How to call different function based on column value in dataframe in Pyspark
I have dataframe which contains column1, column2 and column3 , column2 can version value like 1.0 or 2.0.
based on this column i need process the dataframe columns. Something like:
if(column2 > 1.0)
call method1()
else
call method2()