How convert json file into dataframe with spark?
One of my task today is read a simpe json file convert into dataframe and do a loop over the dataframe and do some validations, etc…
How convert a list into multiple columns and a dataframe?
i have a challenge today, is:
Having a list of s3 paths, inside a list, split this and get a dataframe with one column with the path and a new column with just the name of the folder.