How to convert latitude and longitude columns in parquet format dataframe to point type (geometry) with Apache Sedona?
I have 100 Terabytes of data in parquet format. The data has lots of columns including latitude and longitude columns. I would like to use Apache Sedona to convert these columns to point type column (geometry), so that I will be able to do some other functions such as find the points in polygon. I am using databricks notebook with pyspark 3.2.