In Spark how to retrieve the all the partition value within foreachPartition method

I have a multi level partitioned data as follows.

spark sql query result issue

I have 2 spark dataset views

How to draw a single Spark monotonically increasing id and pass it to Dataset.map()

Using Java Spark to transform a dataset of object A into a dataset of object B, I use

How to convert a dataframe into a larger schema with java spark

If I have a Dataframe of Row with a schema such as StructType(StructField(Foo,String,true), StructField(Bar,String,true), StructField(XYZ,String,true)) and filled with data. Actual case has 22 columns.

how to create a spark dataset of map of list from spark dataset

I have a data set like this