Relative Content

Tag Archive for apache-sparkhive

Spark not removing _temporary directory after successful job

I am running a Spark Scala job which creates several hive tables. As far as I can tell, the job succeeds and all the tables are created. However, Spark is not removing the _temporary directory created while the table’s data is being written.