Spark application that loads data into elasticsearch keeps hanging
We are facing some issues with our spark application that loads data from s3 to elasticsearch. Since some weeks these jobs are not closing off correctly anymore in Kubernetes.
We are facing some issues with our spark application that loads data from s3 to elasticsearch. Since some weeks these jobs are not closing off correctly anymore in Kubernetes.