Hadoop data getting corrupted at every restart of docker hadoop container
We have docker hadoop setup in our evnironment(One master + three worker nodes) each of them running in a seperate container in single physical server, Hadoop file system inside docker is mapped to NFS share in physical server using docker volumes, Below is the configuration on how we mapped it.
volumes:
– “/opt/hadoop/dfs:/opt/hadoop/dfs”