How to force releasing memory
I’m trying to iterate over a large file tree reading URL’s and creating hash values, but there’s a memory leak I can’t fix. The consumed memory is growing until the app stopp working. For testing reason I tried to read and hash 600Gb/ 350T files with single files up to 25Gb, writing the URL and hash value to a simple text file. Production data would be at about 50-70Tb/ 1.8M files.