Parameter sweep: Apparent exponential decay of improvement of processing time with added CPUs?
I recently ran a simple parameter sweep of a Python script I have written which includes mltiprocessing. I sequentially assessed N files (adding 20 files per iteration) across 4, 8, 12, and 16 CPUs and assessed how long the process took to run. I ran this on a node exclusive to my job (i.e. no other processes were competing for resources)