Relative Content

Tag Archive for pythonnumpyshared-memorymultiprocess

Writing to numpy array in shared memory failing past a certain size threshold, but only in IDEs

I’m trying to implement a shared numpy array for use in multiprocessing. It works fine on smaller arrays, but then failed when I tried to use a ~2.7GB numpy array (about 5.6Mx64 matrix). After a little tinkering, I found that the error occurs when writing the input matrix to the assigned shared memory, e.g. if dst is the buffered numpy array and test_matrix is the large matrix being copied over, then dst[:] = test_matrix[:] throws the following system error: Process finished with exit code 135 (interrupted by signal 7:SIGBUS).