When training a simple model the processes were crashed by RuntimeError: No grad accumulator for a saved leaf! in loss.backward(), but I make sure all the data that need to calculate gradients are put on GPUs.