I’m a new student in machine learning, currently learning about Pytorch. It is mentioned that running Pytorch tensors in GPU is much faster than running any array/tensor/dictionary in CPU. I have the following code for Q-learning using OpenAI’s frozen lake environment which I wrote using python dictionary operations: