I am trying to make c++ neural network library and i noticed, that sometimes model with same inputs and same parameter values drastically changes output for no reason. I have no idea why it happens, and i am sure that i didn’t made any mistakes. It’s looks like my fpu gets exhausted and losses a little bit of precision which results in very diffrent outputs in larger networks (eg. 10m params).