Relative Content

Tag Archive for optimizationpytorch

Doing Gradient Descent Ascent using PyTorch

I want to perform GDA for minimax problems of form $min_xmax_y f(x,y)$. This is the same objective as that in GANs but GDA takes gradient steps simultaneously.
In particular, we need