GAN’s solution is a Nash equilibrium and there is no such guarantee in theory. (see https://medium.com/@jonathan_hui/gan-why-it-is-so-hard-to-train-generative-advisory-networks-819a86b3750b)

But in practice, in many projects, we see it converges to some local optimal if properly trained.