ИССЛЕДОВАНИЕ ВЛИЯНИЯ АДАПТИВНОЙ СПЕКТРАЛЬНОЙ НОРМАЛИЗАЦИИ НА КАЧЕСТВО ГЕНЕРАТИВНЫХ МОДЕЛЕЙ И СТАБИЛЬНОСТЬ ИХ ОБУЧЕНИЯ

Доклады Российской академии наук. Математика, информатика, процессы управления (ранее - Доклады Академии Наук. Математика). 2023. Т. 514. № 2. С. 49–59.

Егоров Е. А., Rogachev A.

When using Wasserstein GAN loss function for training generative adversarial networks (GAN), it is theoretically necessary to limit the discriminators’ expressive power (so called discriminator normalization). Such limitation increases the stability of GAN training at the expense of a less expressive final model. Spectral normalization is one of the normalization algorithms that involves applying a fixed operation independently to each discriminator layer. However, the optimal strength of the discriminator limitation varies for different tasks, which requires a parameterized normalization method. This paper proposes modifications to the spectral normalization algorithm that allow changing the strength of the discriminator limitation. In addition to parameterization, the proposed methods can change the degree of limitation during training, unlike the original algorithm. The quality of the obtained models is explored for each of the proposed methods.

Keywords: high energy physics, физика высоких энергий, generative models, генеративно-состязательные сети, Generative adversarial network, глубокие генеративные модели, spectral normalization, спектральная нормализация

Publication based on the results of: Investigation of Accurate Fast Simulation Machine Learning Models for Charged Particles Passage through Matter: Method Development (2023)