Stable Topic Modeling with Local Density Regularization

P. 176–188.

Sergei Koltcov, Nikolenko S. I., Olessia Koltsova, Vladimir Filippov, Svetlana Bodrunova

Topic modeling has emerged over the last decade as a powerful tool for analyzing large text corpora, including Web-based user-generated texts. Topic stability, however, remains a concern: topic models have a very complex optimization landscape with many local maxima, and even different runs of the same model yield very different topics. Aiming to add stability to topic modeling, we propose an approach to topic modeling based on local density regularization, where words in a local context window of a given word have higher probabilities to get the same topic as that word. We compare several models with local density regularizers and show how they can improve topic stability while remaining on par with classical models in terms of quality metrics.

Keywords: стабильность, Gibbs sampling, topic modeling, LDA, stability, латентное размещение Дирихле, тематическое моделирование, алгоритм сэмплирования Гиббса

Publication based on the results of: Internet use and Internet users: cross-country and cross-regional comparisons (2016)

In book

Internet Science, Proc. of 3d conf INSCI 2016, Lecture Notes in Computer Science series

Vol. 9934. , Switzerland: Springer, 2016.