Research of heuristic approaches for determining the tonality of text messages in natural language processing problems

P. 159–164.

Polyakov E. V., Polyakov S. V., Abramov P.

Determining the tonality of the text is a difficult task, the solution of which essentially depends on the context, the field of study and the amount of text data. The analysis shows that the authors in their works do not jointly use the full range of possible transformations on the data and their combinations. The article explores a generalized approach, which consists in sequentially passing through the stages of intelligence analysis, obtaining a basic solution, vectorization, preprocessing, tuning hyperparameters and modeling. The experiments carried out by iterative application of these stages give a positive increase in quality for classical machine learning algorithms and a significant increase for deep learning.

Keywords: natural language processing, machine learning, deep learning, vectorization, data pre-processing, automatic machine learning, transfer learning, modeling

In book

Proceedings of 2019 XVI International Symposium "Problems of Redundancy in Information and Control Systems" (REDUNDANCY)

IEEE, 2019.