Searching for Interpretable Demographic Patterns

P. 18–31.

Anna Muratova, Islam R., Mitrofanova E., Ignatov D. I.

Nowadays there is a large amount of demographic data which should be analyzed and interpreted. From accumulated demographic data, more useful information can be extracted by applying modern methods of data mining. Two kinds of experiments are considered in this work: 1) generation of additional secondary features from events and evaluation of its influence on accuracy; 2) exploration of features influence on classification result using SHAP (SHapley Additive exPlanations). An algorithm for creating secondary features is proposed and applied to the dataset. The classifications were made by two methods, SVM and neural networks, and the results were evaluated. The impact of events and features on the classification results was evaluated using SHAP; it was demonstrated how to tune model for improving accuracy based on the obtained values. Applying convolutional neural network for sequences of events allowed improve classification accuracy and surpass the previous best result on the studied demographic dataset.

Keywords: data mining, майнинг данных, демографические последовательности, Demographic patterns

Publication based on the results of: Development of Mathematical Models and Methods for Recommender Systems and Natural Language Processing (2019)

In book

Proceedings of the Fifth Workshop on Experimental Economics and Machine Learning at the National Research University Higher School of Economics co-located with the Seventh International Conference on Applied Research in Economics (iCare7)

Aachen: CEUR Workshop Proceedings, 2019.