• A
  • A
  • A
  • АБВ
  • АБВ
  • АБВ
  • A
  • A
  • A
  • A
  • A
Обычная версия сайта
  • RU
  • EN
  • HSE University
  • Publications
  • Book chapter
  • MobileEmotiFace: Efficient Facial Image Representations in Video-Based Emotion Recognition on Mobile Devices
  • RU
  • EN
Расширенный поиск
Высшая школа экономики
Национальный исследовательский университет
Priority areas
  • business informatics
  • economics
  • engineering science
  • humanitarian
  • IT and mathematics
  • law
  • management
  • mathematics
  • sociology
  • state and public administration
by year
  • 2027
  • 2026
  • 2025
  • 2024
  • 2023
  • 2022
  • 2021
  • 2020
  • 2019
  • 2018
  • 2017
  • 2016
  • 2015
  • 2014
  • 2013
  • 2012
  • 2011
  • 2010
  • 2009
  • 2008
  • 2007
  • 2006
  • 2005
  • 2004
  • 2003
  • 2002
  • 2001
  • 2000
  • 1999
  • 1998
  • 1997
  • 1996
  • 1995
  • 1994
  • 1993
  • 1992
  • 1991
  • 1990
  • 1989
  • 1988
  • 1987
  • 1986
  • 1985
  • 1984
  • 1983
  • 1982
  • 1981
  • 1980
  • 1979
  • 1978
  • 1977
  • 1976
  • 1975
  • 1974
  • 1973
  • 1972
  • 1971
  • 1970
  • 1969
  • 1968
  • 1967
  • 1966
  • 1965
  • 1964
  • 1963
  • 1958
  • More
Subject
News
June 11, 2026
Mathematicians from Nizhny Novgorod and Shanghai Study System Stability
Mathematicians at HSE University–Nizhny Novgorod, in collaboration with colleagues from Tongji University in Shanghai, are investigating the fundamental causes of structural stability in systems and the mechanisms underlying its disruption. In this interview with the HSE News Service, Prof. Olga Pochinka, Head of the International Laboratory of Dynamical Systems and Applications at HSE University–Nizhny Novgorod and leader of the project ‘Qualitative Theory of Systems of Ordinary and Partial Differential Equations,’ discusses the project, which is being implemented as part of HSE University's International Academic Cooperation programme.
June 11, 2026
Neurolinguists Assist in Awake Surgery on 11-Year-Old Patient with Epilepsy
Researchers at the HSE Centre for Language and Brain took part in a rare awake neurosurgical procedure performed on an 11-year-old patient with drug-resistant epilepsy. Working alongside surgeons at the Voyno-Yasenetsky Centre of Specialised Medical Care for Children in Solntsevo, they monitored the resection of a portion of the left temporal lobe, where the epileptic focus had been identified.
June 11, 2026
Scientists Explain How Emotions Shape Attitudes Toward Digital Governance
Today, interactions between citizens and government increasingly take place through digital governance platforms, including digital public services, AI-powered systems, and algorithmic decision-making tools. Until now, however, these technologies have largely been viewed as technical instruments, with their effectiveness assessed primarily in terms of efficiency and user-friendliness. The authors of a new study propose a broader perspective, arguing that digital governance should also be understood as an emotional experience that directly shapes citizens' trust in public institutions.

 

Have you spotted a typo?
Highlight it, click Ctrl+Enter and send us a message. Thank you for your help!

Publications
  • Books
  • Articles
  • Chapters of books
  • Working papers
  • Report a publication
  • Research at HSE

?

MobileEmotiFace: Efficient Facial Image Representations in Video-Based Emotion Recognition on Mobile Devices

P. 266–274.
Demochkina P., Savchenko A.

In this paper, we address the emotion classification problem in videos using a two-stage approach. At the first stage, deep features are extracted from facial regions detected in each video frame using a MobileNet-based image model. This network has been preliminarily trained to identify the age, gender, and identity of a person, and further fine-tuned on the AffectNet dataset to classify emotions in static images. At the second stage, the features of each frame are aggregated using multiple statistical functions (mean, standard deviation, min, max) into a single MobileEmotiFace descriptor of the whole video. The proposed approach is experimentally studied on the AFEW dataset from the EmotiW 2019 challenge. It was shown that our image mining technique leads to more accurate and much faster decision-making in video-based emotion recognition when compared to conventional feature extractors.

Language: English
Full text
DOI
Text on another site
Keywords: emotion recognitionconvolutional neural networksmobile devicefacial analysisface classificationdeep features

In book

Pattern Recognition. ICPR International Workshops and Challenges. Virtual Event, January 10–15, 2021, Proceedings, Part V
Springer, 2021.
Similar publications
Understanding emotions through biological motion in autism spectrum disorder: A systematic review
Gavrilova E., Novoselova K., Myachykov A. et al., Research in Autism 2026 Vol. 132 Article 202833
Background Body movements convey crucial insights into emotions. Although autistic individuals may process these cues differently, the specific factors influencing emotion-from-motion perception in autism remain poorly understood. This systematic review synthesizes current research and highlights key findings in this area of study. Objectives This systematic review aimed to assess autistic individuals’ ability to recognize emotions through biological motion (operationalized via ...
Added: April 14, 2026
Ансамбль современных моделей компьютерного зрения для задачи обнаружения дипфейков
Pikul A. S., Безопасность информационных технологий 2024 Т. 31 № 4 С. 116–127
This article explores the potential use of modern computer vision architectures for the task of deepfake detection. The following architectures are considered: EfficientNet, Vision Transformer (ViT), VisionLSTM (ViL), Vision KAN, and Mamba Vision. The novelty of the approach lies in the application and comparison of these architectures, as well as their combination into paired ensembles ...
Added: December 12, 2025
Recognition of Mentally Pronounced Russian Phonemes Using Convolutional Neural Networks and Electroencephalography Data
Seleznev L. E., Chupakhin A. A., Kostenko V. A. et al., Optical Memory and Neural Networks (Information Optics) 2023 Vol. 32 No. 2 P. 73–85
We analyze a classification problem of mentally pronounced Russian phonemes based on data obtained by means of an electroencephalography device. We describe the data collection method as well as the methods of the obtained data processing. To solve the small sample size problem we present the augmentation techniques that use the time stretching and the ...
Added: October 2, 2025
Convolutional Neural Networks Decode Finger Movements in Motor Sequence Learning from MEG Data
Zabolotniy A., Chan R. W., Moiseeva V. et al., Frontiers in Neuroscience 2025 Vol. 19 Article 1623380
We demonstrated the feasibility of finger movement decoding with a tailored Convolutional Neural Network. The performance of our approach was comparable to complex deep learning architectures, while providing faster and interpretable outcome. This algorithmic strategy holds high potential for the investigation of the mechanisms underlying non-invasive neurophysiological recordings in cognitive neuroscience. ...
Added: October 2, 2025
Device-Specific Facial Descriptors: Winning a Lottery with a SuperNet
Savchenko A., Maslov D., Makarov I., , in: ECAI 2024. 27th European Conference on Artificial Intelligence, October 19 – 24 October 2024, Santiago de Compostela, Spain – Including 13th Conference on Prestigious Applications of Intelligent Systems (PAIS 2024).: IOS Press, 2024. P. 4439–4442.
Added: February 15, 2025
Automatic Morpheme Segmentation for Russian: Can an Algorithm Replace Experts?
Morozov D., Garipov T., Lyashevskaya O. et al., Journal of Language and Education 2024 Vol. 10 No. 4 P. 71–84
Introduction: Numerous algorithms have been proposed for the task of automatic morpheme segmentation of Russian words. Due to the differences in task formulation and datasets utilized, comparing the quality of these algorithms is challenging. It is unclear whether the errors in the models are due to the ineffectiveness of algorithms themselves or to errors and inconsistencies ...
Added: January 7, 2025
Опыт создания российской базы лиц, изображающих различные эмоции: первый этап
Petrakova A., Лебедева Е. И., Kuzmina Y. et al., Психология. Журнал Высшей школы экономики 2024 Т. 21 № 2 С. 423–431
This article presents a pilot study with the objective to create and test stimulus material, which consists of photographic portraits of adults and children expressing various emotions. The uniqueness of this work is due to the approach to organizing the creation of stimulus material, in which the models demonstrated emotions not according to an established ...
Added: December 26, 2024
Распознавание эмоций в соотнесении к «эмоциональным семействам»
Petrakova A., Лебедева Е. И., Anikudimova E., Экспериментальная психология 2024 Т. 17 № 3 С. 4–15
The work is aimed at studying the performance of emotion recognition of people of different sex and age, expressed without specified criteria, in association with «emotional families». The materials of an empirical online research obtained with the help of the crowdsourcing service «Yandex. Toloka», in which 3,590 tes- ters took part. The subjects guessed one ...
Added: December 26, 2024
Proceedings Volume 11605, Thirteenth International Conference on Machine Vision
Teplyakov L., Kaymakov K., Shvets E. et al., SPIE, 2021.
Line detection is an important computer vision task traditionally solved by Hough Transform. With the advance of deep learning, however, trainable approaches to line detection became popular. In this paper we propose a lightweight CNN for line detection with an embedded parameter-free Hough layer, which allows the network neurons to have global strip-like receptive fields. ...
Added: November 5, 2024
Культурные правила выражения и распознавание эмоций других людей: различия в распознавании гнева представителями армянской и русской культур
Sysoeva T., Айрапетян Е. А., Психологические исследования: электронный научный журнал 2023 Т. 16 № 92 Статья 1
The current study is aimed to investigate the differences in emotion recognition among representatives of Armenian and Russian cultures. A preliminary study demonstrated that Armenians, unlike Russians, tend to control the expression of anger towards in-group members in greater extent. One hypothesis explaining the cultural influence on emotion recognition suggests that expression norms, which require ...
Added: January 29, 2024
Подходы к распознаванию эмоций в интеллектуальных системах
Kartasheva A., Технологос 2020 № 2 С. 15–24
The article examines approaches to emotion recognition in intelligent systems from the point of view of methodological grounds. In interdisciplinary research, where it is necessary to combine approaches from different fields, we face terminological uncertainty, since the problem of describing the emotional sphere is solved by different researchers in line with several main approaches. First, the ...
Added: October 20, 2023
Lightweight and Elegant Data Reduction Strategies for Training Acceleration of Convolutional Neural Networks
Demidovskij A., Artyom Tugaryov, Aleksei Trutnev et al., Mathematics 2023 Vol. 14 No. 11 Article 3120
Due to industrial demands to handle increasing amounts of training data, lower the cost of computing one model at a time, and lessen the ecological effects of intensive computing resource consumption, the job of speeding the training of deep neural networks becomes exceedingly challenging. Adaptive Online Importance Sampling and IDS are two brand-new methods for ...
Added: September 12, 2023
Fast Search of Face Recognition Model for a Mobile Device Based on Neural Architecture Comparator
Savchenko A., Savchenko L., Makarov I., IEEE Access 2023 Vol. 11 P. 65977–65990
This paper addresses the face recognition task for offline mobile applications. Using AutoML techniques, a novel technological framework is proposed to develop a fast neural network-based facial feature extractor for a concrete device. First, the Once-for-All SuperNet is trained on a large facial dataset. Each device is characterized by its lookup table, which contains the ...
Added: August 28, 2023
A standalone software for real-time facial analysis in online conferences and e-lessons
Churaev E., Savchenko A., Software Impacts 2023 Vol. 16 Article 100507
Nowadays, many meetings, lessons, conferences, and presentations are organized online, where it is complicated to communicate with an audience and control their engagement and emotions. In this article, we present a novel C++ application that is led to help estimate facial identities and expressions. It captures a screen with a window of an arbitrary online ...
Added: May 18, 2023
Sex differences in emotional perception: Evidence from population of Tuvans (Southern Siberia)
Mezentseva A. A., Rostovtseva V. V., Ananyeva K. I. et al., Frontiers in Psychology 2022 Vol. 13 Article 924486
Prior studies have reported that women outperform men in nonverbal communication, including the recognition of emotions through static facial expressions. In this experimental study, we investigated sex differences in the estimation of states of happiness, anger, fear, and disgust through static photographs using a two-culture approach. This study was conducted among the Tuvans and Mongolian ...
Added: October 31, 2022
Correlation analysis of the data from a mobile device accelerometer to detect the difference in step duration
Borisova M. D., Tomchuk K. K., A. M. Turlikov, , in: 2020 Wave Electronics and its Application in Information and Telecommunication Systems (WECONF).: IEEE, 2020. Ch. 9131479 P. 1–4.
The work considers a method for determining average relative difference in the length of the left and right legs' steps when walking on straight even surface. This value indirectly characterizes the degree of a number of diseases of the musculoskeletal and central nervous systems. The measurement interval for the difference in duration by the proposed ...
Added: October 31, 2022
Multi-user facial emotion recognition in video based on user-dependent neural network adaptation
Churaev E., Andrey V. Savchenko, , in: 2022 VIII International Conference on Information Technology and Nanotechnology (ITNT).: IEEE, 2022. P. 1–5.
In this paper, the multi-user video-based facial emotion recognition is examined in the presence of a small data set with the emotions of end users. By using the idea of speaker-dependent speech recognition, we propose a novel approach to solve this task if labeled video data from end users is available. During the training stage, ...
Added: September 25, 2022
Video-based Frame-level Facial Analysis of Affective Behavior on Mobile Devices using EfficientNets
Savchenko A., , in: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).: IEEE, 2022. P. 2358–2365.
In this paper, we consider the problem of real-time video-based facial emotion analytics, namely, facial expression recognition, prediction of valence and arousal and detection of action unit points. We propose the novel frame-level emotion recognition algorithm by extracting facial features with the single EfficientNet model pre-trained on Affect-Net. The predictions for sequential frames are smoothed ...
Added: August 29, 2022
  • About
  • About
  • Key Figures & Facts
  • Sustainability at HSE University
  • Faculties & Departments
  • International Partnerships
  • Faculty & Staff
  • HSE Buildings
  • HSE University for Persons with Disabilities
  • Public Enquiries
  • Studies
  • Admissions
  • Programme Catalogue
  • Undergraduate
  • Graduate
  • Exchange Programmes
  • Summer University
  • Summer Schools
  • Semester in Moscow
  • Business Internship
  • Research
  • International Laboratories
  • Research Centres
  • Research Projects
  • Monitoring Studies
  • Conferences & Seminars
  • Academic Jobs
  • Yasin (April) International Academic Conference on Economic and Social Development
  • Media & Resources
  • Publications by staff
  • HSE Journals
  • Publishing House
  • iq.hse.ru: commentary by HSE experts
  • Library
  • Economic & Social Data Archive
  • Video
  • HSE Repository of Socio-Economic Information
  • HSE1993–2026
  • Contacts
  • Copyright
  • Privacy Policy
  • Site Map
Edit