Intelligent Interfaces and Systems for Human-Computer Interaction

P. 3–13.

Karpov A., Dvoynikova A., Ryumina E.

Abstract. The paper presents a brief review of intelligent interfaces and systems of human-machine interaction. To date, few intelligent interfaces and systems are used in various areas of industry. All the systems of human-machine interaction can be divided into intelligent synthesis and analysis systems. Intelligent synthesis implies the presentation of information from the system to the user. Aiming at presenting information from a person to a system, intelligent analysis is based on state-of-the-art predictive neural networks such as Transformer models with attention mechanisms. Meanwhile, intelligent synthesis is based on generative neural networks designed to generate video, audio and text information for various tasks. The paper briefly describes state-of-the-art methods in this area, as well as provides an overview of existing freely available systems for generating and analyzing uni- and multimodal information. The paper also focuses on recent research results of the Speech and Multimodal Interfaces Laboratory of SPC RAS in this field, as well as presents some methods for solving actual tasks of intelligent analysis.

Keywords: intelligent analysis, artificial intelligence, Intelligent Synthesis

In book

Lecture Notes in Networks and Systems

Vol. 776. , Springer, 2023.