?
РАСПОЗНАВАНИЕ РУКОПИСНЫХ ГРАФИЧЕСКИХ ЭЛЕМЕНТОВ И МУЛЬТИЯЗЫЧНОГО ТЕКСТА: ОБЗОР СОВРЕМЕННЫХ ПОДХОДОВ, БАЗОВЫЙ МЕТОД И ПЕРСПЕКТИВЫ РАЗВИТИЯ
This article presents an overview of modern methods for solving the problem of recognizing handwritten content, including multilingual text (Russian and English) and graphical elements such as block diagrams consisting of rectangles and arrows, with a focus on the recognition of whiteboard images. For multilingual handwritten text, architectures capable of processing multiple languages are considered, and for block diagrams - methods for recognizing shapes and structure. In addition, the paper proposes a baseline model in which EasyOCR and TrOCR are used for text recognition, and OpenCV-based algorithms that extract shape contours are used for analyzing graphical elements. The purpose of this model is to assess the complexity of solving the given problem using publicly available tools with minimal preparation. The baseline model is focused on the specific task of recognizing content on a whiteboard, and the results are generated in XML format for further processing (e.g., visualization). The system was tested on a specially collected dataset of whiteboard images. The article also discusses the main challenges of the recognition task and outlines promising directions for improving the accuracy and quality of the solution.