• A
  • A
  • A
  • АБВ
  • АБВ
  • АБВ
  • A
  • A
  • A
  • A
  • A
Обычная версия сайта
  • RU
  • EN
  • HSE University
  • Publications
  • Articles
  • Using large language models for extracting and pre-annotating texts on mental health from noisy data in a low-resource language
  • RU
  • EN
Расширенный поиск
Высшая школа экономики
Национальный исследовательский университет
Priority areas
  • business informatics
  • economics
  • engineering science
  • humanitarian
  • IT and mathematics
  • law
  • management
  • mathematics
  • sociology
  • state and public administration
by year
  • 2027
  • 2026
  • 2025
  • 2024
  • 2023
  • 2022
  • 2021
  • 2020
  • 2019
  • 2018
  • 2017
  • 2016
  • 2015
  • 2014
  • 2013
  • 2012
  • 2011
  • 2010
  • 2009
  • 2008
  • 2007
  • 2006
  • 2005
  • 2004
  • 2003
  • 2002
  • 2001
  • 2000
  • 1999
  • 1998
  • 1997
  • 1996
  • 1995
  • 1994
  • 1993
  • 1992
  • 1991
  • 1990
  • 1989
  • 1988
  • 1987
  • 1986
  • 1985
  • 1984
  • 1983
  • 1982
  • 1981
  • 1980
  • 1979
  • 1978
  • 1977
  • 1976
  • 1975
  • 1974
  • 1973
  • 1972
  • 1971
  • 1970
  • 1969
  • 1968
  • 1967
  • 1966
  • 1965
  • 1964
  • 1963
  • 1958
  • More
Subject
News
November 17, 2026
Physicists Show How a Solvent Shapes the Response of Drug Molecules
Many drug molecules can switch between different three-dimensional shapes. Using a mathematical model of ibuprofen dissolved in supercritical CO₂, researchers from HSE University and the Institute of Solution Chemistry of the Russian Academy of Sciences have shown that the solvent can make these molecules appear to respond unusually slowly. The molecules themselves continue to change shape rapidly, but their surroundings rearrange much more slowly, and this lag shows up in the measurements. The study has been published in The Journal of Chemical Physics. 
November 10, 2026
Physicists Train AI to Optimise Particle Beams in Accelerators
Researchers from the AI and Digital Science Institute at the HSE Faculty of Computer Science and the Budker Institute of Nuclear Physics at the Siberian Branch of the Russian Academy of Sciences have developed RLABC (Reinforcement Learning for Accelerator Beamline Control), a framework that uses reinforcement learning to identify optimal settings for a particle accelerator. In a computer simulation, RLABC optimised the accelerator's parameters to achieve a particle transmission rate of 70%. The study has been published in Computer Physics Communications.
November 9, 2026
'Organ-on-a-Chip Technology Could Eliminate the Need for Animal Testing'
The Laboratory of Molecular Physiology at the HSE Faculty of Biology and Biotechnology investigates how molecular regulators known as microRNAs control gene expression and contribute to the development of diseases, including cancer, viral and inflammatory conditions, and pregnancy complications. At HSE University, researchers develop organ-on-a-chip models: miniature devices containing living cells that mimic the functions of human organs, such as the placenta and intestines. These models help researchers understand how diseases develop and how drugs affect them. HSE News Service spoke with Evgeny Knyazev, Head of the Laboratory.

 

Have you spotted a typo?
Highlight it, click Ctrl+Enter and send us a message. Thank you for your help!

Publications
  • Books
  • Articles
  • Chapters of books
  • Working papers
  • Report a publication
  • Research at HSE

?

Using large language models for extracting and pre-annotating texts on mental health from noisy data in a low-resource language

PeerJ Computer Science, США. 2024. Vol. 10. Article e2395 .
Sergei Koltcov, Surkov A., Koltsova O., Ignatenko V.

 

Recent advancements in large language models (LLMs) have opened new possibilities for developing conversational agents (CAs) in various subfields of mental healthcare. However, this progress is hindered by limited access to high-quality training data, often due to privacy concerns and high annotation costs for low-resource languages. A potential solution is to create human-AI annotation systems that utilize extensive public domain user-to-user and user-to-professional discussions on social media. These discussions, however, are extremely noisy, necessitating the adaptation of LLMs for fully automatic cleaning and pre-classification to reduce human annotation effort. To date, research on LLM-based annotation in the mental health domain is extremely scarce. In this article, we explore the potential of zero-shot classification using four LLMs to select and pre-classify texts into topics representing psychiatric disorders, in order to facilitate the future development of CAs for disorder-specific counseling. We use 64,404 Russian-language texts from online discussion threads labeled with seven most commonly discussed disorders: depression, neurosis, paranoia, anxiety disorder, bipolar disorder, obsessive-compulsive disorder, and borderline personality disorder. Our research shows that while preliminary data filtering using zero-shot technology slightly improves classification, LLM fine-tuning makes a far larger contribution to its quality. Both standard and natural language inference (NLI) modes of fine-tuning increase classification accuracy by more than three times compared to non-fine-tuned training with preliminarily filtered data. Although NLI fine-tuning achieves slightly higher accuracy (0.64) than the standard approach, it is six times slower, indicating a need for further experimentation with NLI hypothesis engineering. Additionally, we demonstrate that lemmatization does not affect classification quality and that multilingual models using texts in their original language perform slightly better than English-only models using automatically translated texts. Finally, we introduce our dataset and model as the first openly available Russian-language resource for developing conversational agents in the domain of mental health counseling.

Research target: Computer Science Psychology
Language: English
Full text
DOI
Text on another site
Keywords: natural language inferencelarge language model (LLM)Большие языковые модели (LLMs)Zero shot classificationPsychological text dataлогический вывод на естественном языкетекстовые психологические данные
Publication based on the results of:
Modelling information and communication behaviour in computer-mediated environments and improving algorithms for behavioural data analysis (2024)
Similar publications
Agentic Large Language Models for Multimodal Item Generation and Automated Review in Educational Assessment: A Framework Using Kazakhstan’s UNT Physics Test
Shinetova L., Omopekunola M., Kardanova E. et al., Sage Open 2026 Vol. 16 No. 4
High-stakes educational assessment requires large numbers of high-quality items, yet item writing and review remain labor-intensive, especially when items include visual stimuli. This study presents a descriptive feasibility evaluation of an agentic large language model (LLM) framework implemented as a role-based, multi-stage LLM orchestration workflow for generating and reviewing multimodal physics multiple-choice items for Kazakhstan’s ...
Added: November 14, 2026
Траектории ставок как сигнал сговора: LSTM-классификация аукционов государственных закупок
Ефимов К. Д., Журнал Новой экономической ассоциации 2026 № 72 С. 105–114
This study proposes a method for automatic detection of collusive behavior in electronic public procurement auctions based on analysis of the full bid trajectory. The empirical dataset comprises 508 auction histories from 2016–2020 collected from the RTS tender e-procurement platform; the positive class is labeled using case materials of the Federal Antimonopoly Service (FAS Russia), ...
Added: November 13, 2026
РУССКОЯЗЫЧНАЯ АДАПТАЦИЯ ОПРОСНИКА ВОЗРАСТНОГО КРИЗИСА (ОВК–РУС) НА ПРИМЕРЕ КРИЗИСА ПЕРВОЙ ЧЕТВЕРТИ ЖИЗНИ
Yerofeyeva V., Nartova-Bochaver S. K., Вопросы психологии 2026 Т. 72 № 2 С. 105–114
The article presents the results of the adaptation of the Developmental Crisis Questionnaire (DCQ–Rus) in Russia (N = 335) using the case of the quarter-life crisis experienced by emerging adults (from 18 to 29 years). At this time, there is an active development of identity and personal authenticity, and the demands of the external environment ...
Added: November 13, 2026
Cultural Variability in the Link Between Affect and Meaning in Life: Evidence From 69 Countries.
Górski M., Costin V., van Tilburg W. et al., Emotion 2026 P. 1–21
People tend to evaluate their lives as more meaningful when they experience morepositive affect and lessnegative affect. However, most evidence for this association comes from Western, educated, industrialized, rich, and democratic societies, which are culturally distinctive in their strong emphasis onhappiness. To assess the cross-cultural generality of the affect–meaning link, we conducted the largest cross-cultural ...
Added: November 13, 2026
Model-Dependent Prompt-Component Ablation for Medical LLM Decision Support: Application to ENT Biologics Screening
Sergey N. Koltcov, Budkovaia M., Surkov A. et al., IEEE Journal of Biomedical and Health Informatics 2026 P. 1–10
Large language models (LLMs) show promise for clinical decision support, but privacy constraints and unreliable free-text decisions limit deployment. We present Medotor, a locally deployed system for screening patients with chronic rhinosinusitis with nasal polyps (CRSwNP) for biologic therapy, and evaluate prompt design on 163 retrospective cases (132 eligible and 31 ineligible). Five models were ...
Added: November 13, 2026
Impact of 5G NR-V2X Message Losses on Connected Vehicle Warning Functions
Физулин А. В., Stepanyants V., Amerikanov A. et al., FUTURE TRANSPORTATION 2026 Vol. 6 No. 6 Article 264
Cooperative warning functions depend on whether V2X information becomes available in time to influence vehicle control. This article presents an event-based co-simulation framework coupling SUMO, ns-3 (ms-van3t), 5G-LENA NR sidelink and application records, with Sionna RT enabled for the intersection scenario. In 140 emergency-vehicle-warning runs, reducing mean packet reception ratio (PRR) from 0.9412 to 0.0675 ...
Added: November 12, 2026
Structural model of decision support system for sustainable development of oil and gas companies
Stoianova A. D., Trofimets V. Y., Matrokhina K. V., International Journal of Engineering, Transactions A: Basics 2025 Vol. 38 No. 4 P. 701–709
The article considers the issue of managerial decision-making in an oil and gas company, which is related to the class of multi-criteria choice problems. To improve the validity of decisions in the context of companies’ sustainable development it is proposed to implement a Decision Support System (DSS). A brief review of the existing methods of ...
Added: November 10, 2026
EdFitter: a hybrid course recommendation system using large language models
Sergei Koltcov, Ryumin D., Alexandr Axyonov et al., PeerJ Computer Science 2026 Article 12:e4141
Educational institutions face increasing pressure to adapt their curricula to the rapidly evolving demands of the job market, and recommender systems can be important tools to guide students in selecting courses that align with their career goals. We present EdFitter, a hybrid course recommendation system that combines pretrained text embeddings for retrieval with large language ...
Added: November 10, 2026
Assessing density equilibration in confined Liquid–Liquid interfaces
Guskov T., Gerke K., Kondratyuk N. et al., Molecular Simulation 2026 Vol. 52 No. 7 P. 546 – 555
Equilibration is often assumed rather than tested in molecular dynamics studies of confined liquid–liquid interfaces, even though different physical properties may relax on different time scales. In this work, equilibration is examined using an automated truncation method based on the marginal standard error rule. Interfacial geometry, wetting behaviour, and density-related properties are analysed for liquid–liquid ...
Added: November 10, 2026
Influence of nuclear quantum effects on metastable states of warm dense hydrogen
Lukyanchuk V., Norman G., Kondratyuk N. et al., Scientific Reports 2026 Vol. 16 No. 1 Article 16435
Previously, it has been effectively shown that nuclear quantum effects (NQE) considerably influence the prediction of the warm dense hydrogen phase diagram. Here, we study the influence of NQE on the parameters of the conducting state formation in warm dense hydrogen using path integral molecular dynamics (PIMD) within the framework of the finite temperature density ...
Added: November 10, 2026
Измерение практик проектной работы преподавателей российских вузов
Antipkina I., Горбушина А. В., Manina V. et al., Психологическая наука и образование 2026 Т. 31 № 4 С. 22–36
Context and relevance. Traditionally, the operationalization of project-based activity among university teachers has been confined to either an inventory of didactic techniques or a delineation of role functions. Yet, should project-based activity be regarded as a distinct construct — namely, a pedagogical competency — it becomes necessary to provide empirical validation of its structure and ...
Added: November 9, 2026
Machine Learning and Knowledge Discovery in Databases. Research Track and Applied Data Science Track. European Conference, ECML PKDD 2026, Naples, Italy, September 7–11, 2026, Proceedings
Cham: Springer, 2027.
This volume is Part VIII of the refereed proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases, ECML PKDD 2026, held in Naples, Italy, September 7–11, 2026. It contains 40 papers from the Research Track and the Applied Data Science Track and is published as volume 16948 of Lecture Notes in ...
Added: November 9, 2026
Artificial Intelligence for Software Engineering (AI4SE): A Review of Capabilities, Evaluation, and Verification Challenges
Avdoshin S.M., Pesotskaya E.Y., Proceedings of the Institute for System Programming of the RAS 2026 Vol. 38 No. 6, part 2 P. 133–146
Artificial intelligence has significantly reshaped contemporary software engineering practice, changing how software systems are designed, implemented, tested, and maintained. Recent advances in large language models and AI-assisted development tools have expanded the role of AI from supporting isolated tasks to participating in multiple stages of the software lifecycle. In many development settings, software is now created from high-level specifications ...
Added: November 8, 2026
MFL-ScrollNet: Recurrent Sliding-Window Detection for Panoramic Pipeline Magnetic Flux Leakage Images
Aleksei Samarin, Belous F., Торопов А. Г. et al., Technologies 2026 Vol. 14 No. 11 P. 1–21
Abstract Automated interpretation of magnetic flux leakage (MFL) data is central to condition assessment of long-distance oil and gas pipelines. Yet, full-resolution panoramas are difficult to process without either suppressing small anomalies through resizing or fragmenting elongated objects at sliding-window boundaries. We propose MFL-ScrollNet, a recurrent sliding-window detector that formulates panoramic analysis as an ordered sequence ...
Added: November 8, 2026
Proceedings 2026 IEEE International Conference on Joint Cloud Computing JCC 2026
IEEE Computer Society (Conference Publishing Services, CPS), 2026.
Added: November 7, 2026
Detecting the undetectable: benchmarking AI-generated text
Sergey Avdoshin, Elena Pesotskaya, Saleh H. et al., Procedia Computer Science 2026 Vol. 292 P. 1332–1341
The rapid development of generative large language models (LLMs) has intensified the need for reliable methods capable of distinguishing AI-generated text from human writing, especially in academic and professional settings. This paper presents the results of a systematic benchmarking study evaluating the performance and limitations of contemporary LLM-text detectors applied to Russian-language academic content. We introduce ...
Added: November 7, 2026
PrimeKV: Preserving critical KV cache without attention scores for long-context inference
Zhang Z., Ilvovsky D., Neurocomputing 2027 Vol. 710
Efficient management of the Key-Value (KV) cache is essential for deploying large language models (LLMs) in long-context scenarios, where memory requirements often exceed the capacity of resource-constrained hardware. Many existing training-free compression algorithms typically rely on attention-driven heuristics, but exhibit two key limitations. First, they require explicit attention score computation, which is difficult to reconcile ...
Added: November 5, 2026
Bytedance и Open Source - открытые проекты от разработчика TikTok
Silakov D., Системный администратор 2026 С. 84–89
Social media users rarely think about what lies behind the beautiful facade of activity feeds, teeming with photos and video stories. However, the widespread popularity of such platforms generates a huge amount of all sorts of content that needs to be stored, processed quickly, and displayed, and in the era of AI, it also needs ...
Added: September 28, 2026
FROM LECTURER TO CHATBOT: EVALUATING A HYBRID TEACHING MODEL
Filatova Asya, Didenko A., Ravedovskaya U., Journal of Teaching English for Specific and Academic Purposes 2025 Vol. 13 No. 3 P. 529–538
Emergence of generative artificial intelligence (GenAI) is revolutionizing teaching and evaluation in higher education. Early adopters have already demonstrated how large language model (LLM) conversational agents can serve as on-demand tutors, yet empirical evidence regarding their effectiveness in facilitating conceptual learning in non-computational domains is scant. Based on constructivist learning theory, this paper presents a ...
Added: September 18, 2026
Proceedings of the 4th Workshop on NLP for Music and Audio (NLP4MusA 2026)
Buzaev F., Mullakhmetov R., Bogachev R. et al., Association for Computational Linguistics, 2026.
Playlist generation based on textual queries using large language models (LLMs) is becoming an important interaction paradigm for music streaming platforms. User queries span a wide spectrum from highly personalized intent to essentially catalog-style requests. Existing systems typically rely on non-personalized retrieval/ranking or apply a fixed level of preference conditioning to every query, which can ...
Added: June 22, 2026
Benchmarking DNA large language models on quadruplexes
Cherednichenko O., Herbert A., Poptsova M., Computational and Structural Biotechnology Journal 2025 Vol. 27 P. 992–1000
Large language models (LLMs) in genomics have successfully predicted various functional genomic elements. While their performance is typically evaluated using genomic benchmark datasets, it remains unclear which LLM is best suited for specific downstream tasks, particularly for generating whole-genome annotations. Current LLMs in genomics fall into three main categories: transformer-based models, long convolution-based models, and state-space models ...
Added: June 19, 2026
Pre-trained LLMs Meet Sequential Recommenders: Efficient User-Centric Knowledge Distillation
Severin N., Kartushov D., Urzhumov V. et al., , in: Advances in Information Retrieval: 48th European Conference on Information Retrieval, ECIR 2026, Delft, The Netherlands, March 29 – April 2, 2026, Proceedings, Part II. (LNCS, volume 16484).: Cham: Springer Publishing Company, 2026. P. 508–517.
Sequential recommender systems have achieved significant success in modeling temporal user behavior but remain limited in cap-turing rich user semantics beyond interaction patterns. Large Language Models (LLMs) present opportunities to enhance user understanding with their reasoning capabilities, yet existing integration approaches cre-ate prohibitive inference costs in real time. To address these limitations, we present a ...
Added: June 18, 2026
ESQA: Event Sequences Question Answering
Abdullaeva I., Karpukhin I., Filatov A. et al., IEEE Access 2026 Vol. 14 P. 59390–59408
Event sequences, a specialized type of tabular data annotated with timestamps, are prevalent across practical domains such as finance, retail, social networks, and healthcare. Despite the importance of event sequence modeling and analysis, there has been little effort to adapt Large Language Models (LLMs) to this domain. In this paper, we propose a novel solution ...
Added: June 16, 2026
Large Language Model-Based Automated Item Generation in STEM Assesements: Historical Mapping and a Scoping Review of Empirical Studies
Omopekunola M., JOURNAL OF EDUCATIONAL TECHNOLOGY DEVELOPMENT AND EXCHANGE 2026 Vol. 19 No. 2 P. 141–165
Educational assessments, from low-stakes classroom tests to high-stakes national examinations, require item pools that are valid, fair, and secure. Automated Item Generation (AIG) aims to efficiently produce large pools of calibrated test items. This paper adopts a two-part design: (1) a brief historical mapping situating LLM-based AIG within the broader AIG trajectory; and (2) a ...
Added: May 5, 2026
  • About
  • About
  • Key Figures & Facts
  • Sustainability at HSE University
  • Faculties & Departments
  • International Partnerships
  • Faculty & Staff
  • HSE Buildings
  • HSE University for Persons with Disabilities
  • Public Enquiries
  • Studies
  • Admissions
  • Programme Catalogue
  • Undergraduate
  • Graduate
  • Exchange Programmes
  • Summer University
  • Summer Schools
  • Semester in Moscow
  • Business Internship
  • Research
  • International Laboratories
  • Research Centres
  • Research Projects
  • Monitoring Studies
  • Conferences & Seminars
  • Academic Jobs
  • Yasin (April) International Academic Conference on Economic and Social Development
  • Media & Resources
  • Publications by staff
  • HSE Journals
  • Publishing House
  • iq.hse.ru: commentary by HSE experts
  • Library
  • Economic & Social Data Archive
  • Video
  • HSE Repository of Socio-Economic Information
  • HSE1993–2026
  • Contacts
  • Copyright
  • Privacy Policy
  • Site Map
Edit