• A
  • A
  • A
  • АБВ
  • АБВ
  • АБВ
  • A
  • A
  • A
  • A
  • A
Обычная версия сайта
  • RU
  • EN
  • HSE University
  • Publications
  • Articles
  • Distractor Generation for Lexical Questions Using Learner Corpus Data
  • RU
  • EN
Расширенный поиск
Высшая школа экономики
Национальный исследовательский университет
Priority areas
  • business informatics
  • economics
  • engineering science
  • humanitarian
  • IT and mathematics
  • law
  • management
  • mathematics
  • sociology
  • state and public administration
by year
  • 2027
  • 2026
  • 2025
  • 2024
  • 2023
  • 2022
  • 2021
  • 2020
  • 2019
  • 2018
  • 2017
  • 2016
  • 2015
  • 2014
  • 2013
  • 2012
  • 2011
  • 2010
  • 2009
  • 2008
  • 2007
  • 2006
  • 2005
  • 2004
  • 2003
  • 2002
  • 2001
  • 2000
  • 1999
  • 1998
  • 1997
  • 1996
  • 1995
  • 1994
  • 1993
  • 1992
  • 1991
  • 1990
  • 1989
  • 1988
  • 1987
  • 1986
  • 1985
  • 1984
  • 1983
  • 1982
  • 1981
  • 1980
  • 1979
  • 1978
  • 1977
  • 1976
  • 1975
  • 1974
  • 1973
  • 1972
  • 1971
  • 1970
  • 1969
  • 1968
  • 1967
  • 1966
  • 1965
  • 1964
  • 1963
  • 1958
  • More
Subject
News
November 17, 2026
Physicists Show How a Solvent Shapes the Response of Drug Molecules
Many drug molecules can switch between different three-dimensional shapes. Using a mathematical model of ibuprofen dissolved in supercritical CO₂, researchers from HSE University and the Institute of Solution Chemistry of the Russian Academy of Sciences have shown that the solvent can make these molecules appear to respond unusually slowly. The molecules themselves continue to change shape rapidly, but their surroundings rearrange much more slowly, and this lag shows up in the measurements. The study has been published in The Journal of Chemical Physics. 
November 10, 2026
Physicists Train AI to Optimise Particle Beams in Accelerators
Researchers from the AI and Digital Science Institute at the HSE Faculty of Computer Science and the Budker Institute of Nuclear Physics at the Siberian Branch of the Russian Academy of Sciences have developed RLABC (Reinforcement Learning for Accelerator Beamline Control), a framework that uses reinforcement learning to identify optimal settings for a particle accelerator. In a computer simulation, RLABC optimised the accelerator's parameters to achieve a particle transmission rate of 70%. The study has been published in Computer Physics Communications.
November 9, 2026
'Organ-on-a-Chip Technology Could Eliminate the Need for Animal Testing'
The Laboratory of Molecular Physiology at the HSE Faculty of Biology and Biotechnology investigates how molecular regulators known as microRNAs control gene expression and contribute to the development of diseases, including cancer, viral and inflammatory conditions, and pregnancy complications. At HSE University, researchers develop organ-on-a-chip models: miniature devices containing living cells that mimic the functions of human organs, such as the placenta and intestines. These models help researchers understand how diseases develop and how drugs affect them. HSE News Service spoke with Evgeny Knyazev, Head of the Laboratory.

 

Have you spotted a typo?
Highlight it, click Ctrl+Enter and send us a message. Thank you for your help!

Publications
  • Books
  • Articles
  • Chapters of books
  • Working papers
  • Report a publication
  • Research at HSE

?

Distractor Generation for Lexical Questions Using Learner Corpus Data

Jazykovedny Casopis. 2023. Vol. 74. No. 1. P. 345–356.
Nikita Login

Learner corpora with error annotation can serve as a source of data for automated question generation (QG) for language testing. In case of multiple choice gapfill lexical questions, this process involves two steps. The first step is to extract sentences with lexical corrections from the learner corpus. The second step, which is the focus of this paper, is to generate distractors for the retrieved questions. The presented approach (called DisSelector) is based on supervised learning on specially annotated learner corpus data. For each sentence a list of distractor candidates was retrieved. Then, each candidate was manually labelled as a plausible or implausible distractor. The derived set of examples was additionally filtered by a set of lexical and grammatical rules and then split into training and testing subsets in 4:1 ratio. Several classification models, including classical machine learning algorithms and gradient boosting implementations, were trained on the data. Word and sentence vectors from language models together with corpus word frequencies were used as input features for the classifiers. The highest F1-score (0.72) was attained by a XGBoost model. Various configurations of DisSelector showed improvements over the unsupervised baseline in both automatic and expert evaluation. DisSelector was integrated into an opensource language testing platform LangExBank as a microservice with a REST API.

Research target: Philology and Linguistics
Language: English
Full text
DOI
Text on another site
Keywords: учебный корпусlearner corporadistractor generationautomated question generationгенерация неправильных вариантов ответаавтоматизированная генерация вопросов
Publication based on the results of:
Second-language acquisition modelling within different frameworks of existing theories on the basis of learner corpora platforms for experiments and computer tools (2023)
Similar publications
«Сохрани мою речь...». Мандельштамовский альманах.
СПб.: Свет, 2026.
Мандельштамовское общество в сотрудничестве с Центром цифровых архивных исследований Школы филологических наук Научно-исследователь ского университета «Высшая школа экономики» возобновляет выпуск серии традиционных Мандельштамовских альманахов «Сохрани мою речь...». Ранее серия под эгидой Мандельштамовского общества выходила в издательствах «Обновление» (1991, выпуск 1), «Книжный сад» (1994, выпуск 2) и РГГУ (2000, 2008, 2011, выпуски 3–5). Шестой выпуск посвящен ...
Added: November 17, 2026
An Awkward Oikonym: Obscene Toponymy and Traditional Culture
Moroz A., Folklore (Estonia) 2026 Vol. 101 P. 441–456
Abstract. The article examines the situation surrounding an informal yet widely known and historically attested oikonym derived from an obscene word. On the one hand, the existence of this obscene oikonym serves as a point of pride and a unusual peculiarity, eagerly shared with ‘outsiders’ by locals. On the other hand, it makes the residents ...
Added: November 16, 2026
Вокруг Иосифа Бродского: неподцензурная литература 1950-х — 1970-х годов: материалы II международной конференции 28–29 мая 2025 года, Санкт-Петербург
Penskaja E., СПб.: ООО «Журнал «Звезда», 2026.
The collection includes articles by authoritative literary scholars—participants in the Second International Scholarly Conference “Around Joseph Brodsky: Uncensored Literature of the 1950s–1970s,” held in May 2025 in St. Petersburg. The collection is divided into two sections. The first section—“Joseph Brodsky: Biography and Creative Work in the Context of His Time”—is devoted to the life and ...
Added: November 15, 2026
Этнолингвистика. Ономастика. Этимология. Материалы VI Международной научной конференции, посвященной 100-летию со дня рождения А. К. Матвеева. Екатеринбург, 24–27 сентября 2026 г.
Moroz A., Издательство Уральского университета, 2026.
The field materials obtained through many years of work by folklore expeditions of RSUH and HSE University in various regions of Russia and the eastern regions of Belarus contain a large number of relatively uniform contexts in which an informant tells a story about events involving the manifestation of a demonological character, the manifestation of ...
Added: November 14, 2026
О чем говорит школьный урок? Корпусный анализ структуры урока и речи учителя как основа для педагогических продуктов
Виноградова Ю. С., Браташ В. С., Zubov V. et al., Вопросы образования 2026 Т. 1 № 3 С. 94–131
The aim of the study is to describe the structure of a school lesson and identify linguistic characteristics associated with effective teaching practices, based on recordings of real lessons in schools of the Russian Federation. Fifty-five audio recordings of lessons (Grades 5–9, six subjects, 2022–2024) were annotated for lesson structure, phonetic, lexical, and grammatical features, ...
Added: November 13, 2026
Берестяные грамоты из раскопок 2024 г. II. Великий Новгород, Старая Русса, Меглецы
Gippius A., Вопросы языкознания 2026 № 6 С. 7–26
This article presents a preliminary publication of 14 birchbark letters discovered during the 2024 archaeological season in Veliky Novgorod. Of particular historical and linguistic interest is a group of seven documents from the second half of the 14th century attributed to scribe Fefila, who was associated with posadnik Ontsifor Lukinich. It includes, in particular, court ...
Added: November 13, 2026
Thematic Clusters and Linguistic Features of Fashion Anglicisms Used by Russian Fashion Influencers
Karamalak O., Dionysios Zoumpalidis, English Today 2026 P. 1–11
The study explores the use of Anglicisms in the discourse of Russian speaking fashion influencers on YouTube, focusing on the thematic usage and linguistic adaptation of English borrowings to the Russian language. This topic is highly relevant due to the unprecedented popularity of digital social media and influencers who manipulate consumers’ opinions. Research methodology implies ...
Added: November 12, 2026
«Пролитая чаша» (Театр сатиры, 1952): нарративная адаптация и стилизация китайской классики как опыт межкультурного диалога
Чэнь Б., Penskaja E., Театр. Живопись. Кино. Музыка 2026 № 1 С. 150–162
Based on a  wide range of unpublished archival documents the article presents a comprehensive philological and historical-theatrical analysis of the first Soviet production of the classical Chinese drama The Western Chamber (Wang Shifu, 13th century) — the play The Spilled Cup (Moscow Satire Theatre, 1952, dir. N. V. Petrov and V. N. Pluchek, adaptation by A. P. Globа). ...
Added: November 11, 2026
“A Nursery of Technique,” the Laboratory in the Socio-Cultural Context of the 1920s–1930s: Between Practice and Metaphor
Penskaja E., Arts 2026 Vol. 15 No. 7 P. 172–203
This article analyzes the laboratory discourse in Soviet society during the first third of the twentieth century through the lens of tékhnē—the ancient fusion of making and knowing—arguing that the laboratory became a key site for redefining artistic practice as a form of knowledge production. Drawing on the institutional critique of the laboratory (Bruno Latour), ...
Added: November 11, 2026
"Подопытный". Сергей Петров и Осип Мандельштам
Penskaja E., "Сохрани мою речь..." Мандельштамовский альманах 2026 № 6 С. 206–219
This paper  is about the meeting between Nadezhda Yakovlevna Mandelstam and Sergei Vladimirovich Petrov (1911–1988), a poet, translator, and prose writer.³ He had been through prison and exile; after rehabilitation he taught foreign languages, and from 1960 he led a seminar of Scandinavianists in the literary translation section of the Leningrad branch of the Writers’ ...
Added: November 11, 2026
Латерализация функциональной гемодинамики мозга у детей раннего возраста как предиктор расстройств развития языка и речи: обзор литературы
Kibardina A., Vinogradova V., Alexeeva S. V. et al., Вопросы современной педиатрии 2026 Т. 25 № 6 С. 0–0
Проблема ранней диагностики расстройств развития языка и речи сохраняет актуальность в педиатрии. Успешность абилитации при таких расстройствах определяется ранним началом абилитационных мероприятий, но собственно речевые признаки дизонтогенеза в раннем возрасте (0-5 лет) еще недостаточно информативны для инициации вмешательства. По этой причине интерес представляют предикторы расстройств развития языка и речи, доступные для измерения на ранних этапах речевого развития. ...
Added: November 11, 2026
The Syriac Story of the Body of John the Baptist: A Newly Discovered Parabiblical Composition
Minov S., Bible and Christian Antiquity 2026 Vol. 8 No. 1 P. 15–59
The article presents the editio princeps, translation, and commentary of a newly discovered parabiblical composition attested thus far only in Syriac: the Story of the Body of John the Baptist. Produced during the Islamic period in the East Syrian milieu, this work offers a detailed account of John’s life and death, as well as the ...
Added: November 10, 2026
Correcting or Rewriting? An Expert Evaluation of LLM-Based GEC on Academic Learner Data
Kopylova E.V., Tsegoeva O. G., Berlin V.A. et al., , in: Компьютерная лингвистика и интеллектуальные технологии: По материалам ежегодной международной конференции «Диалог». Выпуск 24Issue 24.: M.: Max press, 2026. Ch. 26 P. 1–10.
This paper investigates how large language models correct complex grammatical errors in Russian academic learner writing. Unlike traditional minimal-edit GEC systems, LLMs often apply generative rewriting strategies that may improve fluency, but risk structural overcorrection and semantic drift. We introduce a new expert benchmark derived from an authentic 3,1M-word learner corpus and construct an evaluation set annotated for ...
Added: June 27, 2026
L1 Influence on the Use of the English Present Perfect: A Corpus Analysis of Russian and Spanish Learners’ Essays
Perez-Guerra J., Smirnova E. A., Journal of Language and Education 2024 Vol. 10 No. 1 P. 101–114
Mastering verbal tenses, especially those expressing aspect, in a second language presents a challenge as learners frequently link the semantic nuances of verbal forms in their second language (L2) to the characteristics of the verbal systems in their native languages (L1). This study explores the impact of L1 on the usage of the English Present ...
Added: March 3, 2024
Обработка слов с частотными орфографическими ошибками (исследование на базе учебного корпуса английского языка)
Klimova M., Viklova A., Overnikova D., Вестник Санкт-Петербургского университета. Язык и литература 2023 Т. 20 № 4 С. 824–837
The article presents an experimental study of the influence of the frequency of spelling errors in a word on its representation in mental lexicon. The hypothesis that frequently misspelled words cause difficulties in reading even if they are written correctly has been proved for native speakers of Russian and English. This paper aims to check ...
Added: January 26, 2024
Устный учебный корпус РКИ: новый источник данных для лингвистических и методических исследований
Vlasova E., Бец Ю. В., Северина Е. М., В кн.: «Русская грамматика в диалоге научных школ, направлений, методов».: Владивосток: Издательство ДВФУ, 2022.
В статье анализируются нетривиальные фонетические и грамматические явления устной речи иностранцев, изучающих русский язык. Показано, что устный учебный корпус позволяет получить систематическое представление о компенсаторных механизмах речепорождения, проверять и формулировать гипотезы. ...
Added: November 8, 2023
Аннотирование учебного корпуса в аспекте его использования для исследовательских задач
Klimova M., Viklova A., Overnikova D., В кн.: Современная лингвистика: от теории к практике. III Казанский международный лингвистический саммит (Казань, 14–19 ноября 2022 г.): Труды и материалы, в трёх томах, том 1.: Каз.: Издательство Казанского университета, 2022. С. 46–50.
В данной статье рассматривается классификация ошибок, используемая в учебном корпусе REALEC, в аспекте ее соответствия требованиям и приспособленности для исследовательских задач. ...
Added: January 17, 2023
Review of Practices of Collecting and Annotating Texts in the Learner Corpus REALEC
Vinogradova O. I., Lyashevskaya O., , in: Text, Speech, and Dialogue. 25th International Conference, TSD 2022, Brno, Czech Republic, September 6–9, 2022, Proceedings Lecture Notes in Computer Science (LNAI), vol. 13502Vol. 13502.: Cham: Springer Publishing Company, 2022. P. 77–88.
REALEC, learner corpus released in the open access, had received 6,054 essays written in English by HSE undergraduate students in their English university-level examination by the year 2020. This paper reports on the data collection and manual annotation approaches for the texts of 2014–2019 and discusses the computer tools available for working with the corpus. ...
Added: October 5, 2022
Word-formation complexity: a learner corpus-based study
Lyashevskaya O., Pyzhak J.V., Vinogradova O. I., Russian Journal of Linguistics 2022 Vol. 26 No. 2 P. 471–492
This article explores the word-formation dimension of learner text complexity which indicates how skilful the non-native speakers are in using more and less complex - and varied - derivational constructions. In order to analyse the association between complexity and writing accuracy in word formation as well as interactive effects of task type, text register, and ...
Added: October 5, 2022
Using an Error-Annotated Learner Corpus (REALEC) in DDL Lessons
M. A. Klimova, V. K. Smilga, D. A. Overnikova, , in: Труды международной конференции «Корпусная лингвистика–2021».: Скифия-принт, 2021. P. 112–121.
Added: October 31, 2021
Автоматическое обнаружение и исправление деривационных ошибок в письменной речи на русском как иностранном
Vyrenkova A. S., Смирнов И. Ю., Вестник Новосибирского государственного университета. Серия: Лингвистика и межкультурная коммуникация 2021 Т. 19 № 3 С. 57–68
Learner corpora serve as one of the most valuable sources of statistical data on learners' errors. For instance, data from foreign-language learners’ corpora can be used for the Second Language Acquisition research. However, corpora representativity strongly depends on the quality of its error markup, which is most frequently carried out manually and thus presents a ...
Added: September 24, 2021
Межъязыковая интерференция при выборе видо-временных форм английских глаголов в эссе русскоязычных студентов: корпусное исследование
Vinogradova O. I., Viklova A., В кн.: Межкультурное пространство: лингвистический и дидактический аспектыЧ. 2: Материалы секций «Межкультурная лингвистика», «Межкультурная транслатология» и студенческого научного форума.: Петрозаводск: Издательство ПетрГУ, 2021. С. 17–27.
Added: July 7, 2021
Hedges in Russian EAP writing: A corpus-based study of research papers in management
Smirnova E. A., Стринюк С. А., Journal of English as a Lingua Franca 2020 Vol. 9 No. 1 P. 81–101
The fact that English has become a lingua franca of academic communication has led to increased attention to teaching English for academic purposes (EAP) at the academia. Academic discourse markers, such as hedges, have been an important topic in academic writing research whose prime aim is helping non-Anglophone researchers to present their research findings in ...
Added: October 14, 2020
POS tagger evaluation for the automated text analysis and identification of learner error
Vinogradova O. I., Buzanov A., Генералова С. А. et al., , in: ПРОСТРАНСТВО НАУЧНЫХ ИНТЕРЕСОВ: ИНОСТРАННЫЕ ЯЗЫКИ И МЕЖКУЛЬТУРНАЯ КОММУНИКАЦИЯ - СОВРЕМЕННЫЕ ВЕКТОРЫ РАЗВИТИЯ И ПЕРСПЕКТИВЫВып. 3.: Буки Веди, 2019. Ch. 6 P. 44–49.
Working with learner corpora requires elaborate NLP techniques such as POS-annotation. In this article a team of computational linguists presents their experience of choosing a POS-tagger for precise and effortless annotation of .txt files with Python3. Russian Error-Annotated Learner English Corpus (REALEC) is the underlying corpora to which text features the POS-tagger has to respond. ...
Added: December 28, 2019
  • About
  • About
  • Key Figures & Facts
  • Sustainability at HSE University
  • Faculties & Departments
  • International Partnerships
  • Faculty & Staff
  • HSE Buildings
  • HSE University for Persons with Disabilities
  • Public Enquiries
  • Studies
  • Admissions
  • Programme Catalogue
  • Undergraduate
  • Graduate
  • Exchange Programmes
  • Summer University
  • Summer Schools
  • Semester in Moscow
  • Business Internship
  • Research
  • International Laboratories
  • Research Centres
  • Research Projects
  • Monitoring Studies
  • Conferences & Seminars
  • Academic Jobs
  • Yasin (April) International Academic Conference on Economic and Social Development
  • Media & Resources
  • Publications by staff
  • HSE Journals
  • Publishing House
  • iq.hse.ru: commentary by HSE experts
  • Library
  • Economic & Social Data Archive
  • Video
  • HSE Repository of Socio-Economic Information
  • HSE1993–2026
  • Contacts
  • Copyright
  • Privacy Policy
  • Site Map
Edit