?
Automatic dependency parsing of a learner English corpus REALEC
NRU HSE
,
2017.
Lyashevskaya O., Пантелеева И. М.
The paper presents a Universal Dependencies (UD) annotation scheme for a learner English corpus. The REALEC dataset consists of essays written in English by Russian-speaking university students in the course of general English. The essays are a part of students' preparation for the independent final examination similar to the international English exam. While adjusting existing dependency parsing tools to a learner data, one has to take into account to what extent students' mistakes provoke errors in the parser output. The ungrammatical and stylistically inappropriate utterances may challenge parsers' algorithms trained on grammatically appropriate written texts. In our experiments, we compared the output of the dependency parser UDpipe (trained on UD-English 2.0) with the results of manual parsing, placing a particular focus on parses of ungrammatical English clauses. We show how mistakes made by students influence the work of the parser. Overall, UDpipe performed reasonably well (UAS 92.9, LAS 91.7). The following cases cause the errors in automatic annotation a) incorrect detection of a head, b) incorrect detection of the relation type, as well as c) both. We propose some solutions which could improve the automatic output and thus make the assessment of syntactic complexity more reliable.
Priority areas:
humanitarian
Language:
English
Keywords: учебный корпусанглийский язык как иностранныйlearner corpusuniversal dependenciesуниверсальные зависимостиdependency annotation of learner treebankevaluation of parser qualityL2 Englishсинтаксическая разметка корпусаразметка синтаксических зависимостейсинтаксическая разметка учебного корпусаоценка качества синтаксического парсинга
Publication based on the results of:
Voronina Y., Kuryan M., Н. Новгород: Нижегородский государственный технический университет им. Р.Е. Алексеева, 2026.
Modern foreign-language teaching is aimed at developing not only language skills but also the ability to organise and expres ideas logically and present one’s own position with well-supported arguments. In this context, academic writing is particularly important because it helps learners develop critical thinking, analyse information, compare different points of view, and support their conclusions with convincing ...
Added: November 18, 2026
СПб.: Свет, 2026.
Мандельштамовское общество в сотрудничестве с Центром цифровых архивных исследований Школы филологических наук Научно-исследователь ского университета «Высшая школа экономики» возобновляет выпуск серии традиционных Мандельштамовских альманахов «Сохрани мою речь...». Ранее серия под эгидой Мандельштамовского общества выходила в издательствах «Обновление» (1991, выпуск 1), «Книжный сад» (1994, выпуск 2) и РГГУ (2000, 2008, 2011, выпуски 3–5). Шестой выпуск посвящен ...
Added: November 17, 2026
Burov A., Котыхов А. С., Aksyonov D. et al., Computer Physics Communications 2027 Vol. 330 Article 110458
Explicit incorporation of magnetic degrees of freedom in machine-learning interatomic potentials (magnetic MLIPs)
plays a crucial role in the correct description of magnetic materials and their properties. An important ingredient
for fitting of magnetic MLIPs is spin-polarized density functional theory (DFT) calculations with non-equilibrium
magnetic moments, i.e. DFT calculations with constraints on magnetic moments. In this study, we ...
Added: November 17, 2026
Kertesz-Farkas A., Andrey B., Plos One 2026 Vol. 21 No. 11 P. 1–20
Background
Domain shifts or batch effects can significantly degrade the performance of machine learning-based classifiers in software production without any warning. This can particularly be problematic in medical applications which involve human lives. The shift changes the shape of the prediction score distribution of the test samples compared to that of the training samples; hence, decision ...
Added: November 17, 2026
Moroz A., Folklore (Estonia) 2026 Vol. 101 P. 441–456
Abstract. The article examines the situation surrounding an informal yet widely known and historically attested oikonym derived from an obscene word. On the one hand, the existence of this obscene oikonym serves as a point of pride and a unusual peculiarity, eagerly shared with ‘outsiders’ by locals. On the other hand, it makes the residents ...
Added: November 16, 2026
Penskaja E., СПб.: ООО «Журнал «Звезда», 2026.
The collection includes articles by authoritative literary scholars—participants in the Second International Scholarly Conference “Around Joseph Brodsky: Uncensored Literature of the 1950s–1970s,” held in May 2025 in St. Petersburg. The collection is divided into two sections. The first section—“Joseph Brodsky: Biography and Creative Work in the Context of His Time”—is devoted to the life and ...
Added: November 15, 2026
Moroz A., Издательство Уральского университета, 2026.
The field materials obtained through many years of work by folklore expeditions of RSUH and HSE University in various regions of Russia and the eastern regions of Belarus contain a large number of relatively uniform contexts in which an informant tells a story about events involving the manifestation of a demonological character, the manifestation of ...
Added: November 14, 2026
Виноградова Ю. С., Браташ В. С., Zubov V. et al., Вопросы образования 2026 Т. 1 № 3 С. 94–131
The aim of the study is to describe the structure of a school lesson and identify linguistic characteristics associated with effective teaching practices, based on recordings of real lessons in schools of the Russian Federation. Fifty-five audio recordings of lessons (Grades 5–9, six subjects, 2022–2024) were annotated for lesson structure, phonetic, lexical, and grammatical features, ...
Added: November 13, 2026
Poddiakov A., / Series Social Science Research Network "Social Science Research Network". 2026. No. 7437658.
Clarity of knowledge and reasoning is necessary in many cases. Yet vagueness in scientific thinking related to surprise, curiosity, "ability to engage with not-knowing" (de Freitas) and abductive reasoning is also a crucially important source of scientific creativity which supplements combinatorial logic when dealing with the already known. Starting from studies by C. S. Peirce ...
Added: September 15, 2026
Kopylova E.V., Tsegoeva O. G., Berlin V.A. et al., , in: Компьютерная лингвистика и интеллектуальные технологии: По материалам ежегодной международной конференции «Диалог». Выпуск 24Issue 24.: M.: Max press, 2026. Ch. 26 P. 1–10.
This paper investigates how large language models correct complex grammatical errors in Russian academic
learner writing. Unlike traditional minimal-edit GEC systems, LLMs often apply generative rewriting strategies that
may improve fluency, but risk structural overcorrection and semantic drift. We introduce a new expert benchmark
derived from an authentic 3,1M-word learner corpus and construct an evaluation set annotated for ...
Added: June 27, 2026
Kudriavtseva E., / РЦИС. Серия № 0148-756-286. 2026.
The content of the work is the system is a system for identifying four types of written speech structures. A set of 11 calculated parameters, statistical standards, and semantic characteristics allows for the identification of a text's structure as the result of a specific cognitive schema (scene, event, story, evaluation). The method has been verified ...
Added: June 2, 2026
Vorchik A., / SSRN. Серия Social Science Research Network "Social Science Research Network". 2026.
This work is devoted to a theoretical explanation of the Easterlin paradox, according to which long-term economic growth does not make average level of people's happiness increasing. By happiness, we mean the intensity of emotions people experience while comparing their new income with its expected value, or the target income with its original value. In the first case, ...
Added: May 31, 2026
Strizhkova D., / Институт русской литературы (Пушкинский Дом) РАН. Серия B001 "Репозиторий открытых данных по русской литературе и фольклору". 2026.
В базе данных представлена роспись русскоязычных литературных произведений и отрывков, напечатанных в учебниках по словесности, хрестоматиях, книгах для чтения, сборниках стихотворений и рассказов, выходивших во Франции, Германии, Латвии, Эстонии, Болгарии, Сербии в период первой волны русской эмиграции с 1918 по 1939 гг. Датасет представляет интерес для исследователей школьного литературного канона, эмиграции и детского чтения ...
Added: April 22, 2026
Жигунов А. Ю., / Basic Research Programme. Серия HUM "Humanities". 2026. № 1.
The article attempts to describe the features of the educational potential of Russian animation programmes in aspect of the representation of traditional spiritual and moral values. Based on media and semiotic analysis, the method of cultural and historical interpretation, animated Russian projects created from 2000 to the 2025, which were translated on television channels or streaming ...
Added: April 19, 2026
Малахов В. С., Симон М. Е., Летняков Д. Э. et al., / SSRN. Серия Social Science Research Network "Social Science Research Network". 2020.
The notion of “political accommodation” applied to the theory and practice of managing cultural diversity could enrich the Russian academic dictionary. Liberal democratic states invented specific mechanisms for political accommodation of cultural differences. Thanks to these mechanisms, the part of the population of a democratic state that is not ready to dissolve into the ethnocultural ...
Added: September 26, 2025
Melville A. Y., Каберник В. В., Mironyuk M. et al., / МГИМО МИД России. 2024.
Данный аналитический доклад является одним из результатов исследований в рамках консорциума НИУ ВШЭ и МГИМО. В нем прежде всего раскрыты вопросы концептуализации национальной мощи и сопутствующих категорий и дается обзор прецедентов. Далее рассматриваются вопросы операционализации предлагаемых нами компонентов национальной мощи. В следующих разделах доклада предлагается анализ вопросов методологии, используемой в докладе. На этой основе предложен ...
Added: September 19, 2025
Antipkina I., Ivanov A., Guzhelya D., / Series WP BRP "Basic research program". 2024.
This study presents a methodology for developing a new questionnaire format called explicit continuum scenario scales, in the example of a client focus questionnaire. Elements of the Rasch Guttman scenario scale methodology were used in its development. In three consequent studies, different aspects of the scale functioning were investigated. In Study 1, on the sample ...
Added: February 21, 2025
Aitzhanov S., / NRU HSE. Series WP BRP "Linguistics". 2024. No. 116.
This study focuses on examining the role of language as an attribute in the construction of ethnicity within the Korean community in Kazakhstan. The research examines how language functions as an attribute in the categorization and identification processes, and how it interacts with other ethnic attributes such as descent and appearance. Drawing on qualitative methods, ...
Added: December 10, 2024
Kisselev O., Klimov A., Mihail Kopotev, , in: Complexity, Accuracy and Fluency in Learner Corpus Research. Volume vi.: Amsterdam: John Benjamins Publishing Company, 2022. Ch. 3 P. 51–80.
The study reports on the results of a corpus-based evaluation of automatically extracted syntactic complexity measures as indices of Russian as a foreign language (FL) and Russian as a heritage language (HL) writing development. A list of 12 syntactic complexity measures was tested on a set of longitudinal, classroom-based data. The analyses demonstrated that the ...
Added: November 25, 2024
Микаелян А. Л., / NRU Higher School of Economics. Series WP BRP "Literary Studies". 2024. No. 28.
The article presents an attempt to examine Goethe's poem "Reineke Fox" in connection with the discussion between Goethe and Schiller about the nature of epic poetry and the principles of its renewal within the poetics of "Weimar Classicism". Goethe introduced into his interpretation of the medieval story of the Fox a number of innovations at various ...
Added: November 19, 2024
Remnev N., Obiedkov S., Rakhilina E. V. et al., / Series Computer Science "arxiv.org". 2023.
Grammatical error correction is one of the fundamental tasks in Natural Language Processing. For the Russian language, most of the spellcheckers available correct typos and other simple errors with high accuracy, but often fail when faced with non-native (L2) writing, since the latter contains errors that are not typical for native speakers. In this paper, ...
Added: October 30, 2024
Nikita Login, Jazykovedny Casopis 2023 Vol. 74 No. 1 P. 345–356
Learner corpora with error annotation can serve as a source of data for automated question generation (QG) for language testing. In case of multiple choice gapfill lexical questions, this process involves two steps. The first step is to extract sentences with lexical corrections from the learner corpus. The second step, which is the focus of ...
Added: September 16, 2024
Klimova M., Viklova A., Overnikova D., Вестник Санкт-Петербургского университета. Язык и литература 2023 Т. 20 № 4 С. 824–837
The article presents an experimental study of the influence of the frequency of spelling errors in a word on its representation in mental lexicon. The hypothesis that frequently misspelled words cause difficulties in reading even if they are written correctly has been proved for native speakers of Russian and English. This paper aims to check ...
Added: January 26, 2024
Vlasova E., Бец Ю. В., Северина Е. М., В кн.: «Русская грамматика в диалоге научных школ, направлений, методов».: Владивосток: Издательство ДВФУ, 2022.
В статье анализируются нетривиальные фонетические и грамматические явления устной речи иностранцев, изучающих русский язык. Показано, что устный учебный корпус позволяет получить систематическое представление о компенсаторных механизмах речепорождения, проверять и формулировать гипотезы. ...
Added: November 8, 2023