• A
  • A
  • A
  • АБВ
  • АБВ
  • АБВ
  • A
  • A
  • A
  • A
  • A
Обычная версия сайта
  • RU
  • EN
  • HSE University
  • Publications
  • Preprints
  • Effort versus performance tradeoff in lemmatisation for Uralic languages
  • RU
  • EN
Расширенный поиск
Высшая школа экономики
Национальный исследовательский университет
Priority areas
  • business informatics
  • economics
  • engineering science
  • humanitarian
  • IT and mathematics
  • law
  • management
  • mathematics
  • sociology
  • state and public administration
by year
  • 2028
  • 2027
  • 2026
  • 2025
  • 2024
  • 2023
  • 2022
  • 2021
  • 2020
  • 2019
  • 2018
  • 2017
  • 2016
  • 2015
  • 2014
  • 2013
  • 2012
  • 2011
  • 2010
  • 2009
  • 2008
  • 2007
  • 2006
  • 2005
  • 2004
  • 2003
  • 2002
  • 2001
  • 2000
  • 1999
  • 1998
  • 1997
  • 1996
  • 1995
  • 1994
  • 1993
  • 1992
  • 1991
  • 1990
  • 1989
  • 1988
  • 1987
  • 1986
  • 1985
  • 1984
  • 1983
  • 1982
  • 1981
  • 1980
  • 1979
  • 1978
  • 1977
  • 1976
  • 1975
  • 1974
  • 1973
  • 1972
  • 1971
  • 1970
  • 1969
  • 1968
  • 1967
  • 1966
  • 1965
  • 1964
  • 1963
  • 1958
  • More
Subject
News
August 25, 2026
Scientists Develop Algorithm for More Reliable Processors in Data Centres
Researchers from HSE MIEM and Samara University have developed the LRF-3D algorithm to automatically bypass idle nodes in three-dimensional networks-on-chip. Thanks to its hierarchical architecture, the algorithm outperforms existing solutions in both speed and path accuracy, improving processor reliability for use in data centres, supercomputers, and AI computing. The source code and test results are publicly available.
August 24, 2026
Researchers Develop Method for Direct Generation of Regulatory DNA
Researchers at HSE University have developed a model for generating promoters and enhancers—DNA sequences that regulate gene activity. The model works directly with DNA nucleotides, without first transforming them into a continuous numerical representation. This solution could be useful for applications in synthetic biology and gene therapy. The study results were presented at the ICLR 2026 Workshop ‘Generative AI in Genomics (Gen^2): Barriers and Frontiers.’
August 21, 2026
Social Integration: At the Crossroads of Knowledge and Values
The International Laboratory for Social Integration Research (ILSIR) at HSE University studies the challenges faced by vulnerable groups and explores ways to help them participate fully in everyday life. To develop effective solutions, the laboratory’s researchers combine cutting-edge methods with practical fieldwork. In this interview with the HSE News Service, Laboratory Head Elena Iarskaia-Smirnova discusses the laboratory’s work.

 

Have you spotted a typo?
Highlight it, click Ctrl+Enter and send us a message. Thank you for your help!

Publications
  • Books
  • Articles
  • Chapters of books
  • Working papers
  • Report a publication
  • Research at HSE

?

Effort versus performance tradeoff in lemmatisation for Uralic languages

2020.
Tyers F. M., Bibaeva M.
Lemmatisers in Uralic languages are required for dictionary lookup, an important task for language learners. We explore how to decide which of the rule-based and unsupervised categories is more efficient to invest in. We present a comparison of rule-based and unsupervised lemmatisers, derived from the Giellatekno finite-state morphology project and the Morfessor surface segmenter trained on Wikipedia, respectively. The comparison spanned six Uralic languages, from relatively high-resource (Finnish) to extremely low-resource (Uralic languages of Russia).  Performance is measured by dictionary lookup and vocabulary reduction tasks on the Wikipedia corpora.  Linguistic input was quantified, for rule-based as quantity of source code and state machine complexity, and for unsupervised as the size of the training corpus; these are normalised against Finnish.  Most languages show performance improving with linguistic input.  Future work will produce quantitative estimates for the relationship between corpus size, ruleset size, and lemmatisation performance.
Language: English
Full text
Text on another site
Keywords: stemmingUralic languageslemmatisation
Similar publications
Review of I. Nikolaeva. A Grammar of Tundra Nenets
Stenin I., LINGUIST List 2015 No. 26.5101
The paper is a review of “A Grammar of Tundra Nenets” by Irina Nikolaeva (2014). This review is mostly a short English digest of a rather volume review article by the same reviewer which has been published in Russian as Stenin (2015) in the Russian journal “Voprosy jazykoznanija”. ...
Added: July 26, 2026
Congressus Duodecimus Internationalis Fenno-Ugristarum, Oulu 2015. Book of Abstracts
Oulu: University of Oulu, 2015.
This book of abstracts contains all the abstracts of CIFU XII presentations that were accepted. Chapter 1 includes the abstracts of the plenary presentations, chapter 2 the abstracts of the general session papers and chapter 3 the abstracts of the papers submitted to the symposia. The abstracts are presented in alphabetical order by authors' last ...
Added: July 26, 2026
Комитативно-аддитивная полисемия в пуровском диалекте лесного ненецкого языка
Kozlov A., Лапшина К. М., Вопросы языкознания 2026 № 4 С. 132–146
This article examines two functions of the suffix -samae in the Pur dialect of Forest Nenets based on fieldwork data: comitative (expression of jointness: ‘with X’) and scalar additive (focus particle with the meaning ‘even X’). The comitative use of the suffix -samae primarily marks an inanimate companion. However, its use is also possible with other types ...
Added: July 13, 2026
Лично-числовая асимметрия: согласование пассивных миративов в казымском диалекте хантыйского языка
Starchenko A., Toldova S., Типология морфосинтаксических параметров 2023 Т. 6 № 1 С. 130–148
The study focuses on a previously unrecorded model of split agreement in the mirative paradigm in Kazym Khanty. Split agreement is found when comparing active and passive mirative constructions, as well as in a limited set of uses of non-finite forms. In the passive voice, unlike the active voice, the 3rd person is unmarked and the ...
Added: May 14, 2026
The emergence of hierarchical alignment in Northern Khanty: a comparative dialectal corpus study
Muraviev N., Linguistica Uralica 2025 Vol. 61 No. 2 P. 106–130
This study investigates the morphosyntactic coding of core arguments in Northern Khanty, with a focus on the use of active/passive voice and subjective/objective conjugation. The goal is to offer a more detailed understanding of the coding patterns across dialects. To achieve this, I analyze corpus data from four Northern Khanty dialects: Obdorsk, Shuryshkary, Tegi, and Kazym Khanty, using ...
Added: December 24, 2025
The influence of internal possessors on argument coding in Northern Khanty
Muraviev N., Voprosy Jazykoznanija 2024 Vol. 5 P. 65–79
The study examines contexts in Northern Khanty where the presence of internal possessors in the noun phrases of the core arguments influences their morphosyntactic coding. Based on the corpus data from the Kazym dialect of Khanty, I investigate contexts in which the presence of a third-person topical possessor in the agent or patient NP leads ...
Added: December 24, 2025
String Similarity Measures for Evaluating the Lemmatisation in Old Church Slavonic
Afanasev I., Lyashevskaya O., , in: Structuring Lexical Data and Digitising Dictionaries: Grammatical Theory, Language Processing and Databases in Historical Linguistics.: Boston, Leiden: Brill, 2024. P. 13–35.
Added: January 7, 2025
Проприетивные и привативные аффиксы в некоторых уральских языках: о маркированности и (не)словоизменительном статусе
Лапшина К. М., Вопросы языкознания 2025 № 1 С. 95–118
This paper studies the morphosyntactic properties of bound proprietive and privative markers in some Uralic languages using corpus data and grammatical descriptions. Such affixes are predominantly attached to substantive bases and form derivatives with the meaning of ‘possessing X’ and ‘deprived of X’, respectively. The first part of the study is devoted to the comparison of ...
Added: December 19, 2024
Кириллические памятники на уральских и алтайских языках. Графико-фонетические особенности книг XIX в.
Амелина М. К., Норманская Ю. В., Дыбо А. В. et al., М.: Издательство «Альма Матер», 2022.
I том. Графико-фонетические особенности книг XIX в. ...
Added: May 12, 2024
Digital resources on the Uralic languages of Siberia: an overview, evaluation and application.
Кошелюк Н. А., Fedotova I., / OSF Preprints. Серия 0 "Arts and Humanities". 2023.
The paper reviews digital resources on the Uralic languages of Siberia, defining their scope and testing applicability for different tasks in linguistic studies. We focus on the resources featuring at least one Uralic language of Siberia. A short case-study for Nenets outlines applicability of the resources and the types of data that can be obtained ...
Added: May 12, 2024
Digital resources on the Uralic languages of Siberia: an overview, evaluation and application
Fedotova I., / Series No "Arts and Humanities". 2023.
Added: January 21, 2024
The Effect of (Historical) Language Variation on the East Slavic Lects Lemmatisers Performance
Afanasev I., Lyashevskaya O., Rebrikov Stefan et al., Jazykovedny Casopis 2023 Vol. 74 No. 1 P. 225–233
The need to develop tools for historical and regional variations is becoming more urgent in natural language processing. In this paper, we present two candidate systems for lemmatising historical East Slavic lects (Late Old East Slavic and Middle Russian), as well as modern regional East Slavic lects (Belogornoje and Megra): BERT-based end-to-end pipeline with language-specific ...
Added: December 11, 2023
Reconstruction of Proto-Uralic
Zhivlov M., , in: The Uralic Languages. Second edition.: NY, Abingdon: Routledge, 2023. Ch. 3 P. 117–175.
Added: July 22, 2023
The Uralic Languages. Second edition
NY, Abingdon: Routledge, 2023.
The Uralic Languages, second edition, is a reference book which brings together detailed discussions of the historical development and specialized linguistic structures and features of the languages in the Uralic family. The Uralic languages are spoken today in a vast geographical area stretching from Dalarna County in Sweden to Dudinka, Taimyr, Russia. There are currently approximately ...
Added: July 22, 2023
Non-finite constructions in Khanty: their unity and diversity
Bikina D., Denis Rakhman, Vsevolod Potseluev et al., Folia Linguistica 2022 Vol. 56 No. 3 P. 625–665
This paper investigates non-finite forms in Kazym Khanty (Ob-Ugric, Uralic). In Khanty, almost all subordination makes use of one of the two non-finite forms: -ti (nfin.npst) or -əm (nfin.pst). We propose that their uses are best treated under the headings ‘bare non-finites, ‘head-agreement non-finites’, and ‘verb-agreement non-finites’. The three classes are defined based on the subject agreement pattern ...
Added: December 6, 2022
Language survival among the Ivdel Mansi
Yuri B. Koryakov, Daria Zhornik, Linguistica Uralica 2022 Vol. 58 No. 2 P. 132–145
This article describes the linguistic situation among the Ivdel (Upper Lozʹva) Mansi, a small community residing mostly in the north of the Sverdlosvk region in Russia. The Ivdel Mansi dialect is actively used by speakers of all generations, while other Northern Mansi dialects (and most other indigenous languages of Northern Siberia) are spoken almost exclusively ...
Added: October 26, 2022
Языковая ситуация у ивдельских манси
Жорник Д. О., Koryakov Y., Вестник угроведения 2022 Т. 12 № 1 С. 185–197
Introduction: the article describes the linguistic situation among the Ivdel (Upper Lozva) Mansi people, a small community residing mostly in the North of the Sverdlovsk Oblast in Russia. The Ivdel Mansi dialect is actively used by speakers of all generations, while other Mansi dialects are spoken almost exclusively by elderly and middle-aged people. The degree ...
Added: October 26, 2022
Diachronic Dialectal Classification of Mansi: Evidence from Basic Vocabulary
Fedotova I., / Series code "EasyChair Preprints". 2022. No. 9012.
This paper deals with diachronic classification of Mansi dialect groups based on new resources. The previous research on this data was focused on highlighting the phonetic isoglosses between the discovered dialects, so now it is possible to compare the results based on phonetics with the results gained from lexicostatistics. This research aims to define the ...
Added: October 10, 2022
Shared Semantic Patterns in the Basic Vocabulary of the Uralic Languages in Siberia
Fedotova I., / Series code "EasyChair preprints". 2022. No. 8989.
Nowadays there is a trend for compiling cross-linguistic databases on semantic shifts (DatSemShift 2.0) and colexifications (CLICS), as it serves objectives of typological studies and provides vast data for comparative studies. However, there are no such cross-linguistic databases for diachronic semantic shifts that would describe shifts from a proto-language meaning to the meaning in descendant ...
Added: October 5, 2022
Diagnosing Kazym Khanty unpossessives, or how to tell a synchronically independent marker from its diachronic source
Stiopa Mikhailov, Ural-Altaic Studies 2024 No. 4(55) P. 31–56
Uralic possessive agreement suffixes often develop determiner-like functions. Several authors have suggested monosemic analyses of such functions as derived from the basic possessive meaning. However, recent studies have argued that the functions they investigate must be treated as synchronically independent markers because they do not behave morphosyntactically in the same way that their corresponding proper ...
Added: June 23, 2022
Лексические инновации и классификация уральских языков
Zhivlov M., В кн.: Hämeenmaalta Jamalille: kirja Tapani Salmiselle.: Helda Open Books, 2022. С. 361–375.
Традиционная классификация уральских языков предполагает последовательное бинарное ветвление сначала на самодийские и финно-угорские языки, затем финно-угорских – на угорские и финно-пермские, затем финно-пермских – на пермские и финно-волжские, и, наконец, финно-волжских – на волжские и финно-саамские. Признание за промежуточными узлами в этом дереве генетического статуса (т.е. наличия соответствующих праязыков) предполагает, что эти праязыки должны были ...
Added: April 8, 2022
Hämeenmaalta Jamalille: kirja Tapani Salmiselle
Helda Open Books, 2022.
Added: April 8, 2022
  • About
  • About
  • Key Figures & Facts
  • Sustainability at HSE University
  • Faculties & Departments
  • International Partnerships
  • Faculty & Staff
  • HSE Buildings
  • HSE University for Persons with Disabilities
  • Public Enquiries
  • Studies
  • Admissions
  • Programme Catalogue
  • Undergraduate
  • Graduate
  • Exchange Programmes
  • Summer University
  • Summer Schools
  • Semester in Moscow
  • Business Internship
  • Research
  • International Laboratories
  • Research Centres
  • Research Projects
  • Monitoring Studies
  • Conferences & Seminars
  • Academic Jobs
  • Yasin (April) International Academic Conference on Economic and Social Development
  • Media & Resources
  • Publications by staff
  • HSE Journals
  • Publishing House
  • iq.hse.ru: commentary by HSE experts
  • Library
  • Economic & Social Data Archive
  • Video
  • HSE Repository of Socio-Economic Information
  • HSE1993–2026
  • Contacts
  • Copyright
  • Privacy Policy
  • Site Map
Edit