?
Hm2 at semeval 2019 task2: Unsupervised frame induction using contextualized and uncontextualized word embeddings
P. 125-129.
Anwar S., Ustalov D., Arefyev N., Ponzetto S. P., Biemann C., Panchenko A.
We present our system for semantic frame induction that showed the best performance in Subtask B.1 and finished as the runner-up in Subtask A of the SemEval 2019 Task 2 on unsupervised semantic frame induction (Qasem-iZadeh et al., 2019). Our approach separates this task into two independent steps: verb clustering using word and their context embeddings and role labeling by combining these embeddings with syntactical features. A simple combination of these steps shows very competitive results and can be extended to process other datasets and languages.
Publication based on the results of:
In book
Minneapolis : Association for Computational Linguistics, 2019
Arefyev Nikolay, Sheludko B., Adis D. et al., , in : Proceedings of the 13th International Workshop on Semantic Evaluation (SemEval-2019). : Minneapolis : Association for Computational Linguistics, 2019. P. 31-38.
We describe our solutions for semantic frame and role induction subtasks of SemEval 2019 Task 2. Our approaches got the highest scores, and the solution for the frame induction problem officially took the first place. The main contributions of this paper are related to the semantic frame induction problem. We propose a combined approach that ...
Added: October 10, 2020
Nikolay Arefyev, Boris S., Panchenko A., , in : Proceedings of the International Conference Recent Advances in Natural Language Processing, RANLP 2019. : INCOMA Ltd, 2019. P. 62-70.
Word Sense Induction (WSI) is the task of grouping of occurrences of an ambiguous word according to their meaning. In this work, we improve the approach to WSI proposed by Amrami and Goldberg (2018) based on clustering of lexical substitutes for an ambiguous word in a particular context obtained from neural language models. Namely, we ...
Added: October 9, 2020
Struyanskiy O., Arefyev, N., , in : Supplementary Proceedings of the 7th International Conference on Analysis of Images, Social Networks and Texts (AIST-SUP 2018), Moscow, Russia, July 5-7, 2018. : Aachen : CEUR Workshop Proceedings, 2018. P. 208-213.
Attentional neural networks have achieved remarkable results for a number of tasks in the past few years. The fascinating success of neural networks with attention mechanism in natural language processing, especially in machine translation, suggests that these models can capture the meaning of ambiguous words considering their context. In this paper we introduce a new ...
Added: October 9, 2020
Arefyev, N, Boris S., Aleksashina T., , in : Analysis of Images, Social Networks and Texts. 8th International Conference, AIST 2019, Lecture Notes in Computer Science, Revised Selected Papers. Vol. 11832.: Cham : Springer, 2019. P. 105-121.
Word sense induction (WSI) is the problem of grouping occurrences of an ambiguous word according to the expressed sense of this word. Recently a new approach to this task was proposed, which generates possible substitutes for the ambiguous word in a particular context using neural language models, and then clusters sparse bag-of-words vectors built from ...
Added: October 9, 2020
Nikolay Arefyev, Sheludko B., Podolskiy A. et al., , in : Proceedings of the 28th International Conference on Computational Linguistics. : International Committee on Computational Linguistics, 2020. P. 1242-1255.
Lexical substitution, i.e. generation of plausible words that can replace a particular target word in a given context, is an extremely powerful technology that can be used as a backbone of various NLP applications, including word sense induction and disambiguation, lexical relation extraction, data augmentation, etc. In this paper, we present a large-scale comparative study ...
Added: December 7, 2020
Koshcheev D., Miroliubova T., , in : Science and Global Challenges of the 21st Century – Innovations and Technologies in Interdisciplinary Applications. : Springer, 2023. Ch. 27. P. 883-898.
Despite a vast strand of academic publications on industrial clustering, the mechanism of region and cluster interplay is still unclear. As a result, cluster policy in regions is often ineffective. The present paper proposes an analytical framework to model and to investigate an industrial cluster and a region mutual influence. Based on “system and criteria” ...
Added: June 23, 2023
Лопухин К. А., Iomdin B., Lopukhina A., Компьютерная лингвистика и интеллектуальные технологии 2017 Vol. 1 No. 16 P. 121-134
The assumption that senses are mutually disjoint and have clear boundaries has been drawn into doubt by several linguists and psychologists. The problem of word sense granularity is widely discussed both in lexicographic and in NLP studies. We aim to study word senses in the wild—in raw corpora— by performing word sense induction (WSI). WSI ...
Added: September 27, 2017
Panchenko A., Lopukhina A., Ustalov D. et al., Компьютерная лингвистика и интеллектуальные технологии 2018 No. 17 P. 547-564
The paper describes the results of the first shared task on word sense induction (WSI) for the Russian language. While similar shared tasks were conducted in the past for some Romance and Germanic languages, we explore the performance of sense induction and disambiguation methods for a Slavic language that shares many features with other Slavic ...
Added: June 7, 2018
Malykh V., Chernis K., Artemova E. et al., , in : Proceedings of the 28th International Conference on Computational Linguistics. : International Committee on Computational Linguistics, 2020. Ch. 503. P. 5718-5730.
The existing dialogue summarization corpora are significantly extractive. We introduce a methodology for dataset extractiveness evaluation and present a new low-extractive corpus of movie dialogues for abstractive text summarization along with baseline evaluation. The corpus contains 153k dialogues and consists of three parts: 1) automatically aligned subtitles, 2) automatically aligned scenes from scripts, and 3) ...
Added: December 6, 2020
Smetanin S., Mikhail Komarov, PeerJ Computer Science 2022 Vol. 8 Article e1181
As one of the major platforms of communication, social networks have become a valuable source of opinions and emotions. Considering that sharing of emotions offline and online is quite similar, historical posts from social networks seem to be a valuable source of data for measuring observable subjective well-being (OSWB). In this study, we calculated OSWB ...
Added: December 29, 2022
Arefyev N.V., Bykov D. A., , in : Computational Linguistics and Intellectual Technologies: Papers from the Annual International Conference “Dialogue” (2021). Issue 20: Основной том.: -, 2021. P. 31-46.
Added: September 23, 2021
Lopukhina Anastasia, Pletenev S., Nikiforova A. et al., , in : Proceedings of the Second Workshop on Linguistic and Neurocognitive Resources. : Marseille : European Language Resources Association (ELRA), 2020. P. 28-37.
Linguistics predictability is the degree of confidence in which language unit (word, part of speech, etc.) will be the next in the sequence. Experiments have shown that the correct prediction simplifies the perception of a language unit and its integration into the context. As a result of an incorrect prediction, language processing slows down. Currently, ...
Added: April 20, 2021
Panchenko A., Lopukhina A., Ustalov D. et al., , in : Computational Linguistics and Intellectual Technologies. International Conference "Dialogue 2018" Proceedings. : M. : Conference Proceedings Editorial board, 2018. P. 547-564.
The paper describes the results of the first shared task on word sense induction (WSI) for the Russian language. While similar shared tasks were conducted in the past for some Romance and Germanic languages, we explore the performance of sense induction and disambiguation methods for a Slavic language that shares many features with other Slavic ...
Added: October 9, 2020
Kanovich M., Kuznetsov S., Scedrov A., , in : Logic, Language, Information, and Computation: 26th International Workshop, WoLLIC 2019, Utrecht, The Netherlands, July 2-5, 2019, Proceedings. Vol. 11541: Lecture Notes in Computer Science.: Berlin, Heidelberg : Springer, 2019. P. 373-391.
Language and relational models, or L-models and R-models, are two natural classes of models for the Lambek calculus. Completeness w.r.t. L-models was proved by Pentus and completeness w.r.t. R-models by Andréka and Mikulás. It is well known that adding both additive conjunction and disjunction together yields incompleteness, because of the distributive law. The product-free Lambek ...
Added: September 4, 2019
Arefyev, N., Ermolaev P., Panchenko A., , in : Computational Linguistics and Intellectual Technologies. International Conference "Dialogue 2018" Proceedings. : M. : Conference Proceedings Editorial board, 2018. P. 68-84.
The paper describes our participation in the first shared task on word sense induction and disambiguation for the Russian language RUSSE'2018 [Panchenko et al., 2018]. For each of several dozens of ambiguous words, the participants were asked to group text fragments containing it according to the senses of this word, which were not provided beforehand, ...
Added: October 9, 2020
Arefyev N V., Fedoseev M., Kabanov A. et al., , in : Компьютерная лингвистика и интеллектуальные технологии: по материалам ежегодной международной конференции «Диалог» (Москва, 17–20 июня 2020 г.). Issue 19(26): дополнительный том.: -, 2020. P. 13-32.
Expert-built lexical resources are known to provide information of good quality for the cost of low coverage. This property limits their applicability in modern NLP applications. Building descriptions of lexical-semantic relations manually in sufficient volume requires a huge amount of qualified human labour. However, given some initial version of a taxonomy is already built, automatic ...
Added: October 9, 2020
Davydova V., Gerasimova O., Makarov I., , in : Proceedings of the Conference on Modeling and Analysis of Complex Systems and Processes 2021 (MACSPro 2021). : Aachen : CEUR Workshop Proceedings, 2022. P. 1-18.
In the present work, contextualized word embeddings such as provided by ELMo or BERT are applied to the Word Sense Induction (WSI) task for the Russian language.
Since embeddings produced by these models depend on context, we presumed that they could be able to capture the particular word meaning used in a particular sentence. We have ...
Added: September 15, 2022