• A
  • A
  • A
  • АБВ
  • АБВ
  • АБВ
  • A
  • A
  • A
  • A
  • A
Обычная версия сайта
  • RU
  • EN
  • HSE University
  • Publications
  • Book chapter
  • Improving Text Generation via Neural Discourse Planning
  • RU
  • EN
Расширенный поиск
Высшая школа экономики
Национальный исследовательский университет
Priority areas
  • business informatics
  • economics
  • engineering science
  • humanitarian
  • IT and mathematics
  • law
  • management
  • mathematics
  • sociology
  • state and public administration
by year
  • 2027
  • 2026
  • 2025
  • 2024
  • 2023
  • 2022
  • 2021
  • 2020
  • 2019
  • 2018
  • 2017
  • 2016
  • 2015
  • 2014
  • 2013
  • 2012
  • 2011
  • 2010
  • 2009
  • 2008
  • 2007
  • 2006
  • 2005
  • 2004
  • 2003
  • 2002
  • 2001
  • 2000
  • 1999
  • 1998
  • 1997
  • 1996
  • 1995
  • 1994
  • 1993
  • 1992
  • 1991
  • 1990
  • 1989
  • 1988
  • 1987
  • 1986
  • 1985
  • 1984
  • 1983
  • 1982
  • 1981
  • 1980
  • 1979
  • 1978
  • 1977
  • 1976
  • 1975
  • 1974
  • 1973
  • 1972
  • 1971
  • 1970
  • 1969
  • 1968
  • 1967
  • 1966
  • 1965
  • 1964
  • 1963
  • 1958
  • More
Subject
News
October 14, 2026
At HSE University–St Petersburg, Experts Discuss How AI Changes Tourist Routes and Cultural Heritage
Neural networks are no longer simple travel assistants; now they decide what to include on the route and what to skip. Artificial intelligence changes how people perceive a place and shapes the image of tourist centres. At the II International Scientific and Practical Conference ’Information Technologies in the Preservation and Promotion of Cultural Heritage,’ researchers discussed who controls algorithmic solutions and in what ways, and whether authentic traditions get lost in them.
October 12, 2026
Road Injuries Leading Cause of Death Among Men Aged 10 to 39
Worldwide, road injuries are the leading cause of death among males aged 10–39. An international team of researchers reached this conclusion as part of the Global Burden of Disease Study 2023, analysing data from 204 countries between 1990 and 2023. Their findings have been published in The Lancet Public Health, with HSE University Professor Vasily Vlassov listed among the collaborators.
October 8, 2026
HSE Experts Take Part in 23rd Annual Meeting of Valdai Discussion Club
The 23rd Annual Meeting of the Valdai Discussion Club was held from September 28 to October 1, 2026 under the theme ‘Responsibility for the Future: Limits of the Possible, or Limitless Possibilities?’ The forum brought together 120 experts from 40 countries, including representatives of China, the United States, India, Brazil, the United Kingdom, Germany, Egypt, Iran, and Japan.

 

Have you spotted a typo?
Highlight it, click Ctrl+Enter and send us a message. Thank you for your help!

Publications
  • Books
  • Articles
  • Chapters of books
  • Working papers
  • Report a publication
  • Research at HSE

?

Improving Text Generation via Neural Discourse Planning

P. 1543–1544.
Alexander Chernyavskiy

Recent Transformer-based approaches to NLG like GPT-2 can generate syntactically coherent original texts. However, these generated texts have serious flaws. One of them is a global discourse incoherence. We present an approach to estimate the quality of discourse structure. Empirical results confirm that the discourse structure of currently generated texts is inaccurate. We propose the research directions to plan it and fill in the text in its leaves using the pipeline consisting of two GPT-based generation models. The suggested approach is universal and can be applied to different languages.

Language: English
Full text
DOI
Text on another site
Keywords: discourse structureneural text generationdiscourse planning

In book

WSDM 2022 - Proceedings of the 15th ACM International Conference on Web Search and Data Mining
Association for Computing Machinery (ACM), 2022.
Similar publications
Functional models of elementary discursive units in Russian eSports commentary
Микулинский А. Д., , in: Синергия языков и культур 2022: междисциплинарные исследования.: St. Petersburg: -, 2023. P. 335–351.
The paper is devoted to the issue of the local structure modeling of the eSports commentary spoken genre on an example of the Dota 2 computer discipline. ESports commentary is a spontaneous and creative speech aimed at describing of what is happening on the computer-gaming field. The main factors that force us to study it ...
Added: May 12, 2024
GroundHog: Dialogue Generation using Multi-Grained Linguistic Input
Chernyavskiy A., Ostyakova L., Ilvovsky D., , in: Proceedings of the 5th Workshop on Computational Approaches to Discourse (CODI 2024).: Association for Computational Linguistics, 2024. P. 149–160.
Recent language models have significantly boosted conversational AI by enabling fast and cost-effective response generation in dialogue systems. However, dialogue systems based on neural generative approaches often lack truthfulness, reliability, and the ability to analyze the dialogue flow needed for smooth and consistent conversations with users. To address these issues, we introduce GroundHog, a modified ...
Added: May 9, 2024
Unleashing the Power of Discourse-Enhanced Transformers for Propaganda Detection
Chernyavskiy A., Ilvovsky D., Nakov P., , in: Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics: (Volume 1: Long Papers).: Association for Computational Linguistics, 2024. P. 1452–1462.
Added: May 9, 2024
Multimodal Discourse Trees in Forensic Linguistics
Galitsky B., Ilvovsky D., Goncharova E., , in: Компьютерная лингвистика и интеллектуальные технологии: По материалам ежегодной международной конференции «Диалог». Вып. 22.Вып. 22.: [б.и.], 2023.
We extend the concept of a discourse tree (DT) in the discourse representation of text towards data of various forms and natures. The communicative DT to include speech act theory, extended DT to ascend to the level of multiple documents, entity DT to track how discourse covers various entities were defined previously in computational linguistics, we now proceed ...
Added: November 10, 2023
Transformer-based Multi-Party Conversation Generation using Dialogue Discourse Acts Planning
Alexander Chernyavskiy, Ilvovsky D., , in: Proceedings of the 24th Meeting of the Special Interest Group on Discourse and Dialogue.: Association for Computational Linguistics, 2023. P. 519–529.
Recent transformer-based approaches to multi-party conversation generation may produce syntactically coherent but discursively inconsistent dialogues in some cases. To address this issue, we propose an approach to integrate a dialogue act planning stage into the end-to-end transformer-based generation pipeline. This approach consists of a transformer fine-tuning procedure based on linearized dialogue representations that include special ...
Added: October 6, 2023
Correcting Texts Generated by Transformers using Discourse Features and Web Mining
Chernyavskiy A., Ilvovsky D., Galitsky B., , in: Proceedings of the Student Research Workshop Associated with RANLP 2021.: INCOMA Ltd, 2021. P. 36–43.
Recent transformer-based approaches to NLG like GPT-2 can generate syntactically coherent original texts. However, these generated texts have serious flaws: global discourse incoherence and meaninglessness of sentences in terms of entity values. We address both of these flaws: they are independent but can be combined to generate original texts that will be both consistent and ...
Added: May 29, 2022
DSNDM: Deep Siamese Neural Discourse Model with Attention for Text Pairs Categorization and Ranking
Chernyavskiy A., Ilvovsky D., , in: Proceedings of the First Workshop on Computational Approaches to Discourse.: Association for Computational Linguistics, 2020. P. 76–85.
In this paper, the utility and advantages of the discourse analysis for text pairs categorization and ranking are investigated. We consider two tasks in which discourse structure seems useful and important: automatic verification of political statements, and ranking in question answering systems. We propose a neural network based approach to learn the match between pairs ...
Added: November 18, 2020
Proceedings of the First Workshop on Computational Approaches to Discourse
Association for Computational Linguistics, 2020.
Added: November 18, 2020
Detecting logical argumentation in text via communicative discourse tree
Galitsky B., Ilvovsky D., Kuznetsov S., Journal of Experimental and Theoretical Artificial Intelligence 2018 Vol. 30 No. 5 P. 637–663
We solve the argument mining problem by investigating discourse and communicative text structure. A new formal graph-based structure called communicative discourse tree (CDT) is defined. It consists of a discourse tree with additional labels on edges, which stand for verbs. These verbs represent communicative actions. Discourse trees are based on rhetoric relations, extracted from a ...
Added: October 28, 2018
Дистрибуция протоартиклевого jains 'тот' и sa 'этот, тот' на ранней стадии грамматикализации готского артикля
Pimenova N., В кн.: Материалы XXI чтений памяти И. М. Тронского "Индоевропейское языкознание и классическая филология - XXI".Т. XXI.: СПб.: Наука, 2017. С. 661–671.
The author investigates the features of the Gothic demonstratives sa ‘this, that’ and jains ‘that’ in quoted speech and narrative contexts, which help to reconstruct and describe relations within the deixis system at an early stage of the grammaticalization of definite article (the stage of anaphoric article). ...
Added: October 23, 2018
Linguistic mechanisms of coherence in aphasic and non-aphasic discourse
Linnik A., Bastiaanse R., Stede M. et al., Aphasiology 2022 Vol. 36 No. 2 P. 123–146
Background: Coherence is the quality which distinguishes discourse from a random collection of sentences. People with aphasia have been reported to produce less-coherent discourse than non-language-impaired speakers. It is largely unclear how coherence is established in natural language and what leads to its impairment in aphasia.  Aims: This paper presents a cross-methodological investigation on coherence in ...
Added: September 29, 2016
Роль графических средств в понимании структуры англоязычного учебного дискурса
Khrabrova V. E., Национальная Ассоциация Ученых 2014 Т. 4 № 5 С. 41–43
The paper deals with the problem of using graphic visuals in English class as a means ofenhancing discourse structure awareness from the psychoeducational perspective. The issue under consideration has become actual in teaching English for Specific Purposes, e.g. Economics in English, as well as Academic English. Discourse structures are basic text models making it possible ...
Added: February 6, 2015
  • About
  • About
  • Key Figures & Facts
  • Sustainability at HSE University
  • Faculties & Departments
  • International Partnerships
  • Faculty & Staff
  • HSE Buildings
  • HSE University for Persons with Disabilities
  • Public Enquiries
  • Studies
  • Admissions
  • Programme Catalogue
  • Undergraduate
  • Graduate
  • Exchange Programmes
  • Summer University
  • Summer Schools
  • Semester in Moscow
  • Business Internship
  • Research
  • International Laboratories
  • Research Centres
  • Research Projects
  • Monitoring Studies
  • Conferences & Seminars
  • Academic Jobs
  • Yasin (April) International Academic Conference on Economic and Social Development
  • Media & Resources
  • Publications by staff
  • HSE Journals
  • Publishing House
  • iq.hse.ru: commentary by HSE experts
  • Library
  • Economic & Social Data Archive
  • Video
  • HSE Repository of Socio-Economic Information
  • HSE1993–2026
  • Contacts
  • Copyright
  • Privacy Policy
  • Site Map
Edit