• A
  • A
  • A
  • АБВ
  • АБВ
  • АБВ
  • A
  • A
  • A
  • A
  • A
Обычная версия сайта
  • RU
  • EN
  • HSE University
  • Publications
  • Book chapter
  • Quality Metrics in Recommender Systems: Do We Calculate Metrics Consistently?
  • RU
  • EN
Расширенный поиск
Высшая школа экономики
Национальный исследовательский университет
Priority areas
  • business informatics
  • economics
  • engineering science
  • humanitarian
  • IT and mathematics
  • law
  • management
  • mathematics
  • sociology
  • state and public administration
by year
  • 2027
  • 2026
  • 2025
  • 2024
  • 2023
  • 2022
  • 2021
  • 2020
  • 2019
  • 2018
  • 2017
  • 2016
  • 2015
  • 2014
  • 2013
  • 2012
  • 2011
  • 2010
  • 2009
  • 2008
  • 2007
  • 2006
  • 2005
  • 2004
  • 2003
  • 2002
  • 2001
  • 2000
  • 1999
  • 1998
  • 1997
  • 1996
  • 1995
  • 1994
  • 1993
  • 1992
  • 1991
  • 1990
  • 1989
  • 1988
  • 1987
  • 1986
  • 1985
  • 1984
  • 1983
  • 1982
  • 1981
  • 1980
  • 1979
  • 1978
  • 1977
  • 1976
  • 1975
  • 1974
  • 1973
  • 1972
  • 1971
  • 1970
  • 1969
  • 1968
  • 1967
  • 1966
  • 1965
  • 1964
  • 1963
  • 1958
  • More
Subject
News
May 25, 2026
HSE Scientists Train Neural Network to 'Hear' Faults in Electric Motors
Researchers at the AI and Digital Science Institute of the HSE Faculty of Computer Science have developed a new method—the Signature-Guided Data Augmentation (SGDA) framework—that achieves 99% accuracy in motor fault detection and 86% accuracy in fault classification. The application of this approach can reduce industrial equipment repair costs, minimise downtime, and improve production safety. The study results have been published in Engineering Applications of Artificial Intelligence.
May 25, 2026
'The Humanities Serve as a Conscience'
Maria Mizernaia studies Soviet literature and the history of book publishing. In this interview for the HSE Young Scientists project, she discusses plans to publish a novel about besieged Leningrad, AI-provoked reflections on what it means to be human, and how novels can help satisfy our dopamine hunger.
May 25, 2026
Is It Possible to Predict a Citys Life Based on the Shape of Its Neighbourhoods?
Is it possible to predict, based on the configuration of streets and buildings, where a café will open or where traffic congestion will occur? Participants in the Spatial Analysis and Modelling of Urban Processes research and study group use open data and machine learning to identify universal patterns. Alexander Sheludkov and Eduard Somov discuss the purpose of comparing cities, the need for new forms of urban statistics, and how open data is transforming approaches to urban studies.

 

Have you spotted a typo?
Highlight it, click Ctrl+Enter and send us a message. Thank you for your help!

Publications
  • Books
  • Articles
  • Chapters of books
  • Working papers
  • Report a publication
  • Research at HSE

?

Quality Metrics in Recommender Systems: Do We Calculate Metrics Consistently?

P. 708–713.
Tamm Y., Damdinov R., Vasilev A.
Language: English
DOI
Text on another site
Keywords: metricsrecommender systemsoffline evaluation

In book

RecSys '21: Proceedings of the 15th ACM Conference on Recommender Systems
Association for Computing Machinery (ACM), 2021.
Similar publications
Неслучайные и случайные четырехстопные ямбы Н.А. Некрасова. Сравнительный анализ ритмики стиха и прозы поэта
Kazartsev (Evgenii Kazartcev) E., Качалов В. В., Вестник Казахского национального педагогического университета имени Абая. Серия «Филологические науки» 2023 Т. 83 № 1 С. 29–38
The article is devoted to the study of the rhythm of verse and prose by N.A. Nekrasov using quantitative methods. In this work, the poet's poems written in iambic tetrameter are considered, their correspondence to the trends in the verse of the 1840s-1880s is analyzed. Prose analysis is carried out by constructing and comparing a ...
Added: February 27, 2026
SMMR: Sampling-Based MMR Reranking for Faster, More Diverse, and Balanced Recommendations and Retrieval
Liakhnovich K., Lashinin O., Babkin A. et al., Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval 2025 P. 2754–2758
Relevance and diversity are critical objectives in modern information retrieval (IR), particularly in recommender systems. Achieving a balance between relevance (exploitation) and diversity (exploration) optimizes user satisfaction and business goals such as catalog coverage and novelty. While existing post-processing reranking methods address this trade-off, they usually rely on greedy strategies, leading to suboptimal outcomes for ...
Added: February 3, 2026
Time to Split: Exploring Data Splitting Strategies for Offline Evaluation of Sequential Recommenders
Gusak D., Volodkevich A., Klenitskiy A. et al., , in: RecSys '25: Proceedings of the Nineteenth ACM Conference on Recommender Systems.: ACM, 2025. P. 874–883.
Modern sequential recommender systems, ranging from lightweight transformer-based variants to large language models, have become increasingly prominent in academia and industry due to their strong performance in the next-item prediction task. Yet common evaluation protocols for sequential recommendations remain insufficiently developed: they often fail to reflect the corresponding recommendation task accurately, or are not aligned ...
Added: January 26, 2026
Ultra Fast Warm Start Solution for Graph Recommendations
Yusupov V., Rakhuba M., Frolov E., , in: CIKM '25: Proceedings of the 34rd ACM International Conference on Information and Knowledge Management.: ACM, 2025. Ch. 1 P. 5469–5473.
In this work, we present a fast and effective Linear approach for updating recommendations in a scalable graph-based recommender system UltraGCN. Solving this task is extremely important to maintain the relevance of the recommendations under the conditions of a large amount of new data and changing user preferences. To address this issue, we adapt the ...
Added: October 3, 2025
Leveraging Geometric Insights in Hyperbolic Triplet Loss for Improved Recommendations
Yusupov V., Rakhuba M., Frolov E., , in: RecSys '25: Proceedings of the Nineteenth ACM Conference on Recommender Systems.: ACM, 2025. Ch. 1 P. 1217–1221.
Recent studies have demonstrated the potential of hyperbolic geometry for capturing complex patterns from interaction data in recommender systems. In this work, we introduce a novel hyperbolic recommendation model that uses geometrical insights to improve representation learning and increase computational stability at the same time. We reformulate the notion of hyperbolic distances to unlock additional ...
Added: October 3, 2025
Метрика стихов А. А. Кымытваль, написанных на чукотском языке
Баркова Л. А., Вопросы языкознания 2025 № 4 С. 97–128
This article explores the metrics of poems written by the poet Antonina A. Kymytval. The meter of the verse, written in Chukchi, has not been explored before. I collected a corpus of 40 texts and glossed them manually. After that, I analyzed the number of syllables in a line and the placement of word boundaries, stress, and syllables ...
Added: September 11, 2025
MTS Kion Implicit Contextualised Sequential Dataset for Movie Recommendation
I. Safilo, D. Tikhonovich, Petrov A. et al., Doklady Mathematics 2023 Vol. 108 No. 2 P. S456–S464
We present a new movie and TV show recommendation dataset collected from the real users of MTS Kion video-on-demand platform. In contrast to other popular movie recommendation datasets, such as MovieLens or Netflix, our dataset is based on the implicit interactions registered at the watching time, rather than on explicit ratings. We also provide rich ...
Added: May 24, 2025
Sim4Rec: Flexible and Extensible Simulator for Recommender Systems for Large-Scale Data
Anna Volodkevich, Ivanova V., Vasilev A. et al., , in: Advances in Information Retrieval: 47th European Conference on Information Retrieval, ECIR 2025, Lucca, Italy, April 6–10, 2025, Proceedings, Part IV.: Springer, 2025. P. 425–430.
Simulators for recommender systems are widely used for recommender systems performance evaluation and feedback loop effects analysis. Existing simulators often propose inflexible pipelines, are focused on narrow research tasks, or are not adapted to work with industrial large data volumes. To address these challenges, we developed the Sim4Rec simulation framework. The Sim4Rec models key aspects ...
Added: April 10, 2025
Scalable Cross-Entropy Loss for Sequential Recommendations with Large Item Catalogs
Gleb Mezentsev, Danil Gusak, Ivan V Oseledets et al., , in: RecSys '24: Proceedings of the 18th ACM Conference on Recommender Systems.: Association for Computing Machinery (ACM), 2024. P. 475–485.
Added: January 16, 2025
User response modeling in recommender systems: a survey
M. Shirokikh, Shenbin I., Alekseev A. et al., Journal of Mathematical Sciences 2024 Vol. 285 No. 2 P. 255–284
Over the last several decades, recommender systems have become an integral part of both our daily lives and the research frontier at machine learning. In this survey, we explore various approaches to developing simulators for recommendation systems, especially for modeling the user response function. We consider simple probabilistic models, approaches based on generative adversarial networks, ...
Added: November 24, 2024
RecSys '21: Proceedings of the 15th ACM Conference on Recommender Systems
Association for Computing Machinery (ACM), 2021.
Added: November 24, 2024
Turning Dross Into Gold Loss: is BERT4Rec really better than SASRec?
Klenitskiy Anton, Alexey Vasilev, , in: RecSys '23: Proceedings of the 17th ACM Conference on Recommender Systems.: Association for Computing Machinery (ACM), 2023. P. 1120–1125.
Added: November 24, 2024
RePlay: a Recommendation Framework for Experimentation and Production Use
Vasilev A., Volodkevich Anna, Kulandin D. et al., , in: RecSys '24: Proceedings of the 18th ACM Conference on Recommender Systems.: Association for Computing Machinery (ACM), 2024. P. 1191–1194.
Added: November 24, 2024
Neural Click Models for Recommender Systems
Shirokikh M., Shenbin I., Alekseev A. et al., , in: SIGIR '24: Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval.: Association for Computing Machinery (ACM), 2024. P. 2553–2558.
Added: November 23, 2024
Does It Look Sequential? An Analysis of Datasets for Evaluation of Sequential Recommendations
Klenitskiy Anton, Volodkevich Anna, Pembek A. et al., , in: RecSys '24: Proceedings of the 18th ACM Conference on Recommender Systems.: Association for Computing Machinery (ACM), 2024. P. 1067–1072.
Sequential recommender systems are an important and demanded area of research. Such systems aim to use the order of interactions in a user’s history to predict future interactions. The premise is that the order of interactions and sequential patterns play an essential role. Therefore, it is crucial to use datasets that exhibit a sequential structure ...
Added: November 7, 2024
RECE: Reduced Cross-Entropy Loss for Large-Catalogue Sequential Recommenders
Danil Gusak, Mezentsev G., Oseledets I. et al., , in: CIKM '24: Proceedings of the 33rd ACM International Conference on Information and Knowledge Management.: NY: Association for Computing Machinery (ACM), 2024. P. 3772–3776.
Added: September 11, 2024
CIKM '24: Proceedings of the 33rd ACM International Conference on Information and Knowledge Management
NY: Association for Computing Machinery (ACM), 2024.
This year, the Short Research Paper track has been very competitive, with very high-quality submissions. Each paper received at least three reviews and was assigned one Senior PC member, who led discussions on the merits and weaknesses of each submission and gave a final recommendation. Based on the reviews, the SPC recommendations, and our own ...
Added: September 10, 2024
Revisiting the performance evaluation of knowledge-aware recommender systems: are we making progress?
Ananyeva M., Lashinin O., Kuznetsova M., , in: Proceedings of the Fourth Knowledge-aware and Conversational Recommender Systems Workshop co-located with 16th ACM Conference on Recommender Systems (RecSys 2022)Vol. 3294.: CEUR Workshop Proceedings, 2022. P. 22–28.
Knowledge-aware recommender systems incorporate side information to improve recommendation performance. The authors of new algorithms are usually focused on developing new ideas behind the proposed methods and comparing their models with existing knowledge-aware recommender models. Meanwhile, some commonly used state-of-the-art general top-n recommender models are ignored as potential baselines. In this study, we compare previously ...
Added: January 5, 2024
RecSys '22: Proceedings of the 16th ACM Conference on Recommender Systems
Association for Computing Machinery (ACM), 2022.
ACM COPYRIGHT NOTICE. Copyright © 2022 by the Association for Computing Machinery, Inc. Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice ...
Added: January 5, 2024
О метрике Игоря Чиннова
Plungian V., Труды института русского языка им. В.В. Виноградова 2022 № 3 (33) С. 11–35
В статье исследуется метрический репертуар Игоря Чиннова (1909–1996), одного из наиболее виртуозных русских поэтов второй половины XX века. Приводится общая количественная характеристика используемых Чинновым метров (и других формальных параметров стиха) и анализируется их распределение по разным периодам творчества поэта. Также показано, что выделяемые в его творчестве три периода (условно, поэтика «парижской ноты», поэтика барокко и поэтика ...
Added: November 9, 2023
RecSys '23: Proceedings of the 17th ACM Conference on Recommender Systems
Association for Computing Machinery (ACM), 2023.
ACM COPYRIGHT NOTICE. Copyright ©2023 by the Association for Computing Machinery, Inc. Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and ...
Added: September 27, 2023
Make your next item recommendation model time sensitive
Makhneva E., Sverkunova A., Lashinin O. et al., , in: Adjunct Proceedings of the 31st ACM Conference on User Modeling, Adaptation and Personalization.: Association for Computing Machinery (ACM), 2023. P. 191–195.
Recommender systems have become increasingly popular for providing personalized recommendations to users. Recent studies have shown that transformer-based approaches can enhance the performance of these systems. However, these models usually consider the sequence of past user interactions and do not take into account the time of prediction. In this paper, we address this issue by ...
Added: September 27, 2023
  • About
  • About
  • Key Figures & Facts
  • Sustainability at HSE University
  • Faculties & Departments
  • International Partnerships
  • Faculty & Staff
  • HSE Buildings
  • HSE University for Persons with Disabilities
  • Public Enquiries
  • Studies
  • Admissions
  • Programme Catalogue
  • Undergraduate
  • Graduate
  • Exchange Programmes
  • Summer University
  • Summer Schools
  • Semester in Moscow
  • Business Internship
  • Research
  • International Laboratories
  • Research Centres
  • Research Projects
  • Monitoring Studies
  • Conferences & Seminars
  • Academic Jobs
  • Yasin (April) International Academic Conference on Economic and Social Development
  • Media & Resources
  • Publications by staff
  • HSE Journals
  • Publishing House
  • iq.hse.ru: commentary by HSE experts
  • Library
  • Economic & Social Data Archive
  • Video
  • HSE Repository of Socio-Economic Information
  • HSE1993–2026
  • Contacts
  • Copyright
  • Privacy Policy
  • Site Map
Edit