• A
  • A
  • A
  • АБВ
  • АБВ
  • АБВ
  • A
  • A
  • A
  • A
  • A
Обычная версия сайта
  • RU
  • EN
  • HSE University
  • Publications
  • Book chapter
  • Queuing dynamics of asynchronous Federated Learning
  • RU
  • EN
Расширенный поиск
Высшая школа экономики
Национальный исследовательский университет
Priority areas
  • business informatics
  • economics
  • engineering science
  • humanitarian
  • IT and mathematics
  • law
  • management
  • mathematics
  • sociology
  • state and public administration
by year
  • 2027
  • 2026
  • 2025
  • 2024
  • 2023
  • 2022
  • 2021
  • 2020
  • 2019
  • 2018
  • 2017
  • 2016
  • 2015
  • 2014
  • 2013
  • 2012
  • 2011
  • 2010
  • 2009
  • 2008
  • 2007
  • 2006
  • 2005
  • 2004
  • 2003
  • 2002
  • 2001
  • 2000
  • 1999
  • 1998
  • 1997
  • 1996
  • 1995
  • 1994
  • 1993
  • 1992
  • 1991
  • 1990
  • 1989
  • 1988
  • 1987
  • 1986
  • 1985
  • 1984
  • 1983
  • 1982
  • 1981
  • 1980
  • 1979
  • 1978
  • 1977
  • 1976
  • 1975
  • 1974
  • 1973
  • 1972
  • 1971
  • 1970
  • 1969
  • 1968
  • 1967
  • 1966
  • 1965
  • 1964
  • 1963
  • 1958
  • More
Subject
News
May 25, 2026
HSE Scientists Train Neural Network to 'Hear' Faults in Electric Motors
Researchers at the AI and Digital Science Institute of the HSE Faculty of Computer Science have developed a new method—the Signature-Guided Data Augmentation (SGDA) framework—that achieves 99% accuracy in motor fault detection and 86% accuracy in fault classification. The application of this approach can reduce industrial equipment repair costs, minimise downtime, and improve production safety. The study results have been published in Engineering Applications of Artificial Intelligence.
May 25, 2026
'The Humanities Serve as a Conscience'
Maria Mizernaia studies Soviet literature and the history of book publishing. In this interview for the HSE Young Scientists project, she discusses plans to publish a novel about besieged Leningrad, AI-provoked reflections on what it means to be human, and how novels can help satisfy our dopamine hunger.
May 25, 2026
Is It Possible to Predict a Citys Life Based on the Shape of Its Neighbourhoods?
Is it possible to predict, based on the configuration of streets and buildings, where a café will open or where traffic congestion will occur? Participants in the Spatial Analysis and Modelling of Urban Processes research and study group use open data and machine learning to identify universal patterns. Alexander Sheludkov and Eduard Somov discuss the purpose of comparing cities, the need for new forms of urban statistics, and how open data is transforming approaches to urban studies.

 

Have you spotted a typo?
Highlight it, click Ctrl+Enter and send us a message. Thank you for your help!

Publications
  • Books
  • Articles
  • Chapters of books
  • Working papers
  • Report a publication
  • Research at HSE

?

Queuing dynamics of asynchronous Federated Learning

P. 1711–1719.
Leconte L., Jonckheere M., Samsonov S., Moulines E.

We study asynchronous federated learning mechanisms with nodes having potentially different computational speeds. In such an environment, each node is allowed to work on models with potential delays and contribute to updates to the central server at its own pace. Existing analyses of such algorithms typically depend on intractable quantities such as the maximum node delay and do not consider the underlying queuing dynamics of the system. In this paper, we propose a non-uniform sampling scheme for the central server that allows for lower delays with better complexity, taking into account the closed Jackson network structure of the associated computational graph. Our experiments clearly show a significant improvement of our method over current state-of-the-art asynchronous algorithms on image classification problems.

Language: English
Text on another site
Keywords: Distributed computingпараллельные и распределенные вычисления и системыТеория массового обслуживания и ее приложенияqueueing theoryфедеративное обучениеFederated learning

In book

Proceedings of The 27th International Conference on Artificial Intelligence and Statistics (AISTATS 2024), 2-4 May 2024, Palau de Congressos, Valencia, Spain. PMLR: Volume 238
Vol. 238. , Valencia: PMLR, 2024.
Similar publications
Federated Reinforcement Learning for Intelligent Traffic Signal Control: A Privacy-Preserving Approach with Edge-Assisted Aggregation
Ali J. Dayoub, Ehab S. Suleiman, , in: Proceedings of the 2026 8th International Youth Conference on Radio Electronics, Electrical and Power Engineering (REEPE).: IEEE, 2026. Ch. 159 P. 1–5.
Abstract— Urban traffic congestion costs the global economy over $1 trillion annually, necessitating intelligent traffic signal control (ITSC) solutions. Traditional centralized approaches face critical limitations: privacy violations from vehicle trajectory data sharing, prohibitive communication overhead, and scalability challenges in heterogeneous urban environments. This paper presents a federated reinforcement learning (FRL) framework for privacy-preserving traffic signal ...
Added: April 30, 2026
Methods with Local Steps and Random Reshuffling for Generally Smooth Non-Convex Federated Optimization
Demidovich Y., Petr Ostroukhov, Malinovsky G. et al., , in: The Thirteenth International Conference on Learning Representations: ICLR 2025.: ICLR, 2025.
Non-convex Machine Learning problems typically do not adhere to the standard smoothness assumption. Based on empirical findings, Zhang et al. (2020b) proposed a more realistic generalized $(L_0,L_1)$-smoothness assumption, though it remains largely unexplored. Many existing algorithms designed for standard smooth problems need to be revised. However, in the context of Federated Learning, only a few ...
Added: July 15, 2025
Simulation Framework for Research and Education in Distributed Computing
Sukhoroslov O. V., Physics of Particles and Nuclei 2024 Vol. 55 P. 334–337
The paper presents DSLab, a general-purpose software framework for simulation of distributed systems. The main advantages of DSLab in comparison to other similar frameworks are versatility and extensibility, convenient and flexible programming model, high performance and ability to simulate large-scale systems. The viability of the framework is confirmed by diverse set of developed domain-specific modules ...
Added: February 22, 2025
Efficient Conformal Prediction under Data Heterogeneity
Plassier V., Kotelevskii N., Rubashevskii A. et al., , in: Proceedings of The 27th International Conference on Artificial Intelligence and Statistics (AISTATS 2024), 2-4 May 2024, Palau de Congressos, Valencia, Spain. PMLR: Volume 238Vol. 238.: Valencia: PMLR, 2024. P. 4879–4887.
Conformal prediction (CP) stands out as a robust framework for uncertainty quantification, which is crucial for ensuring the reliability of predictions. However, common CP methods heavily rely on the data exchangeability, a condition often violated in practice. Existing approaches for tackling non-exchangeability lead to methods that are not computable beyond the simplest examples. In this ...
Added: May 30, 2024
Federated Learning Strategies Over Wireless Channels
Ali A., , in: 22nd International Conference, NEW2AN 2022, Tashkent, Uzbekistan, December 15–16, 2022, Proceedings. Internet of Things, Smart Spaces, and Next Generation Networks and Systems. LNCS, volume 13772Issue 13772.: Springer, 2023. P. 525–533.
Machine learning over distributed data collected by many clients has important applications in use cases where data privacy is a key concern or central data storage is not an option. Federated learning has introduced solutions for these scenarios, unlike the client-server approach, where all the training data is centralized in the server side, the clients, in a federated ...
Added: May 18, 2023
Adaptation Diffusion Strategy Over Wireless Fading Channels
Ali A., , in: 2022 International Conference on Smart Applications, Communications and Networking (SmartNets).: IEEE, 2022. P. 1–4.
Added: May 16, 2023
АДАПТАЦИЯ СТРАТЕГИЯ ДИФФУЗИИ ПО БЕСПРОВОДНЫМ КАНАЛАМ С ЗАМИРАНИЕМ
Ali A., Koucheryavy E., Ebraheem A., В кн.: Инновационные, информационные и коммуникационные технологии. Сборник трудов XIX Международной научно-практической конференции.: М.: Ассоциация выпускников и сотрудников ВВИА им. проф. Жуковского, 2022. С. 38–42.
Added: February 22, 2023
Decentralized personalized federated learning: Lower bounds and optimal algorithm for all personalization modes
Sadiev A., Borodich E., Beznosikov A. et al., EURO Journal on Computational Optimization 2022 Vol. 10 Article 100041
This paper considers the problem of decentralized, personalized federated learning. For centralized personalized federated learning, a penalty that measures the deviation from the local model and its average, is often added to the objective function. However, in a decentralized setting this penalty is expensive in terms of communication costs, so here, a different penalty — ...
Added: October 28, 2022
Federated Learning in Named Entity Recognition
Efim Luboshnikov, Makarov I., , in: Recent Trends in Analysis of Images, Social Networks and Texts. 9th International Conference, AIST 2020, Skolkovo, Moscow, Russia, October 15–16, 2020 Revised Supplementary ProceedingsVol. 12602.: Springer, 2021. Ch. 8 P. 90–101.
This article is devoted to the implementation of the federated approach to named entity recognition. The novel federated approach is designed to solve data privacy issues. The classic BiLSTM-CNNs-CRF and its modifications trained on a single machine are taken as baseline. Federated training is conducted for them. Influence of use of pretrained embedding, use of ...
Added: March 24, 2021
Распределенные компьютерные и телекоммуникационные сети: управление, вычисление, связь (DCCN-2019) Материалы XXII Международной научной конференции
Российский университет дружбы народов (РУДН), 2019.
В научном издании представлены материалы XXII Международной научной конференции «Распределенные компьютерные и телекоммуникационные сети: управление, вычисление, связь» по следующим направлениям: • Алгоритмы и протоколы телекоммуникационных сетей • Управление в компьютерных и инфокоммуникационных системах • Анализ производительности, оценка QoS / QoE и эффективность сетей • Аналитическое и имитационное моделирование коммуникационных систем последующих поколений • Эволюция беспроводных ...
Added: December 25, 2019
On mean-field GI/GI/1 queueing model: existence, uniqueness
Veretennikov A., Queueing Systems 2020 Vol. 94 No. 3 P. 243–255
A mean-field extension of the queueing system \(GI/GI/1\) is considered. The process is constructed as a Markov solution of a martingale problem. Uniqueness in distribution is also established under a slightly different set of assumptions on intensities in comparison to those required for existence. ...
Added: October 29, 2019
8th International Conference “Distributed Computing and Grid-technologies in Science and Education”
., 2018.
Selected Papers of the 8th International Conference "Distributed Computing and Grid-technologies in Science and Education"   Dubna, Russia, September 10-14, 2018. Edited by   Vladimir Korenkov * Andrey Nechaevskiy * Tatiana Zaikina * Elena Mazhitova * * Joint Institute for Nuclear Research, Dubna, Moscow Region, Russia ...
Added: January 9, 2019
Slot Co-allocation Optimization in Distributed Computing with Heterogeneous Resources
Toporkov V., Anna Toporkova, Yemelyanov D., , in: Intelligent Distributed Computing XIIVol. 798: Intelligent Distributed Computing XII.: Cham, Switzerland: Springer, 2018. P. 40–49.
In this work, we introduce slot selection and co-allocation algorithms for parallel jobs in distributed computing with non-dedicated and heterogeneous resources. A single slot is a time span that can be assigned to a task, which is a part of a parallel job. The job launch requires a co-allocation of a specified number of slots ...
Added: October 26, 2018
Intelligent Distributed Computing XII
Cham, Switzerland: Springer, 2018.
This book gathers a wealth of research contributions on recent advances in intelligent and distributed computing, and which present both architectural and algorithmic findings in these fields. A major focus is placed on new techniques and applications for evolutionary computation, swarm intelligence, multi-agent systems, multi-criteria optimization and Deep/Shallow machine learning models, all of which are ...
Added: October 26, 2018
Intelligent Distributed Computing X. Proceedings of the 10th International Symposium on Intelligent Distributed Computing – IDC 2016, Paris, France, October 10-12 2016
Cham, Switzerland: Springer, 2017.
This book presents the combined peer-reviewed proceedings of the tenth International Symposium on Intelligent Distributed Computing (IDC’2016), which was held in Paris, France from October 10thto 12th, 2016. The 23 contributions address a range of topics related to theory and application of intelligent distributed computing, including: Intelligent Distributed Agent-Based Systems, Ambient Intelligence and Social Networks, ...
Added: January 31, 2018
Аналитические и вычислительные методы в теории вероятностей и её приложениях (АВМТВ-2017) = Analytical and Computational Methods in Probability Theory and its Applications (ACMPT-2017) : Proceedings, 23-27 October 2017
M.: RUDN, 2017.
Materials for the International Conference Analytical and Computational Methods in Probability Theory and its Applications (ACMPT-2017) The scientific publication presents the materials of the International Scientific Conference "Analytical and Computational Methods in Probability Theory and Its Applications" in the following main areas: - Analytical methods in probability theory and its applications; - Computational methods in probability theory and its ...
Added: October 18, 2017
Структурный анализ сетей Петри
Kulagin V., Дубинин В. Н., Информационные технологии 2016 Т. 22 № 1 С. 3–13
In this article we propose a new formalism — the structure of Petri nets (PN-structure) designed to study the models of complex systems. Structures or lattices are called partially ordered set in which any two elements there is a precise accurate lower and upper faces. In this paper we use the term "structure". Typed operations ...
Added: February 25, 2016
Heuristic strategies for preference-based scheduling in virtual organizations of utility grids
Toporkov V., Anna Toporkova, Tselishchev A. et al., Journal of Ambient Intelligence and Humanized Computing 2015 Vol. 6 No. 6 P. 733–740
Distributed environments with the users decoupling from resource providers are generally defined as utility Grids. This paper focuses on the problems of an efficient scheduling in virtual organizations (VOs) of utility Grids. The proposed scheduling model ensures the VO stakeholders preferences and provides strategies for effective resources utilization. An approach based on the combination of ...
Added: April 22, 2015
  • About
  • About
  • Key Figures & Facts
  • Sustainability at HSE University
  • Faculties & Departments
  • International Partnerships
  • Faculty & Staff
  • HSE Buildings
  • HSE University for Persons with Disabilities
  • Public Enquiries
  • Studies
  • Admissions
  • Programme Catalogue
  • Undergraduate
  • Graduate
  • Exchange Programmes
  • Summer University
  • Summer Schools
  • Semester in Moscow
  • Business Internship
  • Research
  • International Laboratories
  • Research Centres
  • Research Projects
  • Monitoring Studies
  • Conferences & Seminars
  • Academic Jobs
  • Yasin (April) International Academic Conference on Economic and Social Development
  • Media & Resources
  • Publications by staff
  • HSE Journals
  • Publishing House
  • iq.hse.ru: commentary by HSE experts
  • Library
  • Economic & Social Data Archive
  • Video
  • HSE Repository of Socio-Economic Information
  • HSE1993–2026
  • Contacts
  • Copyright
  • Privacy Policy
  • Site Map
Edit