• A
  • A
  • A
  • АБВ
  • АБВ
  • АБВ
  • A
  • A
  • A
  • A
  • A
Обычная версия сайта
  • RU
  • EN
  • HSE University
  • Publications
  • Book chapter
  • Queuing dynamics of asynchronous Federated Learning
  • RU
  • EN
Расширенный поиск
Высшая школа экономики
Национальный исследовательский университет
Priority areas
  • business informatics
  • economics
  • engineering science
  • humanitarian
  • IT and mathematics
  • law
  • management
  • mathematics
  • sociology
  • state and public administration
by year
  • 2027
  • 2026
  • 2025
  • 2024
  • 2023
  • 2022
  • 2021
  • 2020
  • 2019
  • 2018
  • 2017
  • 2016
  • 2015
  • 2014
  • 2013
  • 2012
  • 2011
  • 2010
  • 2009
  • 2008
  • 2007
  • 2006
  • 2005
  • 2004
  • 2003
  • 2002
  • 2001
  • 2000
  • 1999
  • 1998
  • 1997
  • 1996
  • 1995
  • 1994
  • 1993
  • 1992
  • 1991
  • 1990
  • 1989
  • 1988
  • 1987
  • 1986
  • 1985
  • 1984
  • 1983
  • 1982
  • 1981
  • 1980
  • 1979
  • 1978
  • 1977
  • 1976
  • 1975
  • 1974
  • 1973
  • 1972
  • 1971
  • 1970
  • 1969
  • 1968
  • 1967
  • 1966
  • 1965
  • 1964
  • 1963
  • 1958
  • More
Subject
News
May 22, 2026
HSE Graduates AI Project Wins at TECH & AI Awards
Daria Davydova, graduate of the HSE Graduate School of Business and Head of the AI Implementation Unit at the Artificial Intelligence Department of Alfa-Bank, received a prize at the TECH & AI Awards. She was awarded for the best AI solution for optimising business processes. The winners were determined as part of the VII Russian Summit and Awards on Digital Transformation (CDO/CDTO Summit & Awards).
May 20, 2026
HSE University Opens First Representative Office of Satellite Laboratory in Brazil
HSE University-St Petersburg opened a representative office of the Satellite Laboratory on Social Entrepreneurship at the University of Campinas in Brazil. The platform is going to unite research and educational projects in the spheres of sustainable development, communications and social innovations.
May 18, 2026
The 'Second Shift' Is Not Why Women Avoid News
Women are more likely than men to avoid political and economic news, but the reasons for this behaviour are linked less to structural inequality or family-related stress than to personal attitudes and the emotional perception of news content. This conclusion was reached by HSE researchers after analysing data from a large-scale survey of more than 10,000 residents across 61 regions of Russia. The study findings have been published in Woman in Russian Society.

 

Have you spotted a typo?
Highlight it, click Ctrl+Enter and send us a message. Thank you for your help!

Publications
  • Books
  • Articles
  • Chapters of books
  • Working papers
  • Report a publication
  • Research at HSE

?

Queuing dynamics of asynchronous Federated Learning

P. 1711–1719.
Leconte L., Jonckheere M., Samsonov S., Moulines E.

We study asynchronous federated learning mechanisms with nodes having potentially different computational speeds. In such an environment, each node is allowed to work on models with potential delays and contribute to updates to the central server at its own pace. Existing analyses of such algorithms typically depend on intractable quantities such as the maximum node delay and do not consider the underlying queuing dynamics of the system. In this paper, we propose a non-uniform sampling scheme for the central server that allows for lower delays with better complexity, taking into account the closed Jackson network structure of the associated computational graph. Our experiments clearly show a significant improvement of our method over current state-of-the-art asynchronous algorithms on image classification problems.

Language: English
Text on another site
Keywords: Distributed computingпараллельные и распределенные вычисления и системыТеория массового обслуживания и ее приложенияqueueing theoryфедеративное обучениеFederated learning

In book

Proceedings of The 27th International Conference on Artificial Intelligence and Statistics (AISTATS 2024), 2-4 May 2024, Palau de Congressos, Valencia, Spain. PMLR: Volume 238
Vol. 238. , Valencia: PMLR, 2024.
Similar publications
Federated Reinforcement Learning for Intelligent Traffic Signal Control: A Privacy-Preserving Approach with Edge-Assisted Aggregation
Ali J. Dayoub, Ehab S. Suleiman, , in: Proceedings of the 2026 8th International Youth Conference on Radio Electronics, Electrical and Power Engineering (REEPE).: IEEE, 2026. Ch. 159 P. 1–5.
Abstract— Urban traffic congestion costs the global economy over $1 trillion annually, necessitating intelligent traffic signal control (ITSC) solutions. Traditional centralized approaches face critical limitations: privacy violations from vehicle trajectory data sharing, prohibitive communication overhead, and scalability challenges in heterogeneous urban environments. This paper presents a federated reinforcement learning (FRL) framework for privacy-preserving traffic signal ...
Added: April 30, 2026
Methods with Local Steps and Random Reshuffling for Generally Smooth Non-Convex Federated Optimization
Demidovich Y., Petr Ostroukhov, Malinovsky G. et al., , in: The Thirteenth International Conference on Learning Representations: ICLR 2025.: ICLR, 2025.
Non-convex Machine Learning problems typically do not adhere to the standard smoothness assumption. Based on empirical findings, Zhang et al. (2020b) proposed a more realistic generalized $(L_0,L_1)$-smoothness assumption, though it remains largely unexplored. Many existing algorithms designed for standard smooth problems need to be revised. However, in the context of Federated Learning, only a few ...
Added: July 15, 2025
Simulation Framework for Research and Education in Distributed Computing
Sukhoroslov O. V., Physics of Particles and Nuclei 2024 Vol. 55 P. 334–337
The paper presents DSLab, a general-purpose software framework for simulation of distributed systems. The main advantages of DSLab in comparison to other similar frameworks are versatility and extensibility, convenient and flexible programming model, high performance and ability to simulate large-scale systems. The viability of the framework is confirmed by diverse set of developed domain-specific modules ...
Added: February 22, 2025
Efficient Conformal Prediction under Data Heterogeneity
Plassier V., Kotelevskii N., Rubashevskii A. et al., , in: Proceedings of The 27th International Conference on Artificial Intelligence and Statistics (AISTATS 2024), 2-4 May 2024, Palau de Congressos, Valencia, Spain. PMLR: Volume 238Vol. 238.: Valencia: PMLR, 2024. P. 4879–4887.
Conformal prediction (CP) stands out as a robust framework for uncertainty quantification, which is crucial for ensuring the reliability of predictions. However, common CP methods heavily rely on the data exchangeability, a condition often violated in practice. Existing approaches for tackling non-exchangeability lead to methods that are not computable beyond the simplest examples. In this ...
Added: May 30, 2024
Federated Learning Strategies Over Wireless Channels
Ali A., , in: 22nd International Conference, NEW2AN 2022, Tashkent, Uzbekistan, December 15–16, 2022, Proceedings. Internet of Things, Smart Spaces, and Next Generation Networks and Systems. LNCS, volume 13772Issue 13772.: Springer, 2023. P. 525–533.
Machine learning over distributed data collected by many clients has important applications in use cases where data privacy is a key concern or central data storage is not an option. Federated learning has introduced solutions for these scenarios, unlike the client-server approach, where all the training data is centralized in the server side, the clients, in a federated ...
Added: May 18, 2023
Adaptation Diffusion Strategy Over Wireless Fading Channels
Ali A., , in: 2022 International Conference on Smart Applications, Communications and Networking (SmartNets).: IEEE, 2022. P. 1–4.
Added: May 16, 2023
АДАПТАЦИЯ СТРАТЕГИЯ ДИФФУЗИИ ПО БЕСПРОВОДНЫМ КАНАЛАМ С ЗАМИРАНИЕМ
Ali A., Koucheryavy E., Ebraheem A., В кн.: Инновационные, информационные и коммуникационные технологии. Сборник трудов XIX Международной научно-практической конференции.: М.: Ассоциация выпускников и сотрудников ВВИА им. проф. Жуковского, 2022. С. 38–42.
Added: February 22, 2023
Decentralized personalized federated learning: Lower bounds and optimal algorithm for all personalization modes
Sadiev A., Borodich E., Beznosikov A. et al., EURO Journal on Computational Optimization 2022 Vol. 10 Article 100041
This paper considers the problem of decentralized, personalized federated learning. For centralized personalized federated learning, a penalty that measures the deviation from the local model and its average, is often added to the objective function. However, in a decentralized setting this penalty is expensive in terms of communication costs, so here, a different penalty — ...
Added: October 28, 2022
Federated Learning in Named Entity Recognition
Efim Luboshnikov, Makarov I., , in: Recent Trends in Analysis of Images, Social Networks and Texts. 9th International Conference, AIST 2020, Skolkovo, Moscow, Russia, October 15–16, 2020 Revised Supplementary ProceedingsVol. 12602.: Springer, 2021. Ch. 8 P. 90–101.
This article is devoted to the implementation of the federated approach to named entity recognition. The novel federated approach is designed to solve data privacy issues. The classic BiLSTM-CNNs-CRF and its modifications trained on a single machine are taken as baseline. Federated training is conducted for them. Influence of use of pretrained embedding, use of ...
Added: March 24, 2021
Распределенные компьютерные и телекоммуникационные сети: управление, вычисление, связь (DCCN-2019) Материалы XXII Международной научной конференции
Российский университет дружбы народов (РУДН), 2019.
В научном издании представлены материалы XXII Международной научной конференции «Распределенные компьютерные и телекоммуникационные сети: управление, вычисление, связь» по следующим направлениям: • Алгоритмы и протоколы телекоммуникационных сетей • Управление в компьютерных и инфокоммуникационных системах • Анализ производительности, оценка QoS / QoE и эффективность сетей • Аналитическое и имитационное моделирование коммуникационных систем последующих поколений • Эволюция беспроводных ...
Added: December 25, 2019
On mean-field GI/GI/1 queueing model: existence, uniqueness
Veretennikov A., Queueing Systems 2020 Vol. 94 No. 3 P. 243–255
A mean-field extension of the queueing system \(GI/GI/1\) is considered. The process is constructed as a Markov solution of a martingale problem. Uniqueness in distribution is also established under a slightly different set of assumptions on intensities in comparison to those required for existence. ...
Added: October 29, 2019
8th International Conference “Distributed Computing and Grid-technologies in Science and Education”
., 2018.
Selected Papers of the 8th International Conference "Distributed Computing and Grid-technologies in Science and Education"   Dubna, Russia, September 10-14, 2018. Edited by   Vladimir Korenkov * Andrey Nechaevskiy * Tatiana Zaikina * Elena Mazhitova * * Joint Institute for Nuclear Research, Dubna, Moscow Region, Russia ...
Added: January 9, 2019
Slot Co-allocation Optimization in Distributed Computing with Heterogeneous Resources
Toporkov V., Anna Toporkova, Yemelyanov D., , in: Intelligent Distributed Computing XIIVol. 798: Intelligent Distributed Computing XII.: Cham, Switzerland: Springer, 2018. P. 40–49.
In this work, we introduce slot selection and co-allocation algorithms for parallel jobs in distributed computing with non-dedicated and heterogeneous resources. A single slot is a time span that can be assigned to a task, which is a part of a parallel job. The job launch requires a co-allocation of a specified number of slots ...
Added: October 26, 2018
Intelligent Distributed Computing XII
Cham, Switzerland: Springer, 2018.
This book gathers a wealth of research contributions on recent advances in intelligent and distributed computing, and which present both architectural and algorithmic findings in these fields. A major focus is placed on new techniques and applications for evolutionary computation, swarm intelligence, multi-agent systems, multi-criteria optimization and Deep/Shallow machine learning models, all of which are ...
Added: October 26, 2018
Intelligent Distributed Computing X. Proceedings of the 10th International Symposium on Intelligent Distributed Computing – IDC 2016, Paris, France, October 10-12 2016
Cham, Switzerland: Springer, 2017.
This book presents the combined peer-reviewed proceedings of the tenth International Symposium on Intelligent Distributed Computing (IDC’2016), which was held in Paris, France from October 10thto 12th, 2016. The 23 contributions address a range of topics related to theory and application of intelligent distributed computing, including: Intelligent Distributed Agent-Based Systems, Ambient Intelligence and Social Networks, ...
Added: January 31, 2018
Аналитические и вычислительные методы в теории вероятностей и её приложениях (АВМТВ-2017) = Analytical and Computational Methods in Probability Theory and its Applications (ACMPT-2017) : Proceedings, 23-27 October 2017
M.: RUDN, 2017.
Materials for the International Conference Analytical and Computational Methods in Probability Theory and its Applications (ACMPT-2017) The scientific publication presents the materials of the International Scientific Conference "Analytical and Computational Methods in Probability Theory and Its Applications" in the following main areas: - Analytical methods in probability theory and its applications; - Computational methods in probability theory and its ...
Added: October 18, 2017
Структурный анализ сетей Петри
Kulagin V., Дубинин В. Н., Информационные технологии 2016 Т. 22 № 1 С. 3–13
In this article we propose a new formalism — the structure of Petri nets (PN-structure) designed to study the models of complex systems. Structures or lattices are called partially ordered set in which any two elements there is a precise accurate lower and upper faces. In this paper we use the term "structure". Typed operations ...
Added: February 25, 2016
Heuristic strategies for preference-based scheduling in virtual organizations of utility grids
Toporkov V., Anna Toporkova, Tselishchev A. et al., Journal of Ambient Intelligence and Humanized Computing 2015 Vol. 6 No. 6 P. 733–740
Distributed environments with the users decoupling from resource providers are generally defined as utility Grids. This paper focuses on the problems of an efficient scheduling in virtual organizations (VOs) of utility Grids. The proposed scheduling model ensures the VO stakeholders preferences and provides strategies for effective resources utilization. An approach based on the combination of ...
Added: April 22, 2015
  • About
  • About
  • Key Figures & Facts
  • Sustainability at HSE University
  • Faculties & Departments
  • International Partnerships
  • Faculty & Staff
  • HSE Buildings
  • HSE University for Persons with Disabilities
  • Public Enquiries
  • Studies
  • Admissions
  • Programme Catalogue
  • Undergraduate
  • Graduate
  • Exchange Programmes
  • Summer University
  • Summer Schools
  • Semester in Moscow
  • Business Internship
  • Research
  • International Laboratories
  • Research Centres
  • Research Projects
  • Monitoring Studies
  • Conferences & Seminars
  • Academic Jobs
  • Yasin (April) International Academic Conference on Economic and Social Development
  • Media & Resources
  • Publications by staff
  • HSE Journals
  • Publishing House
  • iq.hse.ru: commentary by HSE experts
  • Library
  • Economic & Social Data Archive
  • Video
  • HSE Repository of Socio-Economic Information
  • HSE1993–2026
  • Contacts
  • Copyright
  • Privacy Policy
  • Site Map
Edit