• A
  • A
  • A
  • АБВ
  • АБВ
  • АБВ
  • A
  • A
  • A
  • A
  • A
Обычная версия сайта
  • RU
  • EN
  • HSE University
  • Publications
  • Book chapter
  • Federated Reinforcement Learning for Intelligent Traffic Signal Control: A Privacy-Preserving Approach with Edge-Assisted Aggregation
  • RU
  • EN
Расширенный поиск
Высшая школа экономики
Национальный исследовательский университет
Priority areas
  • business informatics
  • economics
  • engineering science
  • humanitarian
  • IT and mathematics
  • law
  • management
  • mathematics
  • sociology
  • state and public administration
by year
  • 2027
  • 2026
  • 2025
  • 2024
  • 2023
  • 2022
  • 2021
  • 2020
  • 2019
  • 2018
  • 2017
  • 2016
  • 2015
  • 2014
  • 2013
  • 2012
  • 2011
  • 2010
  • 2009
  • 2008
  • 2007
  • 2006
  • 2005
  • 2004
  • 2003
  • 2002
  • 2001
  • 2000
  • 1999
  • 1998
  • 1997
  • 1996
  • 1995
  • 1994
  • 1993
  • 1992
  • 1991
  • 1990
  • 1989
  • 1988
  • 1987
  • 1986
  • 1985
  • 1984
  • 1983
  • 1982
  • 1981
  • 1980
  • 1979
  • 1978
  • 1977
  • 1976
  • 1975
  • 1974
  • 1973
  • 1972
  • 1971
  • 1970
  • 1969
  • 1968
  • 1967
  • 1966
  • 1965
  • 1964
  • 1963
  • 1958
  • More
Subject
News
May 18, 2026
The 'Second Shift' Is Not Why Women Avoid News
Women are more likely than men to avoid political and economic news, but the reasons for this behaviour are linked less to structural inequality or family-related stress than to personal attitudes and the emotional perception of news content. This conclusion was reached by HSE researchers after analysing data from a large-scale survey of more than 10,000 residents across 61 regions of Russia. The study findings have been published in Woman in Russian Society.
May 15, 2026
Preserving Rationality in a Period of Turbulence
The HSE International Laboratory for Logic, Linguistics and Formal Philosophy studies logic and rationality in a transformed world characterised by a diversity of logical systems and rational agents. The laboratory supports and develops academic ties with Russian and international partners. The HSE News Service spoke with the head of the laboratory, Prof. Elena Dragalina-Chernaya, about its work.
May 15, 2026
‘All My Time Is Devoted to My Dissertation
Ilya Venediktov graduated from the Master’s programme at the HSE Tikhonov Moscow Institute of Electronics and Mathematics through the combined Master’s–PhD track and is currently studying at the HSE Doctoral School of Engineering Sciences. At present, he is undertaking a long-term research internship at the University of Science and Technology of China in Hefei, where he is preparing his dissertation. In this interview, he explains how an internship differs from an academic mobility programme, discusses his research topic, and describes the daily life of a Russian doctoral student in China.

 

Have you spotted a typo?
Highlight it, click Ctrl+Enter and send us a message. Thank you for your help!

Publications
  • Books
  • Articles
  • Chapters of books
  • Working papers
  • Report a publication
  • Research at HSE

?

Federated Reinforcement Learning for Intelligent Traffic Signal Control: A Privacy-Preserving Approach with Edge-Assisted Aggregation

Ch. 159. P. 1–5.
Ali J. Dayoub, Ehab S. Suleiman

Abstract— Urban traffic congestion costs the global economy over $1 trillion annually, necessitating intelligent traffic signal control (ITSC) solutions. Traditional centralized approaches face critical limitations: privacy violations from vehicle trajectory data sharing, prohibitive communication overhead, and scalability challenges in heterogeneous urban environments. This paper presents a federated reinforcement learning (FRL) framework for privacy-preserving traffic signal optimization. The proposed approach combines three innovations: edgeassisted aggregation weighting client contributions by local traffic density, FedProx regularization handling non-IID traffic distributions, and differential privacy. Evaluated on a 4×4 urban grid using SUMO simulation with four federated clients, our framework achieves 86.5% improvement in waiting time over 100 rounds, outperforms centralized Deep Q-Networks (DQN) by 56.6% at round 50 despite avoiding raw data access, and reduces communication overhead by 8,333. Results establish federated learning as a viable paradigm for scalable, privacy-compliant intelligent transportation systems with
superior performance to centralized approaches.

Language: English
Full text
DOI
Text on another site
Keywords: Intelligent transportation systemsedge computingFederated learningtraffic signal control

In book

Proceedings of the 2026 8th International Youth Conference on Radio Electronics, Electrical and Power Engineering (REEPE)
Dayoub A., Suleiman E. IEEE, 2026.
Similar publications
Parallel Multi-Level Simulation for Large-Scale Detailed Intelligent Transportation System Modeling
Stepanyants V., Karpov A., Margaryan A. et al., FUTURE TRANSPORTATION 2025 Vol. 5 No. 4 Article 141
Nowadays, the problems of traffic accidents, inefficiency, and congestion still affect transportation systems. Conventional solutions often do not resolve and can even exacerbate the problems. Intelligent transportation system (ITS) technology, including intelligent vehicles, could provide a solution for these problems. However, such technologies should be thoroughly verified and validated before their large-scale adoption. Computer simulation ...
Added: October 17, 2025
Methods with Local Steps and Random Reshuffling for Generally Smooth Non-Convex Federated Optimization
Demidovich Y., Petr Ostroukhov, Malinovsky G. et al., , in: The Thirteenth International Conference on Learning Representations: ICLR 2025.: ICLR, 2025.
Non-convex Machine Learning problems typically do not adhere to the standard smoothness assumption. Based on empirical findings, Zhang et al. (2020b) proposed a more realistic generalized $(L_0,L_1)$-smoothness assumption, though it remains largely unexplored. Many existing algorithms designed for standard smooth problems need to be revised. However, in the context of Federated Learning, only a few ...
Added: July 15, 2025
Efficient Conformal Prediction under Data Heterogeneity
Plassier V., Kotelevskii N., Rubashevskii A. et al., , in: Proceedings of The 27th International Conference on Artificial Intelligence and Statistics (AISTATS 2024), 2-4 May 2024, Palau de Congressos, Valencia, Spain. PMLR: Volume 238Vol. 238.: Valencia: PMLR, 2024. P. 4879–4887.
Conformal prediction (CP) stands out as a robust framework for uncertainty quantification, which is crucial for ensuring the reliability of predictions. However, common CP methods heavily rely on the data exchangeability, a condition often violated in practice. Existing approaches for tackling non-exchangeability lead to methods that are not computable beyond the simplest examples. In this ...
Added: May 30, 2024
Queuing dynamics of asynchronous Federated Learning
Leconte L., Jonckheere M., Samsonov S. et al., , in: Proceedings of The 27th International Conference on Artificial Intelligence and Statistics (AISTATS 2024), 2-4 May 2024, Palau de Congressos, Valencia, Spain. PMLR: Volume 238Vol. 238.: Valencia: PMLR, 2024. P. 1711–1719.
We study asynchronous federated learning mechanisms with nodes having potentially different computational speeds. In such an environment, each node is allowed to work on models with potential delays and contribute to updates to the central server at its own pace. Existing analyses of such algorithms typically depend on intractable quantities such as the maximum node ...
Added: May 26, 2024
Real-time detection of hogweed: UAV platform empowered by deep learning
Menshchikov A., Shadrin D., Prutyanov V. et al., IEEE Transactions on Computers 2021 Vol. 70 No. 8 P. 1175–1188
The Hogweed of Sosnowskyi (lat. Heracleum sosnowskyi) is poisonous for humans, dangerous for farming crops, and local ecosystems. This plant is fast-growing and has already spread all over Eurasia: from Germany to the Siberian part of Russia, and its distribution expands year-by-year. In-situ detection of this harmful plant is a tremendous challenge for many countries. ...
Added: May 11, 2024
Новая программная платформа для моделирования транспортных потоков с участием беспилотных автомобилей
Beklaryan A., Вестник ЦЭМИ 2023 Т. 6 № 1 Статья 5
The article presents a new software platform for modelling traffic flows involving unmanned vehicles, using a number of advanced technological solutions, in particular, the FLAME GPU supercomputer agent modelling framework, intelligent software modules based on fuzzy and hierarchical clustering, genetic optimization algorithms, a subsystem for visualizing the state of agents-vehicles based on OpenGL, etc. As ...
Added: June 4, 2023
Оптимизация характеристик интеллектуальной транспортной системы с использованием генетического алгоритма вещественного кодирования на основе адаптивной мутации
Akopov A. S., Бекларян Л. А., Beklaryan A., Информационные технологии 2023 Т. 29 № 3 С. 115–125
A novel real-coded genetic algorithm (FCGA-AM) that uses the proposed adaptive mutation (AM) operator is presented. The algorithm is designed to optimise the characteristics of the developed intelligent transportation system. The performance of the proposed genetic algorithm was evaluated in comparison with other methods of multicriteria heuristic optimization with the use of various test instances ...
Added: June 4, 2023
Federated Learning Strategies Over Wireless Channels
Ali A., , in: 22nd International Conference, NEW2AN 2022, Tashkent, Uzbekistan, December 15–16, 2022, Proceedings. Internet of Things, Smart Spaces, and Next Generation Networks and Systems. LNCS, volume 13772Issue 13772.: Springer, 2023. P. 525–533.
Machine learning over distributed data collected by many clients has important applications in use cases where data privacy is a key concern or central data storage is not an option. Federated learning has introduced solutions for these scenarios, unlike the client-server approach, where all the training data is centralized in the server side, the clients, in a federated ...
Added: May 18, 2023
Adaptation Diffusion Strategy Over Wireless Fading Channels
Ali A., , in: 2022 International Conference on Smart Applications, Communications and Networking (SmartNets).: IEEE, 2022. P. 1–4.
Added: May 16, 2023
АДАПТАЦИЯ СТРАТЕГИЯ ДИФФУЗИИ ПО БЕСПРОВОДНЫМ КАНАЛАМ С ЗАМИРАНИЕМ
Ali A., Koucheryavy E., Ebraheem A., В кн.: Инновационные, информационные и коммуникационные технологии. Сборник трудов XIX Международной научно-практической конференции.: М.: Ассоциация выпускников и сотрудников ВВИА им. проф. Жуковского, 2022. С. 38–42.
Added: February 22, 2023
Аспекты кэширования в информационно-ориентированных сетях
Iakimenko S., В кн.: Современные сетевые технологии: труды 4-й Международной конференции "Современные сетевые технологии" (MoNeTec-2022), 27-29 октября 2022 г., г.Москва (короткие и стендовые доклады).: М.: Издательский отдел факультета ВМК МГУ им. М.В. Ломоносова, 2022. С. 70–76.
The article is devoted to the issues of caching in information-centric networks (ICN), aimed at addressing by the content name and separating information from its producer node. Intra-network caching is one of the main features of ICN, turning them, in fact, into a network of interconnected caches that can accumulate packets in the buffer of ...
Added: December 20, 2022
Decentralized personalized federated learning: Lower bounds and optimal algorithm for all personalization modes
Sadiev A., Borodich E., Beznosikov A. et al., EURO Journal on Computational Optimization 2022 Vol. 10 Article 100041
This paper considers the problem of decentralized, personalized federated learning. For centralized personalized federated learning, a penalty that measures the deviation from the local model and its average, is often added to the objective function. However, in a decentralized setting this penalty is expensive in terms of communication costs, so here, a different penalty — ...
Added: October 28, 2022
A future triple entry accounting framework using blockchain technology
Moinak Maiti, Ivan Kotliarov, Vitalii Lipatnikov, Blockchain: Research and Applications 2021 Vol. 2 No. 4 Article 100037
The study adopts a single case study approach to bring into conversation, ideas, and views of several scholars on triple entry accounting (TEA). The development of blockchain technology already drives the conscious move towards the TEA. The TEA is currently not being used in any significant way but is in a greater debate whether it ...
Added: September 22, 2022
Hybrid Deep Learning Enabled Air Pollution Monitoring in ITS Environment
Dutta A. K., Sampson J., Ahmad S. et al., Computers, Materials and Continua 2022 Vol. 72 No. 1 P. 1157–1172
Intelligent Transportation Systems (ITS) have become a vital part in improving human lives and modern economy. It aims at enhancing road safety and environmental quality. There is a tremendous increase observed in the number of vehicles in recent years, owing to increasing population. Each vehicle has its own individual emission rate; however, the issue arises ...
Added: April 11, 2022
Automatic Vehicle License Plate Recognition Using Optimal K-Means with Convolutional Neural Network for Intelligent Transportation Systems
Pustokhina I., Pustokhin D. A., Rodrigues J. J. et al., IEEE Access 2020 Vol. 8 P. 92907–92917
Due to recent developments in highway research and increased utilization of vehicles, there has been significant interest paid on latest, effective, and precise Intelligent Transportation System (ITS). The process of identifying particular objects in an image plays a crucial part in the fields of computer vision or digital image processing. Vehicle License Plate Recognition (VLPR) ...
Added: October 2, 2021
Automatic vehicle license plate recognition using optimal deep learning model
Vaiyapuri T., Nandan Mohanty S., Sivaram M. et al., Computers, Materials and Continua 2021 Vol. 67 No. 2 P. 1881–1897
The latest advancements in highway research domain and increase in the number of vehicles everyday led to wider exposure and attention towards the development of efficient Intelligent Transportation System (ITS). One of the popular research areas i.e.,Vehicle License PlateRecognition (VLPR) aims at determining the characters that exist in the license plate of the vehicles. The ...
Added: October 2, 2021
On Machine Learning Applicability to Transaction Time Prediction for Time-Critical C-ITS Applications
Stepanov N., Veprev A., Sharapova A. et al., , in: 2021 44th International Conference on Telecommunications and Signal Processing (TSP).: IEEE Computer Society, 2021. P. 408–413.
The demand in providing a reliable operation of modern Cooperative Intelligent Transport Systems (C-ITS) is growing tremendously. One of the enablers for improving efficiency is applying Machine Learning (ML) techniques to predict network characteristics. This work proposes methods to solve the Regression and Classification tasks for the real-life C-ITS mission-critical (transaction) data between buses and ...
Added: October 2, 2021
Metadata-Driven Industrial-Grade ETL System
Suleykin A., Panfilov P., , in: 2020 IEEE International Conference on Big Data (Big Data 2020).: IEEE, 2020. P. 2433–2442.
Digital transformation of a railway system based on big data technologies relies on integrating large volumes of streaming data into digitally enabled enterprise systems to form a comprehensive and efficient intelligent transportation system. Data requirements of the smart railway transportation involve a large number of unstructured data and semi-structured data including railway KPI data. Traditional ...
Added: April 16, 2021
Federated Learning in Named Entity Recognition
Efim Luboshnikov, Makarov I., , in: Recent Trends in Analysis of Images, Social Networks and Texts. 9th International Conference, AIST 2020, Skolkovo, Moscow, Russia, October 15–16, 2020 Revised Supplementary ProceedingsVol. 12602.: Springer, 2021. Ch. 8 P. 90–101.
This article is devoted to the implementation of the federated approach to named entity recognition. The novel federated approach is designed to solve data privacy issues. The classic BiLSTM-CNNs-CRF and its modifications trained on a single machine are taken as baseline. Federated training is conducted for them. Influence of use of pretrained embedding, use of ...
Added: March 24, 2021
Многоагентная система управления наземными беспилотными транспортными средствами
Akopov A. S., Бекларян Л. А., Khachatryan N. et al., Информационные технологии 2020 Т. 26 № 6 С. 342–353
This article presents a ground-based unmanned vehicles (UV) control system developed using agent-based simulation methods (supported by AnyLogic). An important feature of such a system is the ability to assess the influence of various parameters (such as average initial speeds, input stream intensities, frequency of data exchange between BTS agents, etc.) on the behavior and ...
Added: June 18, 2020
Action-Oriented Programming Model: Collective Executions and Interactions in the Fog
Mäkitalo N., Aaltonen T., Raatikainen M. et al., Journal of Systems and Software 2019 No. 157 P. 1–25
Today’s dominant design for the Internet of Things (IoT) is a Cloud-based system, where devices transfer their data to a back-end and in return receive instructions on how to act. This view is challenged when delays caused by communication with the back-end become an obstacle for IoT applications with, for example, stringent timing constraints. In contrast, ...
Added: October 31, 2019
Towards a Cloud Computing Paradigm for Big Data Analysis in Smart Cities
Massobrio R., Nesmachnow S., Tchernykh A. et al., Programming and Computer Software 2018 Vol. 44 No. 3 P. 181–189
In this paper, we present a Big Data analysis paradigm related to smart cities using cloud computing infrastructures. The proposed architecture follows the MapReduce parallel model implemented using the Hadoop framework. We analyse two case studies: a quality-of-service assessment of public transportation system using historical bus location data, and a passenger-mobility estimation using ticket sales ...
Added: August 10, 2018
  • About
  • About
  • Key Figures & Facts
  • Sustainability at HSE University
  • Faculties & Departments
  • International Partnerships
  • Faculty & Staff
  • HSE Buildings
  • HSE University for Persons with Disabilities
  • Public Enquiries
  • Studies
  • Admissions
  • Programme Catalogue
  • Undergraduate
  • Graduate
  • Exchange Programmes
  • Summer University
  • Summer Schools
  • Semester in Moscow
  • Business Internship
  • Research
  • International Laboratories
  • Research Centres
  • Research Projects
  • Monitoring Studies
  • Conferences & Seminars
  • Academic Jobs
  • Yasin (April) International Academic Conference on Economic and Social Development
  • Media & Resources
  • Publications by staff
  • HSE Journals
  • Publishing House
  • iq.hse.ru: commentary by HSE experts
  • Library
  • Economic & Social Data Archive
  • Video
  • HSE Repository of Socio-Economic Information
  • HSE1993–2026
  • Contacts
  • Copyright
  • Privacy Policy
  • Site Map
Edit