• A
  • A
  • A
  • АБВ
  • АБВ
  • АБВ
  • A
  • A
  • A
  • A
  • A
Обычная версия сайта
  • RU
  • EN
  • HSE University
  • Publications
  • Articles
  • Optical stabilization for laser communication satellite systems through proportional–integral–derivative (PID) control and reinforcement learning approach
  • RU
  • EN
Расширенный поиск
Высшая школа экономики
Национальный исследовательский университет
Priority areas
  • business informatics
  • economics
  • engineering science
  • humanitarian
  • IT and mathematics
  • law
  • management
  • mathematics
  • sociology
  • state and public administration
by year
  • 2028
  • 2027
  • 2026
  • 2025
  • 2024
  • 2023
  • 2022
  • 2021
  • 2020
  • 2019
  • 2018
  • 2017
  • 2016
  • 2015
  • 2014
  • 2013
  • 2012
  • 2011
  • 2010
  • 2009
  • 2008
  • 2007
  • 2006
  • 2005
  • 2004
  • 2003
  • 2002
  • 2001
  • 2000
  • 1999
  • 1998
  • 1997
  • 1996
  • 1995
  • 1994
  • 1993
  • 1992
  • 1991
  • 1990
  • 1989
  • 1988
  • 1987
  • 1986
  • 1985
  • 1984
  • 1983
  • 1982
  • 1981
  • 1980
  • 1979
  • 1978
  • 1977
  • 1976
  • 1975
  • 1974
  • 1973
  • 1972
  • 1971
  • 1970
  • 1969
  • 1968
  • 1967
  • 1966
  • 1965
  • 1964
  • 1963
  • 1958
  • More
Subject
News
September 21, 2026
Researchers Develop Methodology to Assess the Quality of Legal Representation in Criminal Proceedings
Having a good defence attorney in criminal proceedings can largely determine whether a defendant retains their freedom, health and good name. Researchers at HSE University propose a method for predicting an attorney’s performance based on the outcomes of their previous cases. The methodology takes into account the severity of the charges, the complexity of the cases, and the most likely outcome, drawing on judicial statistics.
September 21, 2026
Algebra, Geometry, and AI: Russian and Vietnamese Mathematicians Discuss Current Research
A delegation of scientists from Hanoi visited the HSE Faculty of Computer Science and then took part in a Russian-Vietnamese conference in St Petersburg. The events were part of the three-year project ‘Flexibility and Computational Methods.’ Over the course of the project, the researchers have prepared joint publications and obtained new mathematical results.
September 18, 2026
When Pictures Hinder Understanding: Illustrations May Impede Learning of Abstract Ideas
Illustrations can help remember specific actions but do not always make abstract ideas easier to learn. Researchers from HSE University and Humboldt University compared how people learn from texts with different levels of abstractness. They found that participants remembered illustrations better and performed better on related tasks after reading a multimedia text about yoga asanas than after reading an abstract text about the Nash equilibrium. The findings could help improve the selection of illustrations for educational and informational materials. The study has been published in Learning and Instruction.

 

Have you spotted a typo?
Highlight it, click Ctrl+Enter and send us a message. Thank you for your help!

Publications
  • Books
  • Articles
  • Chapters of books
  • Working papers
  • Report a publication
  • Research at HSE

?

Optical stabilization for laser communication satellite systems through proportional–integral–derivative (PID) control and reinforcement learning approach

Review of Scientific Instruments. 2025. Vol. 96. No. 3.
Бахшалиев Р. М., Reutov A., Vorobey S., Katanskiy A., Balakirev V., Barbyshev K., Merzlinkin V., Tekaev V.

One of the main issues of the satellite-to-ground optical communication, including free-space satellite quantum key distribution (QKD), is an achievement of the reasonable accuracy of positioning, navigation, and optical stabilization. Proportional–integral–derivative (PID) controllers can handle various control tasks in optical systems. Recent research shows the promising results in the area of composite control systems including classical control via PID controllers and reinforcement learning (RL) approach. In this work, we apply a RL agent to an experimental stand of the optical stabilization system of the QKD terminal. We find via agent control history more precise PID parameters and also provide an effective combined RL-PID dynamic control approach for the optical stabilization of the satellite-to-ground communication system.

Language: English
DOI
Text on another site
Keywords: quantum informationdeep reinforcement learningOptical devicesdiode lasers
Similar publications
New bound on S1× S2-setting Bell locality of a nonseparable Werner state
Loubenets E. R., / Series arxiv.org "quant-ph". 2026. No. 2607.18050.
In many quantum applications it is important to know whether or not a Bell nonlocal two-qudit state exhibits its nonlocality under correlation scenarios with some given numbers S1,S2≥1 of generalized quantum measurements at two sites. In the present article, we find analytically a new general locality condition sufficient for a  nonseparable Werner state with a ...
Added: July 21, 2026
Protecting quantum states via the super-Zeno effect and anticoherence
Chryssomalakos C., Flores-Delgado A. G., Guzman Gonzalez E. et al., Physical Review A: Atomic, Molecular, and Optical physics 2026 Vol. 113 Article L060404
Added: June 3, 2026
Learning-Based UAV–RIS Secure Communication Under Eavesdropper Location Uncertainty
Ehab S. Suleiman, Ali J. Dayoub, , in: Proceedings of the 2026 8th International Youth Conference on Radio Electronics, Electrical and Power Engineering (REEPE).: IEEE, 2026. Ch. 165 P. 1–6.
Unmanned aerial vehicle (UAV)-assisted reconfigurable intelligent surface (RIS) systems can enhance physical layer security through joint mobility and propagation control. However, most existing designs assume the availability of the eavesdropper's channel state information (CSI), which is unrealistic in passive eavesdropping scenarios. In this paper, secure UAV-RIS downlink communication is studied under bounded eavesdropper location uncertainty, ...
Added: April 30, 2026
Optimization of the Accelerator Control by Reinforcement Learning: A Simulation-Based Approach
Ibrahim A., Derkach D., Petrenko A. et al., Physics of Particles and Nuclei 2025 Vol. 56 No. 6 P. 1476–1481
Optimizing accelerator control is a critical challenge in experimental particle physics, requiring significant manual effort and resource expenditure. Traditional tuning methods are often time-consuming and reliant on expert input, highlighting the need for more efficient approaches. This study aims to create a simulation-based framework integrated with Reinforcement Learning (RL) to address these challenges. Using \texttt{Elegant} ...
Added: March 16, 2025
Adaptive Algorithm for Selecting the Optimal Trading Strategy Based on Reinforcement Learning for Managing a Hedge Fund
Belyakov B., Sizykh D., IEEE Access 2024 Vol. 12 P. 189047–189063
In hedge fund management, the ability to dynamically select optimal trading strategies is paramount for maximizing returns and mitigating risk. This paper presents a pioneering approach that integrates Reinforcement Learning (RL), specifically the Proximal Policy Optimization (PPO) algorithm, into the strategy selection process for hedge fund management. Our model considers a diverse array of strategies, ...
Added: January 15, 2025
Improving GFlowNets with Monte Carlo Tree Search
Morozov N., Tiapkin D., Samsonov S. et al., , in: ICML 2024 Workshop on Structured Probabilistic Inference & Generative Modeling.: OpenReview, 2024.
Added: October 24, 2024
Geometric quantum discord of an arbitrary two-qudit state: Exact value and general upper bounds
Elena R. Loubenets, Louis Hanotel, Physical Review A: Atomic, Molecular, and Optical physics 2024 Vol. 110 No. 3 Article 032410
The geometric quantum discord of a two-qudit state has been studied in many papers; however, its exact analytical value in the explicit form is known only for a general two-qubit state, a general qubit-qudit state, and some special families of two-qudit states. Based on the general Bloch vectors formalism [E. R. Loubenets et al., J. Phys. A: ...
Added: September 11, 2024
Output Power of III-V Injection Microdisk and Microring Lasers
Natalia V. Kryzhanovskaya, Eduard I. Moiseev, Alexey M. Nadtochiy et al., IEEE Journal on Selected Topics in Quantum Electronics 2025 Vol. 31 No. 2 Article 1501312
Technological progress makes it possible to significantly reduce the size of semiconductor laser emitters to microscales and sizes commensurate with the emission wavelength. Extreme laser miniaturization can be achieved using disk or ring resonators supporting high-Q whispering gallery modes (WGM). WGMlasers are interesting not only due to small sizes (small mode volume) but also for ...
Added: September 10, 2024
Geometric quantum discord of an arbitrary two-qudit state: the exact value and general upper bounds
Elena R. Loubenets, Louis Hanotel, / Series arxiv/org "quant-ph". 2024. No. https://arxiv.org/abs/2403.09342.
The geometric quantum discord of a two-qudit state has been studied in many papers, but up to now, its exact analytical value in the explicit form is known only for a general two-qubit state and some specific classes of two-qudit states. Based on the general Bloch vectors formalism [J. Phys. A: Math. Theor. 54 195301 ...
Added: March 16, 2024
Quantifying Bell nonlocality of a pure two-qudit state via its entanglement
Elena R. Loubenets, Sergey Kuznetsov, Louis Hanotel, Journal of Physics A: Mathematical and Theoretical 2024 Vol. 57 No. 5 Article 055302
For the maximal violation of all Bell inequalities by an arbitrary pure two-qudit state of any dimension, we derive a new lower bound expressed via the concurrence of this pure state. This new lower bound and the upper bound on the maximal Bell violation, found in [J. Phys. A: Math. Theor. 55, 285301 (2022)] and ...
Added: January 6, 2024
When to Switch: Planning and Learning for Partially Observable Multi-Agent Pathfinding
Skrynnik A., Andreychuk A., Yakovlev K. et al., IEEE Transactions on Neural Networks and Learning Systems 2024 Vol. 35 No. 12 P. 17411–17424
Multi-agent pathfinding (MAPF) is a problem that involves finding a set of non-conflicting paths for a set of agents confined to a graph. In this work, we study a MAPF setting, where the environment is only partially observable for each agent, i.e., an agent observes the obstacles and other agents only within a limited field-of-view. ...
Added: December 4, 2023
Dealing With Sparse Rewards Using Graph Neural Networks
Gerasyov Matvey, Makarov I., IEEE Access 2023 Vol. 11 P. 89180–89187
Deep reinforcement learning in partially observable environments is a difficult task in itself and can be further complicated by a sparse reward signal. Most tasks involving navigation in three-dimensional environments provide the agent with minimal information. Typically, the agent receives a visual observation input from the environment and is rewarded once at the end of ...
Added: August 28, 2023
Artificial Intelligence and Mathematical Models of Power Grids Driven by Renewable Energy Sources: A Survey
Srinivasan S., Kumarasamy S., Andreadakis Z. et al., Energies 2023 Vol. 16 No. 14 Article 5383
To face the impact of climate change in all dimensions of our society in the near future, the European Union (EU) has established an ambitious target. Until 2050, the share of renewable power shall increase up to 75% of all power injected into nowadays’ power grids. While being clean and having become significantly cheaper, renewable ...
Added: July 17, 2023
Maximum Entropy Model-based Reinforcement Learning
Svidchenko O., Shpilman A., , in: NeurIPS'2021 Deep Reinforcement Learning Workshop.: [б.и.], 2021.
Recent advances in reinforcement learning have demonstrated its ability to solve hard agent-environment interaction tasks on a super-human level. However, the application of reinforcement learning methods to practical and real-world tasks is currently limited due to most RL state-of-art algorithms' sample inefficiency, i.e., the need for a vast number of training episodes. For example, OpenAI ...
Added: March 24, 2022
Self-Imitation Learning from Demonstrations
Ivanov D., Пшихачев Г. А., Егоров В. С. et al., , in: NeurIPS'2021 Deep Reinforcement Learning Workshop.: [б.и.], 2021.
Despite the numerous breakthroughs achieved with Reinforcement Learning (RL), solving environments with sparse rewards remains a challenging task that requires sophisticated exploration. Learning from Demonstrations (LfD) remedies this issue by guiding agent’s exploration towards states experienced by an expert. Naturally, the benefits of this approach hinge on the quality of demonstrations, which are rarely optimal ...
Added: March 24, 2022
NeurIPS'2021 Deep Reinforcement Learning Workshop
[б.и.], 2021.
Added: March 24, 2022
21st IEEE International Conference on Data Mining Workshops, ICDMW 2021
IEEE Computer Society, 2021.
The 21th IEEE International Conference on Data Mining (IEEE ICDM 2021) is a premier and truly international conference for researchers and practitioners in the broad area of data mining. The ICDM Workshops program (IEEE ICDMW) aims to provide a platform for multiple workshops with a range of more focused topics to be discussed and explored, where attendees can present ...
Added: February 4, 2022
Accuracy of the quantum regression theorem for photon emission from a quantum dot
Cosacchi M., Seidelmann T., Cygorek M. et al., Physical Review Letters 2021 Vol. 127 No. 10 Article 100402
The quantum regression theorem (QRT) is the most widely used tool for calculating multitime correlation functions for the assessment of quantum emitters. It is an approximate method based on a Markov assumption for environmental coupling. In this Letter we quantify properties of photons emitted from a single quantum dot coupled to phonons. For the single-photon ...
Added: September 26, 2021
Proceedings of the 5th International Electronic Conference on Entropy and Its Applications
MDPI AG, 2020.
Proceedings (ISSN 2504-3900) publishes publications resulting from conferences, workshops and similar events. ...
Added: March 13, 2020
  • About
  • About
  • Key Figures & Facts
  • Sustainability at HSE University
  • Faculties & Departments
  • International Partnerships
  • Faculty & Staff
  • HSE Buildings
  • HSE University for Persons with Disabilities
  • Public Enquiries
  • Studies
  • Admissions
  • Programme Catalogue
  • Undergraduate
  • Graduate
  • Exchange Programmes
  • Summer University
  • Summer Schools
  • Semester in Moscow
  • Business Internship
  • Research
  • International Laboratories
  • Research Centres
  • Research Projects
  • Monitoring Studies
  • Conferences & Seminars
  • Academic Jobs
  • Yasin (April) International Academic Conference on Economic and Social Development
  • Media & Resources
  • Publications by staff
  • HSE Journals
  • Publishing House
  • iq.hse.ru: commentary by HSE experts
  • Library
  • Economic & Social Data Archive
  • Video
  • HSE Repository of Socio-Economic Information
  • HSE1993–2026
  • Contacts
  • Copyright
  • Privacy Policy
  • Site Map
Edit