• A
  • A
  • A
  • АБВ
  • АБВ
  • АБВ
  • A
  • A
  • A
  • A
  • A
Обычная версия сайта
  • RU
  • EN
  • HSE University
  • Publications
  • Book chapter
  • An Experimental Study of Data Transfer Strategies for Execution of Scientific Workflows
  • RU
  • EN
Расширенный поиск
Высшая школа экономики
Национальный исследовательский университет
Priority areas
  • business informatics
  • economics
  • engineering science
  • humanitarian
  • IT and mathematics
  • law
  • management
  • mathematics
  • sociology
  • state and public administration
by year
  • 2027
  • 2026
  • 2025
  • 2024
  • 2023
  • 2022
  • 2021
  • 2020
  • 2019
  • 2018
  • 2017
  • 2016
  • 2015
  • 2014
  • 2013
  • 2012
  • 2011
  • 2010
  • 2009
  • 2008
  • 2007
  • 2006
  • 2005
  • 2004
  • 2003
  • 2002
  • 2001
  • 2000
  • 1999
  • 1998
  • 1997
  • 1996
  • 1995
  • 1994
  • 1993
  • 1992
  • 1991
  • 1990
  • 1989
  • 1988
  • 1987
  • 1986
  • 1985
  • 1984
  • 1983
  • 1982
  • 1981
  • 1980
  • 1979
  • 1978
  • 1977
  • 1976
  • 1975
  • 1974
  • 1973
  • 1972
  • 1971
  • 1970
  • 1969
  • 1968
  • 1967
  • 1966
  • 1965
  • 1964
  • 1963
  • 1958
  • More
Subject
News
June 25, 2026
HSE Researchers Make Aldehydes Perform Dual Function
Chemists from HSE University have discovered a way to carry out a reductive addition reaction without using an external reducing agent. Instead, the required 'resource' is supplied by the aldehyde itself, one of the reaction participants. This approach helps prevent unwanted side reactions, reduces toxicity, and simplifies the production and synthesis of organic molecules, including those used in the manufacture of medicines. The study has been published in Journal of Catalysis.
June 25, 2026
HSE Scientists Explain Why Findings in Autism Research Differ
Researchers from the Cognitive Health and Intelligence Centre at HSE University conducted the first-ever systematic review of studies on the specifics of emotion-from-motion perception in autism. The review showed that differences found between autistic and non-autistic individuals are largely associated with the experimental design and the types of tasks given to study participants. The review findings have been published in Research in Autism.
June 22, 2026
‘In Science, You Are Your Own Boss
Polina Nasledskova is interested in identifying gaps in linguistics and topics that have been overlooked by other researchers. In an interview for the  Young Scientists of HSE University project, she spoke about rare ordinal numerals in Nakh-Daghestanian languages, the benefits of knitting for concentration, and the beauty of the Patriarshy Bridge.

 

Have you spotted a typo?
Highlight it, click Ctrl+Enter and send us a message. Thank you for your help!

Publications
  • Books
  • Articles
  • Chapters of books
  • Working papers
  • Report a publication
  • Research at HSE

?

An Experimental Study of Data Transfer Strategies for Execution of Scientific Workflows

P. 67–79.
Sukhoroslov O. V.

The paper studies the impact of data transfer strategies on the execution of scientific workflows. Five strategies are described, which define when and in what order data transfers are performed during the workflow execution. The strategies are experimentally evaluated by means of simulation using a realistic network model. It is demonstrated that the execution time of data-intensive workflows significantly depends on the used strategy. In particular, Eager and Lazy strategies, often used in theory and practice of workflow scheduling, demonstrate the poor results in most cases. The alternative strategies provide up to 36% makespan improvement by overlapping communications and computations, prioritizing data transfers and reducing network contention.

Language: English
DOI
Keywords: distributed computingworkflows

In book

Parallel Computing Technologies. PaCT 2019. Lecture Notes in Computer Science, vol 11657
Springer, 2019.
Similar publications
Распределённые компьютерные и телекоммуникационные сети: управление, вычисление, связь (DCCN-2023)
-, 2023.
В научном электронном издании представлены материалы XXVI Международной научной конференции «Распределенные компьютерные и телекоммуникационные сети: управление, вычисление, связь» по следующим направлениям: - Алгоритмы и протоколы телекоммуникационных сетей  - Управление в компьютерных и инфокоммуникационных системах - Анализ производительности, оценка QoS / QoE и эффективность сетей - Аналитическое и имитационное моделирование коммуникационных систем последующих поколений - Эволюция беспроводных сетей в направлении 5G; - Технологии сантиметрового и миллиметрового ...
Added: December 18, 2025
Выполнение распределенных вычислительных экспериментов на MLOps платформе НИУ ВШЭ
Хританков А. С., Полежаев В. А., Zhulikov G. et al., Вестник Южно-Уральского государственного университета. Серия: Вычислительная математика и информатика 2025 Т. 14 № 2 С. 42–66
Despite the wide spread and successful application of data mining and processing tools for solving individual applied problems, the problem of developing a technology for creating such software tools has not yet been solved. In the context of a unified MLOps process for creating machine learning technologies, this paper considers the emerging problems of automating ...
Added: July 28, 2025
Experience in Organizing Flexible Access to Remote Computing Resources from JupyterLab Environment Using Technologies of Everest and Templet Projects
Vostokin S., Popov S., O. Sukhoroslov, , in: Proceedings of the 9th International Conference "Distributed Computing and Grid Technologies in Science and Education" (GRID'2021), Dubna, Russia, July 5-9, 2021.: CEUR Workshop Proceedings, 2021. P. 558–561.
The paper describes the experience of building distributed web applications based on the interactive computing technologies of the Jupyter project. The new architecture of such applications is proposed, considering the possibility of deploying a Jupyter notebook server separately from computing resources, and the possibility to interact with several computing resources simultaneously. These features are implemented ...
Added: October 30, 2022
Concurrently Employing Resources of Several Supercomputers With Parascip Solver By Everest Platform
Smirnov S., Voloshinov V., O.V. Sukhoroslov, , in: Proceedings of the 9th International Conference "Distributed Computing and Grid Technologies in Science and Education" (GRID'2021), Dubna, Russia, July 5-9, 2021.: CEUR Workshop Proceedings, 2021. P. 413–417.
ParaSCIP is rather advanced open-source solver for discrete and global optimization problems. This solver is distinguished by that it can run on distributed memory systems and use up to 80,000 cores, solving open problems from the MIPLIB test libraries. Earlier, using this solver, we confirmed the conjecture on optimal packing of nine congruent circles on ...
Added: October 30, 2022
Proceedings of the 9th International Conference "Distributed Computing and Grid Technologies in Science and Education" (GRID'2021), Dubna, Russia, July 5-9, 2021
CEUR Workshop Proceedings, 2021.
Added: October 30, 2022
Training Transformers Together
Borzunov A., Ryabinin M., Dettmers T. et al., , in: Proceedings of the NeurIPS 2021 Competitions and Demonstrations Track.: PMLR, 2022. P. 335–342.
Added: July 27, 2022
Running Many-Task Applications Across Multiple Resources with Everest Platform
Sukhoroslov O. V., Voloshinov V., Smirnov S., , in: Supercomputing. RuSCDays 2020. Communications in Computer and Information ScienceVol. 1331: 6th Russian Supercomputing Days, RuSCDays 2020, Moscow, Russia, September 21–22, 2020, Revised Selected Papers.: Switzerland: Springer, 2020. P. 634–646.
Added: October 29, 2021
35th International Symposium on Distributed Computing (DISC 2021)
Dagstuhl Publishing, 2021.
Welcome to the DISC 2021, the 35th International Symposium on Distributed Computing, held on October 4–18, 2021. DISC is an international forum on the theory, design, analysis, and implementation of distributed systems and networks, focusing on distributed computing in all its forms. DISC is organized in cooperation with the European Association for Theoretical Computer Science ...
Added: October 14, 2021
PODC'21: Proceedings of the 2021 ACM Symposium on Principles of Distributed Computing
Association for Computing Machinery (ACM), 2021.
Welcome to the 40th ACM SIGACT-SIGOPS Symposium on Principles of Distributed Computing (PODC 2021), held virtually (due to the COVID-19 pandemic) on July 26-30, 2021. PODC is the premier forum for presentation of research on all aspects of distributed computing, including the theory, design, implementation, and applications of distributed algorithms, systems, and networks. This volume contains ...
Added: October 14, 2021
34th International Symposium on Distributed Computing
Dagstuhl Publishing, 2020.
DISC, the International Symposium on Distributed Computing, is an international forum on the theory, design, analysis, implementation and application of distributed systems and networks. DISC is organized in cooperation with the European Association for Theoretical Computer Science (EATCS). This volume contains the papers presented at DISC 2020, the 34th International Symposium on Distributed Computing, held ...
Added: October 14, 2021
Advanced Computing. 10th International Conference, IACC 2020, Panaji, Goa, India, December 5–6, 2020, Revised Selected Papers, Part II
Springer, 2021.
10th International Conference, IACC 2020, Panaji, Goa, India, December 5–6, 2020, Revised Selected Papers, Part II   series: Communications in Computer and Information Science (2021) volume 1368 ...
Added: July 7, 2021
Distributed Computer and Communication Networks: Control, Computation, Communications (DCCN-2020). Proceedings of the XXIII International Conference.
M.: ISC RAS, 2020.
The book presents proceedings of the XXIII International Scientific Conference "Distributed computer and communication networks: control, computation, communications (DCCN-2020)" ...
Added: October 31, 2020
Reproducible and Reliable Distributed Classification of Text Streams
Trofimov A., Шавкунов М. В., Reznick S. et al., , in: Proceedings of the 13th ACM International Conference on Distributed and Event-based Systems.: NY: Association for Computing Machinery (ACM), 2019. P. 264–265.
Large-scale classification of text streams is an essential problem that is hard to solve. Batch processing systems are scalable and proved their effectiveness for machine learning but do not provide low latency. On the other hand, state-of-the-art distributed stream processing systems are able to achieve low latency but do not support the same level of ...
Added: December 27, 2019
Harnessing the Complexity of Mobile Network Data with Smart Monitoring
Suleykin, A., Panfilov, P., , in: Proceedings of the MACSPro Workshop 2019Vol. 2478: CEUR Workshop Proceedings.: CEUR-WS.org, 2019. Ch. 13 P. 149–161.
Mobile (cellular) networks represent a fast evolving research field that take advantages of recent technological advances such as Big Data and distributed computing to provide extensive network monitoring for network operation planning and management purposes. Challenges related to making use of the large volume of streaming data generated by mobile networks include extracting relevant elements ...
Added: November 25, 2019
Supporting Efficient Execution of Many-Task Applications with Everest
Sukhoroslov O. V., , in: 8th International Conference “Distributed Computing and Grid-technologies in Science and Education”.: ., 2018. P. 266–270.
Distributed computing systems are widely used for execution of loosely coupled many-task applications. There are two important classes of such applications. Bag-of-tasks applications, eg, parameter sweeps or Monte Carlo simulations, represent a set of independent tasks. Workflows, which are used for automation of complex computational and data processing pipelines, consist of multiple tasks with control ...
Added: October 19, 2019
Using Resources of Supercomputing Centers with Everest Platform
Smirnov S., Sukhoroslov O. V., Voloshinov V., , in: Supercomputing. RuSCDays 2018. Communications in Computer and Information Science, vol 965. Springer, Cham.: Springer, 2019. P. 687–698.
High-performance computing plays an increasingly important role in modern science and technology. However, the lack of convenient interfaces and automation tools greatly complicates the widespread use of HPC resources among scientists. The paper presents an approach to solving these problems relying on Everest, a web-based distributed computing platform. The platform enables convenient access to HPC ...
Added: October 19, 2019
Parallel Computing Technologies. PaCT 2019. Lecture Notes in Computer Science, vol 11657
Springer, 2019.
Added: October 19, 2019
Perspectives of System Informatics 10th International Andrei Ershov Informatics Conference, PSI 2015, in Memory of Helmut Veith, Kazan and Innopolis, Russia, August 24-27, 2015, Revised Selected Papers
Cham: Springer, 2015.
This book constitutes the refereed proceedings of the 10th International Andrei Ershov Informatics Conference, PSI 2015, held in Kazan and Innopolis, Russia, in August 2015.  The 2 invited and 23 full papers presented in this volume were carefully reviewed and selected from 56 submissions. The papers cover various topics related to the foundations of program and ...
Added: January 29, 2019
Building Predictive Maintenance Framework for Smart Environment Application Systems
Peter Panfilov, Attila Katona, , in: 29th DAAAM International Symposium on Intelligent Manufacturing and AutomationVol. 1: Annals of DAAAM and Proceedings of the 29th DAAAM.: DAAAM International Publishing, 2018. P. 0460–0470.
Predictive maintenance is a powerful maintenance strategy that makes it possible to significantly reduce operation and maintenance costs of public, commercial and industrial environments. It is a complex data-driven process, which tries to forecast future states of company assets. On one hand it prerequisites condition monitoring of components on machine level. On the other hand ...
Added: January 27, 2019
Distributed analysis of the BMC kind: Making it fit the tornado supercomputer
Abdullin A., Stepanov D., Akhin M., , in: Communications in Computer and Information ScienceVol. 779: Tools and Methods of Program Analysis.: Springer, 2018. P. 1–10.
Software analysis is becoming increasingly important as a way of software quality assurance. Most works in this area focus their attention on a single machine scenario, when the analysis is run and implemented on a single processing node, as it seems to be a good fit for the current software development methodologies. We argue that ...
Added: November 12, 2018
Using Everest Platform for Teaching Parallel and Distributed Computing
Sukhoroslov O. V., , in: Euro-Par 2016: Parallel Processing Workshops. Euro-Par 2016. Lecture Notes in Computer Science.Vol. 10104.: Springer, 2017. P. 16–27.
The paper presents a practical approach for building high-level services for teaching parallel and distributed computing based on Everest platform. Originally designed for publication of computing applications, the platform is suitable for rapid development of services for running different types of parallel programs on high-performance resources, as well as services for evaluation of practical assignments. ...
Added: October 31, 2018
Euro-Par 2016: Parallel Processing Workshops. Euro-Par 2016. Lecture Notes in Computer Science.
Springer, 2017.
This book constitutes the proceedings of the workshops of the 23rd International Conference on Parallel and Distributed Computing, Euro-Par 2016, held in Grenoble, France in August 2016.   The 65 full papers presented were carefully reviewed and selected from 95 submissions. The volume includes the papers from the following workshops: Euro-EDUPAR (Second European Workshop on Parallel and Distributed ...
Added: October 31, 2018
Distributed Optimization on the Base of AMPL Modeling Language and Everest Platform
Smirnov S., Voloshinov V., Sukhoroslov O. V., Procedia Computer Science 2016 Vol. 101 P. 313–322
Optimization modeling in science and industry requires the use of state-of-the-art software and high-performance computing resources. A common problem faced by researchers is how to integrate related software and leverage available computing resources in a distributed environment. The paper presents an approach for solving this problem based on unifying remote access to optimization software via ...
Added: August 30, 2018
  • About
  • About
  • Key Figures & Facts
  • Sustainability at HSE University
  • Faculties & Departments
  • International Partnerships
  • Faculty & Staff
  • HSE Buildings
  • HSE University for Persons with Disabilities
  • Public Enquiries
  • Studies
  • Admissions
  • Programme Catalogue
  • Undergraduate
  • Graduate
  • Exchange Programmes
  • Summer University
  • Summer Schools
  • Semester in Moscow
  • Business Internship
  • Research
  • International Laboratories
  • Research Centres
  • Research Projects
  • Monitoring Studies
  • Conferences & Seminars
  • Academic Jobs
  • Yasin (April) International Academic Conference on Economic and Social Development
  • Media & Resources
  • Publications by staff
  • HSE Journals
  • Publishing House
  • iq.hse.ru: commentary by HSE experts
  • Library
  • Economic & Social Data Archive
  • Video
  • HSE Repository of Socio-Economic Information
  • HSE1993–2026
  • Contacts
  • Copyright
  • Privacy Policy
  • Site Map
Edit