• A
  • A
  • A
  • АБВ
  • АБВ
  • АБВ
  • A
  • A
  • A
  • A
  • A
Обычная версия сайта
  • RU
  • EN
  • HSE University
  • Publications
  • Articles
  • Random forests with parametric entropy-based information gains for classification and regression problems
  • RU
  • EN
Расширенный поиск
Высшая школа экономики
Национальный исследовательский университет
Priority areas
  • business informatics
  • economics
  • engineering science
  • humanitarian
  • IT and mathematics
  • law
  • management
  • mathematics
  • sociology
  • state and public administration
by year
  • 2027
  • 2026
  • 2025
  • 2024
  • 2023
  • 2022
  • 2021
  • 2020
  • 2019
  • 2018
  • 2017
  • 2016
  • 2015
  • 2014
  • 2013
  • 2012
  • 2011
  • 2010
  • 2009
  • 2008
  • 2007
  • 2006
  • 2005
  • 2004
  • 2003
  • 2002
  • 2001
  • 2000
  • 1999
  • 1998
  • 1997
  • 1996
  • 1995
  • 1994
  • 1993
  • 1992
  • 1991
  • 1990
  • 1989
  • 1988
  • 1987
  • 1986
  • 1985
  • 1984
  • 1983
  • 1982
  • 1981
  • 1980
  • 1979
  • 1978
  • 1977
  • 1976
  • 1975
  • 1974
  • 1973
  • 1972
  • 1971
  • 1970
  • 1969
  • 1968
  • 1967
  • 1966
  • 1965
  • 1964
  • 1963
  • 1958
  • More
Subject
News
November 17, 2026
Physicists Show How a Solvent Shapes the Response of Drug Molecules
Many drug molecules can switch between different three-dimensional shapes. Using a mathematical model of ibuprofen dissolved in supercritical CO₂, researchers from HSE University and the Institute of Solution Chemistry of the Russian Academy of Sciences have shown that the solvent can make these molecules appear to respond unusually slowly. The molecules themselves continue to change shape rapidly, but their surroundings rearrange much more slowly, and this lag shows up in the measurements. The study has been published in The Journal of Chemical Physics. 
November 10, 2026
Physicists Train AI to Optimise Particle Beams in Accelerators
Researchers from the AI and Digital Science Institute at the HSE Faculty of Computer Science and the Budker Institute of Nuclear Physics at the Siberian Branch of the Russian Academy of Sciences have developed RLABC (Reinforcement Learning for Accelerator Beamline Control), a framework that uses reinforcement learning to identify optimal settings for a particle accelerator. In a computer simulation, RLABC optimised the accelerator's parameters to achieve a particle transmission rate of 70%. The study has been published in Computer Physics Communications.
November 9, 2026
'Organ-on-a-Chip Technology Could Eliminate the Need for Animal Testing'
The Laboratory of Molecular Physiology at the HSE Faculty of Biology and Biotechnology investigates how molecular regulators known as microRNAs control gene expression and contribute to the development of diseases, including cancer, viral and inflammatory conditions, and pregnancy complications. At HSE University, researchers develop organ-on-a-chip models: miniature devices containing living cells that mimic the functions of human organs, such as the placenta and intestines. These models help researchers understand how diseases develop and how drugs affect them. HSE News Service spoke with Evgeny Knyazev, Head of the Laboratory.

 

Have you spotted a typo?
Highlight it, click Ctrl+Enter and send us a message. Thank you for your help!

Publications
  • Books
  • Articles
  • Chapters of books
  • Working papers
  • Report a publication
  • Research at HSE

?

Random forests with parametric entropy-based information gains for classification and regression problems

PeerJ Computer Science. 2024. Vol. 10. Article e1775.
Ignatenko V., Surkov A., Sergei Koltcov

The random forest algorithm is one of the most popular and commonly used algorithms
for classification and regression tasks. It combines the output of multiple decision trees
to form a single result. Random forest algorithms demonstrate the highest accuracy on
tabular data compared to other algorithms in various applications. However, random
forests and, more precisely, decision trees, are usually built with the application of
classic Shannon entropy. In this article, we consider the potential of deformed entropies,
which are successfully used in the field of complex systems, to increase the prediction
accuracy of random forest algorithms. We develop and introduce the information gains
based on Renyi, Tsallis, and Sharma-Mittal entropies for classification and regression
random forests. We test the proposed algorithm modifications on six benchmark
datasets: three for classification and three for regression problems. For classification
problems, the application of Renyi entropy allows us to improve the random forest
prediction accuracy by 19-96% in dependence on the dataset, Tsallis entropy improves
the accuracy by 20-98%, and Sharma-Mittal entropy improves accuracy by 22-111%
compared to the classical algorithm. For regression problems, the application of
deformed entropies improves the prediction by 2-23% in terms of R2 in dependence
on the dataset.

Research target: Computer Science
Language: English
Full text
DOI
Keywords: Renyi entropyTsallis entropySharma-Mittal entropyrandom forestClassification regression
Publication based on the results of:
Modelling information and communication behaviour in computer-mediated environments and improving algorithms for behavioural data analysis (2024)
Similar publications
FLowRA: Flow-Guided Rank Allocation for Parameter-Efficient Fine-Tuning of Deep Neural Networks
Aleksei Samarin, Nazarenko A., Kotenko E. et al., Machine Learning and Knowledge Extraction 2026 Vol. 8 No. 11 Article 389
Low-rank adaptation (LoRA) is widely used for parameter-efficient fine-tuning, yet uniform rank assignment ignores the varying contribution of layers to a downstream task. Adaptive methods such as AdaLoRA allocate ranks via gradient and singular-value importance, but they do not exploit the representation change induced by the task. We introduce FLowRA, a calibration-based rank-allocation framework that ...
Added: November 19, 2026
Machine Learning for Astrophysics 2024
Springer, 2026.
This proceedings book reviews the state of the art in the exploitation of machine learning techniques for the astrophysics community and gives the reader a complete overview of the field. The contributed chapters allow the reader to easily digest the material through balanced theoretical and numerical methods and tools with applications in different fields of ...
Added: November 19, 2026
Approximation of Multivariate Time Series in Astronomy Using Vector Gaussian Processes
Semenikhin T. A., Kornilov M., Pruzhinskaya M. V., Moscow University Physics Bulletin 2025 Vol. 80 No. S1 P. S204–S207
In astronomy, it is often necessary to approximate sparse vector functions, such as multiband light curves of transient objects. Traditional methods typically treat each photometric band independently, ignoring interband correlations and thus failing to fully exploit the available multiband information in sparsely sampled datasets. We propose a vector Gaussian process (GP) framework that models multi-band ...
Added: November 19, 2026
Anomaly detection in Fink: I. Discovery, follow-up, and classification of unusual sources
Pruzhinskaya M. V., Kornilov M., Dodin A. V. et al., Astronomy and Astrophysics 2026 Vol. 715 P. 1–18
Context. Modern wide-field time-domain surveys produce alert streams whose scientific potential is often concentrated in rare and unusual events. Efficient discovery therefore requires automated pipelines to be combined with rapid expert validation and follow-up. Aims. We present the first-year performance of the anomaly detection (AD) pipeline operating within the Fink broker on the Zwicky Transient ...
Added: November 19, 2026
Supernova scores for active anomaly detection
Semenikhin T. A., Kornilov M.V., Pruzhinskaya M. V. et al., Astronomy and Computing 2026 Vol. 56 Article 101126
Large time-domain sky surveys generate extensive multi-year catalogs of light curves in which scientifically valuable transients, such as supernovae (SNe), are vastly outnumbered by artifacts and routine star variability. While supervised machine learning models can efficiently filter known classes, they struggle with extreme class imbalance and may overlook rare or novel events. Conversely, unsupervised anomaly ...
Added: November 19, 2026
Active learning of collinear magnetic Moment Tensor Potentials using the spin-MLIP package from soft-constrained spin-polarized DFT calculations: a case study of Fe-Pd
Burov A., Котыхов А. С., Aksyonov D. et al., Computer Physics Communications 2027 Vol. 330 Article 110458
Explicit incorporation of magnetic degrees of freedom in machine-learning interatomic potentials (magnetic MLIPs) plays a crucial role in the correct description of magnetic materials and their properties. An important ingredient for fitting of magnetic MLIPs is spin-polarized density functional theory (DFT) calculations with non-equilibrium magnetic moments, i.e. DFT calculations with constraints on magnetic moments. In this study, we ...
Added: November 17, 2026
Toward reliable false discovery rate control in classification problems under distribution shift
Kertesz-Farkas A., Andrey B., Plos One 2026 Vol. 21 No. 11 P. 1–20
Background Domain shifts or batch effects can significantly degrade the performance of machine learning-based classifiers in software production without any warning. This can particularly be problematic in medical applications which involve human lives. The shift changes the shape of the prediction score distribution of the test samples compared to that of the training samples; hence, decision ...
Added: November 17, 2026
Траектории ставок как сигнал сговора: LSTM-классификация аукционов государственных закупок
Ефимов К. Д., Журнал Новой экономической ассоциации 2026 № 72 С. 105–114
This study proposes a method for automatic detection of collusive behavior in electronic public procurement auctions based on analysis of the full bid trajectory. The empirical dataset comprises 508 auction histories from 2016–2020 collected from the RTS tender e-procurement platform; the positive class is labeled using case materials of the Federal Antimonopoly Service (FAS Russia), ...
Added: November 13, 2026
Model-Dependent Prompt-Component Ablation for Medical LLM Decision Support: Application to ENT Biologics Screening
Sergey N. Koltcov, Budkovaia M., Surkov A. et al., IEEE Journal of Biomedical and Health Informatics 2026 P. 1–10
Large language models (LLMs) show promise for clinical decision support, but privacy constraints and unreliable free-text decisions limit deployment. We present Medotor, a locally deployed system for screening patients with chronic rhinosinusitis with nasal polyps (CRSwNP) for biologic therapy, and evaluate prompt design on 163 retrospective cases (132 eligible and 31 ineligible). Five models were ...
Added: November 13, 2026
Impact of 5G NR-V2X Message Losses on Connected Vehicle Warning Functions
Физулин А. В., Stepanyants V., Amerikanov A. et al., FUTURE TRANSPORTATION 2026 Vol. 6 No. 6 Article 264
Cooperative warning functions depend on whether V2X information becomes available in time to influence vehicle control. This article presents an event-based co-simulation framework coupling SUMO, ns-3 (ms-van3t), 5G-LENA NR sidelink and application records, with Sionna RT enabled for the intersection scenario. In 140 emergency-vehicle-warning runs, reducing mean packet reception ratio (PRR) from 0.9412 to 0.0675 ...
Added: November 12, 2026
Structural model of decision support system for sustainable development of oil and gas companies
Stoianova A. D., Trofimets V. Y., Matrokhina K. V., International Journal of Engineering, Transactions A: Basics 2025 Vol. 38 No. 4 P. 701–709
The article considers the issue of managerial decision-making in an oil and gas company, which is related to the class of multi-criteria choice problems. To improve the validity of decisions in the context of companies’ sustainable development it is proposed to implement a Decision Support System (DSS). A brief review of the existing methods of ...
Added: November 10, 2026
EdFitter: a hybrid course recommendation system using large language models
Sergei Koltcov, Ryumin D., Alexandr Axyonov et al., PeerJ Computer Science 2026 Article 12:e4141
Educational institutions face increasing pressure to adapt their curricula to the rapidly evolving demands of the job market, and recommender systems can be important tools to guide students in selecting courses that align with their career goals. We present EdFitter, a hybrid course recommendation system that combines pretrained text embeddings for retrieval with large language ...
Added: November 10, 2026
Assessing density equilibration in confined Liquid–Liquid interfaces
Guskov T., Gerke K., Kondratyuk N. et al., Molecular Simulation 2026 Vol. 52 No. 7 P. 546 – 555
Equilibration is often assumed rather than tested in molecular dynamics studies of confined liquid–liquid interfaces, even though different physical properties may relax on different time scales. In this work, equilibration is examined using an automated truncation method based on the marginal standard error rule. Interfacial geometry, wetting behaviour, and density-related properties are analysed for liquid–liquid ...
Added: November 10, 2026
Influence of nuclear quantum effects on metastable states of warm dense hydrogen
Lukyanchuk V., Norman G., Kondratyuk N. et al., Scientific Reports 2026 Vol. 16 No. 1 Article 16435
Previously, it has been effectively shown that nuclear quantum effects (NQE) considerably influence the prediction of the warm dense hydrogen phase diagram. Here, we study the influence of NQE on the parameters of the conducting state formation in warm dense hydrogen using path integral molecular dynamics (PIMD) within the framework of the finite temperature density ...
Added: November 10, 2026
Machine Learning and Knowledge Discovery in Databases. Research Track and Applied Data Science Track. European Conference, ECML PKDD 2026, Naples, Italy, September 7–11, 2026, Proceedings
Cham: Springer, 2027.
This volume is Part VIII of the refereed proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases, ECML PKDD 2026, held in Naples, Italy, September 7–11, 2026. It contains 40 papers from the Research Track and the Applied Data Science Track and is published as volume 16948 of Lecture Notes in ...
Added: November 9, 2026
Reach: Recognising episodes of acute complexity in health: a predictive older patient prioritisation machine learning model
Maghsoohi A., Pavlov V., Rouse P. et al., Health Care Management Science 2026 Vol. 29 Article 37
As the numbers of older people (65 +) rise globally, the pressure on acute hospitals to provide efficient and effective care while addressing resource inequities increases. In this study we introduce Recognising Episodes of Acute Complexity in Health (REACH), a novel Automatic Machine Learning (AutoML)-based predictive model that prioritises older patients and assigns them to complex ...
Added: July 30, 2026
Построение системы опережающих индикаторов для прогнозирования валютного кризиса
Shchepeleva M., Финансы: теория и практика 2025 Т. 29 № 4 С. 146–162
This research is devoted to the analysis of financial crises. We examine different classifications of crises, methods of forecasting, approaches to building systems of early warning indicators. To better understand the potential for predicting financial crises, we conduct our own empirical research, comparing Logit model and random forest to predict currency crises in developing countries. ...
Added: February 12, 2026
Классификации и классификаторы в науке и аналитике
Isakov V., Юридическая техника 2024 № 18 С. 17–31
This consultation is devoted to two closely interrelated issues: the first part examines the logical and methodological foundations of the classification approach in analytics, the second part applies this approach to the analytics itself as an object of classification, considers its types and types. ...
Added: December 15, 2025
Automated Identification of Business Models
Milei P., Votintseva N., Barajas A., Information Processing and Management 2025 Vol. 62 No. 1 Article 103893
As business data grows in volume and complexity, there is an increasing demand for efficient, accurate, and scalable methods to analyse and classify business models. This study introduces and validates a novel approach for the automated identification of business models through content analysis of company reports. Our method builds on the semantic operationalisation of the ...
Added: September 22, 2025
Прогнозирование цен на золото с использованием алгоритмов нейросетей
Soldatova A., Финансы, деньги, инвестиции 2023 № 4 С. 9–15
The price of gold is the most important economic indicator. Expectations of rising inflation and higher key rates from central banks are driving investor interest in gold around the world. Given the increasing number of factors influencing the dynamics of the gold rate in the world, forecasting gold prices requires new methods and modern technological ...
Added: July 8, 2025
Predicting Systemic Risk in the Russian Financial Sector with Boosting Techniques
Shchepeleva M., Procedia Computer Science 2024 Vol. 242 P. 51–56
We test the predictive performance of different ensemble methods for forecasting systemic risk in Russia for the period 2008-2024. In contrast to the existing research on machine learning ensemble techniques, we find that conventional random forest works better for the Russian data. Based on this model, we additionally conduct variable importance analysis. We identify that ...
Added: June 17, 2025
Forecasting Stadium Attendance Using Machine Learning Models: A Case of the National Football League
Пан Ю., Wang F., Studia Sportiva 2024 Vol. 18 No. 2 P. 147–164
Added: May 16, 2025
Thermodynamic Parameters of Khubsugul Mountain Forests (Khordol-Sardag, Mongolia)
R. B. Sandlerskiy, Petrzhik N. M., Jargalsaikhan T. et al., Biology Bulletin 2023 Vol. 50 No. S2 P. S226–S238
The results of using a thermodynamic approach to study the functioning of mountain forest biogeocenoses based on Landsat 8 OLI TIRS multispectral scanner survey for the landscapes of the northwestern Khubsugul region are presented. Using the example of a section of the Khordol-Sardag ridge, the spatiotemporal variation of thermodynamic characteristics calculated within the framework of ...
Added: February 26, 2025
Сравнение ансамблевых и корреляционных графов в задаче классификации состояний мозга на основе фМРТ данных
Vlasenko D., Ушаков В. Г., Zaikin A. et al., Известия высших учебных заведений. Прикладная нелинейная динамика 2025 Т. 33 № 4 С. 557–566
The study of functional brain networks that support cognitive processes is one of the central goals of modern neuroscience. Functional magnetic resonance imaging (fMRI) is widely used to obtain data on brain activity. However, the high dimensionality and dynamic nature of fMRI data makes their processing challenging. Network-based methods of data representation offer a promising approach to describe ...
Added: January 14, 2025
  • About
  • About
  • Key Figures & Facts
  • Sustainability at HSE University
  • Faculties & Departments
  • International Partnerships
  • Faculty & Staff
  • HSE Buildings
  • HSE University for Persons with Disabilities
  • Public Enquiries
  • Studies
  • Admissions
  • Programme Catalogue
  • Undergraduate
  • Graduate
  • Exchange Programmes
  • Summer University
  • Summer Schools
  • Semester in Moscow
  • Business Internship
  • Research
  • International Laboratories
  • Research Centres
  • Research Projects
  • Monitoring Studies
  • Conferences & Seminars
  • Academic Jobs
  • Yasin (April) International Academic Conference on Economic and Social Development
  • Media & Resources
  • Publications by staff
  • HSE Journals
  • Publishing House
  • iq.hse.ru: commentary by HSE experts
  • Library
  • Economic & Social Data Archive
  • Video
  • HSE Repository of Socio-Economic Information
  • HSE1993–2026
  • Contacts
  • Copyright
  • Privacy Policy
  • Site Map
Edit