?
Simultaneous approximation of a smooth function and its derivatives by deep neural networks with piecewise-polynomial activations
Neural Networks. 2023. Vol. 161. P. 242–253.
This paper investigates the approximation properties of deep neural networks with piecewise-polynomial activation functions. We derive the required depth, width, and sparsity of a deep neural network to approximate any Hölder smooth function up to a given approximation error in Hölder norms in such a way that all weights of this neural network are bounded by 1. The latter feature is essential to control generalization errors in many statistical and machine learning applications.
Keywords: deep neural networks
Publication based on the results of:
Inês G., Скороход С. Н., Matteo d. V. et al., Communications in Nonlinear Science and Numerical Simulation 2027 Vol. 164 P. 1–13
The collective dynamics of spiking networks of neurons has been of central interest to both computational
neuroscience and network science. Over the past years, a new generation of neural
population models based on exact reductions (ER) of spiking networks have been developed.
However, most of these efforts have been limited to networks of neurons with simple dynamics
(e.g. the ...
Added: October 29, 2026
Sergey Slavnov, / Series math "arxiv.org". 2026.
A prototypical example of categorial grammars are those based on Lambek calculus, i.e. noncommutative intuitionistic linear logic. However, it has been noted that purely noncommutative operations are often not sufficient for modeling even very simple natural language phenomena. Therefore a number of alternative formalisms are considered in the literature: those using purely ``commutative'' linear logic ...
Added: October 29, 2026
Association for Computational Linguistics, 2026.
While Large Language Models (LLMs) have revolutionized NLP, they remain prone to hallucinations, reasoning “mode-collapse” in open-ended generation, and a lack of factual provenance. The Automated Knowledge Base Construction (AKBC) workshop addresses a key missing piece of the generative era: structured knowledge. Knowledge Bases (KBs) serve as ground truth for fact verification, the semantic backbone ...
Added: October 28, 2026
Nikitiuk B., Lenev D., Pisarev V. et al., Journal of Colloid and Interface Science 2026 Vol. 718 Article 140444
Hypothesis:Accurate determination of interfacial tension values is crucial for many modeling applications in the oil and gas industry. However, many of the presently used empirical and theoretical models show poor prediction accuracy and do not allow for direct consideration of the concentrations of gases and salts dissolved in the system as well as the specific ...
Added: October 28, 2026
Deshchenya V., Nikolay D. Kondratyuk, Sivakova A. et al., Chemical Engineering Sciences 2027 Vol. 337 Article 124616
Accurate prediction of complex formulation viscosity is crucial for the lubricant industry and engineering processes. However, developing generalizable models remains challenging due to the complexity of industrial mixtures and the scarcity of public experimental data, often resulting from corporate proprietary restrictions. This study presents a machine-learning workflow for viscosity estimation from a proprietary pseudonymized dataset, ...
Added: October 28, 2026
Zubov A., Zubov A., Малявко, Я. et al., Computer Physics Communications 2025 Vol. 317 Article 109860
The concept of representative volume (REV, or RVE in material sciences) is the cornerstone of continuum scale models – one needs to get the volume big enough so that it could be represented with an averaged value (scalar, vector or tensorial, etc.). While REV should be established in all larger scale simulations, this is rarely ...
Added: October 28, 2026
Roman Prosvirnin, Suslov A., Aleksei Soldatov et al., Computation 2026 Vol. 14 No. 10 Article 261
Abstract
Safety-aligned language models often encode that a request is harmful yet still comply with it. We turn this gap between internal recognition and observable behavior into an inference-time defense. The proposed activation-steering method uses a multiplicative operator that amplifies the residual-stream component along a harm-recognition direction. Intervention strength scales with the model’s own assessment of ...
Added: October 27, 2026
Aleksei Samarin, Nazarenko A., Nazarenko D. et al., Big Data and Cognitive Computing 2026 Vol. 10 No. 11 P. 1–52
Camera traps are a key tool for non-invasive wildlife monitoring, yet models trained on existing benchmarks often generalize poorly to new regions due to domain shift, class imbalance, and natural variability in illumination, season, and background. We introduce PACTraD, a benchmark of 116,973 annotated camera trap images collected in a protected area of the Baikal ...
Added: October 27, 2026
IEEE, 2026.
Proceedings of the X Scientific School "Dynamics of Complex Networks and their Applications"
(DCNA'2026) contain papers of reports of scientists and specialists in the field of intelligent technologies,
engineering education, research and design of complex networks.
DCNA'2026 was held from 10 to 12 September 2026 in Moscow, Russia, as a part of the International
Forum on Artificial Intelligence and ...
Added: October 26, 2026
Maddalena L., Yildiz B., Del Vecchio Blanco F. et al., Scientific data 2026 P. 1–20
We addressed the task of chemical characterization of the aerosol emitted by heated tobacco products (HTPs) and of the smoke emitted by conventional/commercial cigarettes, usually adopted as a reference. Emphasis was placed on quantifying constituents for enabling the identification of novel compounds through targeted and untargeted analyses, and the evaluation of reductions in toxicant exposure under ...
Added: October 26, 2026
Flamarion M. V., Pelinovsky E., Wave Motion 2027 Vol. 148 Article 103867
We consider the interaction of two solitary waves in the modified Benjamin–Bona–Mahony
(mBBM) equation in a regime where a small parameter measures the departure from the classical
modified Korteweg–de Vries (mKdV) equation. A regular perturbation method is used to
analyze the modification of the two-soliton wave field induced by the weak non-integrability of
the mBBM equation. We show that, ...
Added: October 23, 2026
Obsie E. Y., Zhan Y., Liu Y., Engineering Research Express 2026 Article 7
Maintaining plant health is crucial for crop quality, food security, and agricultural productivity. Although deep learning methods have shown strong potential for species, disease, and severity classification, most existing approaches tackle these tasks separately, failing to exploit shared representations and interdependencies among them. Furthermore, the variability of disease symptoms, such as subtle differences in size, ...
Added: October 22, 2026
Lev Pyatko, Sergey Aksenov, Regular and Chaotic Dynamics 2026 Vol. 31 No. 5 P. 794–813
In the circular restricted three-body problem, families of periodic and quasi-periodic orbits exist in the vicinity of the libration points and are of significant interest for practical applications. This work presents a neural network-based algorithm for orbit construction and station-keeping, applicable to both periodic and quasi-periodic orbits near collinear libration points. The method employs a ...
Added: October 19, 2026
Vorontsova T., М.: Академия, 2025.
The textbook has been prepared in accordance with the requirements of the federal state educational standards for secondary vocational education and is intended for studying the professional modules “Information Security in Information and Telecommunication Systems and Networks Using Software and Hardware‑Software Tools, Including Cryptographic Protection Tools” and “Information Security in Automated Systems Using Software and ...
Added: October 19, 2026
Prokhorov A., Wei Z., Sang H. et al., Journal of Productivity Analysis 2026 Vol. 65 P. 1–16
The stochastic frontier model (SFM) is widely employed in the analysis of productivity and efficiency, yet strict parametric forms, such as the Cobb-Douglas and Translog functions, are often assumed for modeling production, leading to potential misspecification issues. While semi- and nonparametric SFMs offer greater flexibility, they face challenges in imposing monotonicity and concavity to maintain ...
Added: September 28, 2026
Pikul A. S., Безопасность информационных технологий 2024 Т. 31 № 4 С. 116–127
This article explores the potential use of modern computer vision architectures for the task of deepfake detection. The following architectures are considered: EfficientNet, Vision Transformer (ViT), VisionLSTM (ViL), Vision KAN, and Mamba Vision. The novelty of the approach lies in the application and comparison of these architectures, as well as their combination into paired ensembles ...
Added: December 12, 2025
Kulyasova E. V., Kulyasov N.S., Puchkov A. Y., , in: Journal of Physics: Conference Series Volume 1260, 2019 Mechanical Science and Technology Update 23–24 April 2019, Omsk, Russian Federation.: IOP Publishing, 2019. Ch. 3 P. 032024–032024.
This article is introduced into the perspective tendencies of the digital transformation of chemical enterprises which allow to improve the process of managing enterprises of the branch. Presented the algorithms of managing and technological information processing based on deep neural network apparatus. New approaches to data processing known as video analytics are applied; it allows ...
Added: September 27, 2024
Nakhodnov M., Kodryan M., Lobacheva E. et al., , in: Doklady MathematicsVol. 106. Issue 1: Supplement.: Pleiades Publishing, Ltd. (Плеадес Паблишинг, Лтд), 2023. P. 43–62.
Knowledge of the loss landscape geometry makes it possible to successfully explain the behavior of neural networks, the dynamics of their training, and the relationship between resulting solutions and hyperparameters, such as the regularization method, neural network architecture, or learning rate schedule. In this paper, the dynamics of learning and the surface of the standard ...
Added: June 9, 2023
Kodryan M., Lobacheva E., Nakhodnov M. et al., , in: Thirty-Sixth Conference on Neural Information Processing Systems : NeurIPS 2022.: Curran Associates, Inc., 2022. P. 14058–14070.
A fundamental property of deep learning normalization techniques, such as batch normalization, is making the pre-normalization parameters scale invariant. The intrinsic domain of such parameters is the unit sphere, and therefore their gradient optimization dynamics can be represented via spherical optimization with varying effective learning rate (ELR), which was studied previously. However, the varying ELR ...
Added: December 20, 2022
Lobacheva E., Kodryan M., Chirkova N. et al., , in: Advances in Neural Information Processing Systems 34 (NeurIPS 2021).: Curran Associates, Inc., 2021. P. 21545–21556.
Added: December 29, 2021
Sokolov A., Savchenko A., , in: 2021 IEEE 19th World Symposium on Applied Machine Intelligence and Informatics (SAMI).: IEEE, 2021. P. 413–418.
This paper is focused on the finetuning of acoustic models for speaker adaptation goals on a given gender. We pretrained the Transformer baseline model on Librispeech-960 and conducted experiments with finetuning on the gender-specific test subsets. The obtained word error rate (WER) relatively to the baseline is up to 5% and 3% lower on male ...
Added: September 26, 2021
Belavin V., Ustyuzhanin A., Sergey Shirobokov et al., , in: Advances in Neural Information Processing Systems 33 (NeurIPS 2020).: Curran Associates, Inc., 2020. P. 14650–14662.
Added: February 14, 2021
Sokolov A., / Series Computer Science "arxiv.org". 2021.
Text encodings from automatic speech recognition (ASR) transcripts and audio representations have shown promise in speech emotion recognition (SER) ever since. Yet, it is challenging to explain the effect of each information stream on the SER systems. Further, more clarification is required for analysing the impact of ASR's word error rate (WER) on linguistic emotion ...
Added: November 17, 2020
Lobacheva E., Chirkova N., Kodryan M. et al., , in: Advances in Neural Information Processing Systems 33 (NeurIPS 2020).: Curran Associates, Inc., 2020. P. 2375–2385.
Added: October 29, 2020