• A
  • A
  • A
  • АБВ
  • АБВ
  • АБВ
  • A
  • A
  • A
  • A
  • A
Обычная версия сайта
  • RU
  • EN
  • HSE University
  • Publications
  • Book chapter
  • Pattern Classification with the Probabilistic Neural Networks Based on Orthogonal Series Kernel
  • RU
  • EN
Расширенный поиск
Высшая школа экономики
Национальный исследовательский университет
Priority areas
  • business informatics
  • economics
  • engineering science
  • humanitarian
  • IT and mathematics
  • law
  • management
  • mathematics
  • sociology
  • state and public administration
by year
  • 2027
  • 2026
  • 2025
  • 2024
  • 2023
  • 2022
  • 2021
  • 2020
  • 2019
  • 2018
  • 2017
  • 2016
  • 2015
  • 2014
  • 2013
  • 2012
  • 2011
  • 2010
  • 2009
  • 2008
  • 2007
  • 2006
  • 2005
  • 2004
  • 2003
  • 2002
  • 2001
  • 2000
  • 1999
  • 1998
  • 1997
  • 1996
  • 1995
  • 1994
  • 1993
  • 1992
  • 1991
  • 1990
  • 1989
  • 1988
  • 1987
  • 1986
  • 1985
  • 1984
  • 1983
  • 1982
  • 1981
  • 1980
  • 1979
  • 1978
  • 1977
  • 1976
  • 1975
  • 1974
  • 1973
  • 1972
  • 1971
  • 1970
  • 1969
  • 1968
  • 1967
  • 1966
  • 1965
  • 1964
  • 1963
  • 1958
  • More
Subject
News
August 12, 2026
‘I Would Like My Research to Help Make the World a Calmer and Better Place
Whatever task Saraa Ali, Junior Research Fellow at the Laboratory of Methods for Big Data Analysis (LAMBDA) of the AI and Digital Science Institute (HSE Faculty of Computer Science), is working on, she thinks about how it can benefit people. She told the Young Scientists of HSE University project about her large family, diagnosing three-phase motors, and her dream of building a children’s home in her native country.
August 11, 2026
‘The Peak of Stupidity and ‘The Valley of Despair: HSE Economists Propose an Explanation for the Dunning–Kruger Effect
The Dunning–Kruger effect, which describes a sharp surge in self-confidence among beginners followed by an equally rapid decline as they gain experience, can be explained by the nature of the learning process and the acquisition of new knowledge. This conclusion was reached by Andrey Vorchik of the HSE Faculty of Economic Sciences together with independent researcher Murat Mamyshev. They developed a mathematical model of learning and demonstrated how subjective confidence is formed and changes as knowledge accumulates, as well as how teachers can reduce the ‘valley of despair’ experienced by learners.
July 24, 2026
‘I Like Self-Fulfilling Prophecies
Andrey Vorchik studies happiness, delivers popular science lectures, and believes that science should address social issues as well. In an interview for the Young Scientists of HSE University project, he spoke about how emotions influence decision-making, the Bermuda Triangle formed by the bathroom, refrigerator, and bed, and the ideal formula for education.

 

Have you spotted a typo?
Highlight it, click Ctrl+Enter and send us a message. Thank you for your help!

Publications
  • Books
  • Articles
  • Chapters of books
  • Working papers
  • Report a publication
  • Research at HSE

?

Pattern Classification with the Probabilistic Neural Networks Based on Orthogonal Series Kernel

P. 505–512.
Savchenko A.

Probabilistic neural network (PNN) is the well-known instance-based learning algorithm, which is widely used in various pattern classification and regression tasks, if rather small number of instances for each class is available. The known disadvantage of this network is its insufficient classification computational complexity. The common way to overcome this drawback is the reduction techniques with selection of the most typical instances. Such approach causes the shifting of the estimates of the class probability distribution, and, in turn, the decrease of the classification accuracy. In this paper we examine another possible solution by replacing the Gaussian window and the Parzen kernel to the orthogonal series Fejér kernel and using the naïve assumption about independence of features. It is shown, that our approach makes it possible to achieve much better runtime complexity in comparison with either original PNN or its modification with the preliminary clustering of the training set.

Language: English
DOI
Text on another site
Keywords: probabilistic neural networksmall sample size problemsPattern classificationOrthogonal series kernelNonparametric density estimates

In book

Advances in Neural Networks – ISNN 2016. 13th International Symposium on Neural Networks, ISNN 2016, St. Petersburg, Russia, July 6-8, 2016, Proceedings
Advances in Neural Networks – ISNN 2016. 13th International Symposium on Neural Networks, ISNN 2016, St. Petersburg, Russia, July 6-8, 2016, Proceedings
Т. 9719: Lecture Notes in Computer Science. , Switzerland: Springer, 2016.
Similar publications
Classification of emotion categories based on functional connectivity patterns of the human brain
Saarimäki H., Glerean E., Smirnov D. et al., Neuroimage 2022 No. 247 P. 1–10
Neurophysiological and psychological models posit that emotions depend on connections across wide-spread corticolimbic circuits. While previous studies using pattern recognition on neuroimaging data have shown differences between various discrete emotions in brain activity patterns, less is known about the differences in functional connectivity. Thus, we employed multivariate pattern analysis on functional magnetic resonance imaging data (i) ...
Added: August 30, 2023
Sequential analysis in Fourier probabilistic neural networks
Savchenko A., Belova N. S., Expert Systems with Applications 2022 Vol. 207 Article 117885
In this paper, the computational complexity of the probabilistic neural network for the classification of high-dimensional data is improved. At first, the class probability densities are estimated by using only a few principal components of an observed point. The Gaussian–Parzen kernel is replaced by the orthogonal series estimates of class-conditional densities for each principal component using the Fourier series to speed ...
Added: June 29, 2022
Probabilistic Neural Network With Complex Exponential Activation Functions in Image Recognition
Savchenko A., IEEE Transactions on Neural Networks and Learning Systems 2020 Vol. 31 No. 2 P. 651–660
If the training data set in image recognition task is not very large, the feature extraction with a convolutional neural network is usually applied. Here, we focus on the nonparametric classification of extracted feature vectors using the probabilistic neural network (PNN). The latter is characterized by the high runtime and memory space complexity. We propose ...
Added: November 1, 2019
Efficient Statistical Face Recognition Using Trigonometric Series and CNN Features
Savchenko A., , in: Proceedings of the 24th International Conference on Pattern Recognition (ICPR).: IEEE, 2018. P. 3262–3267.
In this paper we deal with unconstrained face recognition with few training samples. The facial images are described with the off-the shelf high-dimensional features extracted with a deep convolutional neural network (CNN), which was preliminarily trained with an external very-large dataset. We focus on drawbacks of conventional probabilistic neural network (PNN), namely, low recognition performance ...
Added: December 2, 2018
Classification of Dangerous Situations for Small Sample Size Problem in Maintenance Decision Support Systems
Milov V., Savchenko A., , in: 5th Conference on Analysis of Images, Social Networks, and Text (AIST 2016).: Springer, 2017. P. 338–345.
In this paper we examine the maintenance decision support in classification of the dangerous situations discovered by the monitoring system. This task is reduced to the contextual multi-armed bandit problem. We highlight small sample size problem appeared in this task due to the rather rare failures. The novel algorithm based on the nearest neighbor search ...
Added: October 26, 2018
Тригонометрическая система функций в проекционных оценках плотности вероятности нейросетевых признаков изображений
Savchenko A., Компьютерная оптика 2018 Т. 42 № 1 С. 149–158
In this paper we study the image recognition tasks, in which images are described by high dimensional feature vectors extracted with deep convolutional neural networks and principal component analysis. In particular, we focus on the problem of high computational complexity of statistical approach with non-parametric estimates of probability density implemented by the probabilistic neural network. ...
Added: April 11, 2018
Maximum-likelihood approximate nearest neighbor method in real-time image recognition
Savchenko A., Pattern Recognition 2017 Vol. 61 P. 459–469
An exhaustive search of all classes in pattern recognition methods cannot be implemented in real-time, if the database contains a large number of classes. In this paper we introduce a novel probabilistic approximate nearest-neighbor (NN) method. Despite the most of known fast approximate NN algorithms, our method is not heuristic. The joint probabilistic densities (likelihoods) ...
Added: August 30, 2016
The Adaptive Approach to Abnormal Situations Recognition Using Images from Condition Monitoring Systems
Savchenko A., Milov V., Optical Memory and Neural Networks (Information Optics) 2016 Vol. 25 No. 2 P. 79–87
Decision support in equipment condition monitoring systems with image processing is analyzed. Long-run accumulation of information about earlier made decisions is used to realize the adaptiveness of the proposed approach. It is shown that unlike conventional classification problems, the recognition of abnormalities uses training samples supplemented with reward estimates of earlier decisions and can be ...
Added: July 10, 2016
Pattern Classification with the Probabilistic Neural Networks Based on Orthogonal Series Kernel
Savchenko A., Lecture Notes in Computer Science 2016 Vol. 9719 P. 505–512
Probabilistic neural network (PNN) is the well-known instance-based learning algorithm, which is widely used in various pattern classification and regression tasks, if rather small number of instances for each class is available. The known disadvantage of this network is its insufficient classification computational complexity. The common way to overcome this drawback is the reduction techniques ...
Added: July 6, 2016
Sequential Hierarchical Image Recognition Based on the Pyramid Histograms of Oriented Gradients with Small Samples
Savchenko A., Belova N. S., Milov V., , in: Analysis of Images, Social Networks and Texts. 4th International Conference, AIST 2015, Yekaterinburg, Russia, April 9–11, 2015, Revised Selected PapersVol. 542: Series: Communications in Computer and Information Science.: Switzerland: Springer, 2015. Ch. 2 P. 14–23.
In this paper we explore an application of the pyramid HOG (Histograms of Oriented Gradients) features in image recognition problem with small samples. A sequential analysis is used to improve the performance of hierarchical methods. We propose to process the next, more detailed level of pyramid only if the decision at the current level is ...
Added: December 4, 2015
Об одном подходе к последовательному иерархическому распознаванию изображений
Savchenko A., Милов В. Р., В кн.: XVII ВСЕРОССИЙСКАЯ НАУЧНО-ТЕХНИЧЕСКАЯ КОНФЕРЕНЦИЯ "НЕЙРОИНФОРМАТИКА-2015": Сборник научных трудов. В 3-х частях.Ч. 3.: М.: НИЯУ МИФИ, 2015. С. 50–58.
Рассматривается задача автоматического распознавания изображений. Предложен иерархический подход к ее решению, в котором переход на более детальный уровень описания происходит только при недостаточной надежности классификации на предыдущем уровне. Представлены примеры практического применения в задаче распознания лиц по фотографии. ...
Added: October 8, 2015
Об одном способе повышения вычислительной эффективности вероятностной нейронной сети в задаче распознавания образов на основе проекционных оценок
Savchenko A., Информационные системы и технологии 2015 № 4(90) С. 28–38
Рассмотрена проблема недостаточной вычислительной эффективности вероятностной нейронной сети (ВНС) в задачах распознавания образов при наличии в базе данных для каждого класса небольшого числа эталонов. На основе проекционных оценок плотности распределения с ядром Фейера и наивного предположения о независимости признаков классифицируемого объекта синтезирована новая модификация ВНС. Экспериментально показано, что предложенный классификатор оказался несколько точнее и намного ...
Added: October 8, 2015
Nonlinear Transformation of the Distance Function in the Nearest Neighbor Image Recognition
Savchenko A., Lecture Notes in Computer Science 2014 Vol. 8641 P. 261–266
Conventional image recognition methods usually include dividing the keypoint neighborhood (for local features) or the whole object (for global features) into a grid of blocks, computing the gradient magnitude and orientation at each image sample point and uniting the orientation histograms of all blocks into a single descriptor. The query image is recognized by matching ...
Added: August 27, 2014
Применение асимптотических методов в автоматизированном проектировании технических объектов
Ivashov E., Князева М. П., Костомаров П. С. et al., Международный журнал экспериментального образования 2014 Т. 2 № 1 С. 105–108
The problem of small sample size, i.e. absence of required quantity of empirical data for decision making of rational constructive-technically, in case of computer-aided design of elements, nodes and technical objects’ devices is considered. Randomization approach for blur factor’s determination of nonparametric decision rules is suggested. The approach of Laplace’s method in using cores’ asymptotic ...
Added: January 25, 2014
Статистическое распознавание образов на основе вероятностной нейронной сети с проверкой однородности
Savchenko A., Искусственный интеллект и принятие решений 2013 № 4 С. 45–56
Statistical pattern recognition was reduced to the hypothesis test for homogeneity. The probabilistic neural network (PNN) modification was proposed to achieve its optimal decision in terms of minimum Bayes-risk. The comparative analysis' results of the proposed modification with an original PNN were presented in a problem of automatic author identification ...
Added: December 23, 2013
Pattern recognition and increasing of the computational efficiency of a parallel realization of the probabilistic neural network with homogeneity testing
Savchenko A., Optical Memory and Neural Networks (Information Optics) 2013 Vol. 22 No. 3 P. 184–192
The research subject is the computational complexity of the probabilistic neural network (PNN) in the pattern recognition problem for large model databases. We examined the following methods of increasing the efficiency of a neuralnetwork classifier: a parallel multithread realization, reducing the PNN to a criterion with testing of homogeneity of feature histograms of input and ...
Added: September 10, 2013
Image recognition on the basis of probabilistic neural network with homogeneity testing
Savchenko A., Computer Optics 2013 Vol. 37 No. 2 P. 254–262
The usage of the probabilistic neural network with homogeneity testing is proposed in image recognition problem. This decision is shown to be optimal in Bayesian terms if the task is formulated as a statistical testing for homogeneity of query and model images' feature sets. The problem of the lack of computing efficiency with many classes ...
Added: July 1, 2013
Probabilistic neural network with homogeneity testing in recognition of discrete patterns set
Savchenko A., Neural Networks 2013 Vol. 46 P. 227–241
The article is devoted to pattern recognition task with the database containing small number of samples per class. By mapping of local continuous feature vectors to a discrete range, this problem is reduced to statistical classification of a set of discrete finite patterns. It is demonstrated that Bayesian decision under the assumption that probability distributions ...
Added: June 16, 2013
Statistical Recognition of a Set of Patterns Using Novel Probability Neural Network
Savchenko A., Lecture Notes in Artificial Intelligence 2012 Vol. 7477 LNCS P. 93–103
Since the works by Specht, the probabilistic neural networks (PNNs) have attracted researchers due to their ability to increase training speed and their equivalence to the optimal Bayesian decision of classification task. However, it is known that the PNN's conventional implementation is not optimal in statistical recognition of a set of patterns. In this article ...
Added: February 26, 2013
  • About
  • About
  • Key Figures & Facts
  • Sustainability at HSE University
  • Faculties & Departments
  • International Partnerships
  • Faculty & Staff
  • HSE Buildings
  • HSE University for Persons with Disabilities
  • Public Enquiries
  • Studies
  • Admissions
  • Programme Catalogue
  • Undergraduate
  • Graduate
  • Exchange Programmes
  • Summer University
  • Summer Schools
  • Semester in Moscow
  • Business Internship
  • Research
  • International Laboratories
  • Research Centres
  • Research Projects
  • Monitoring Studies
  • Conferences & Seminars
  • Academic Jobs
  • Yasin (April) International Academic Conference on Economic and Social Development
  • Media & Resources
  • Publications by staff
  • HSE Journals
  • Publishing House
  • iq.hse.ru: commentary by HSE experts
  • Library
  • Economic & Social Data Archive
  • Video
  • HSE Repository of Socio-Economic Information
  • HSE1993–2026
  • Contacts
  • Copyright
  • Privacy Policy
  • Site Map
Edit