Advancing Neural Networks: Innovations and Impacts on Energy Consumption

Advanced Electronic Materials. 2024. Vol. 10. No. 12. Article 2400258.

Fedorova A., Jovišić N., Vallverdù J., Battistoni S., Jovičić M., Medojević M., Toschev A., Alshanskaia E., Talanov M., Erokhin V.

The energy efficiency of Artificial Intelligence (AI) systems is a crucial and actual issue that may have an important impact on an ecological, economic and technological level. Spiking Neural Networks (SNNs) are strongly suggested as valid candidates able to overcome Artificial Neural Networks (ANNs) in this specific contest. In this study, the proposal involves the review and comparison of energy consumption of the popular Artificial Neural Network architectures implemented on the CPU and GPU hardware compared with Spiking Neural Networks implemented in specialized memristive hardware and biological neural network human brain. As a result, the energy efficiency of Spiking Neural Networks can be indicated from 5 to 8 orders of magnitude. Some Spiking Neural Networks solutions are proposed including continuous feedback-driven self-learning approaches inspired by biological Spiking Neural Networks as well as pure memristive solutions for Spiking Neural Networks.

Keywords: нейронные сети, электроника, нейробиология, neurobiology, electronics, Computational biophysics, analog electronics, Биология мозга человека, мемристоры, Artificial Neural Network (ANN), spiking neural networks, спайковые нейронные сети, биофизика, математическая биология, biophysics, mathematical biology, Bio-inspired computing, neuromorphic computing, memristors, биоморфные вычисления