Spiking Neural Networks: A Comprehensive Survey of Training Methodologies, Hardware Implementations and Applications

Khan, Ameer Hamza; Cao, Xinwei; Luo, Chunbo; Zhang, Shiqing; Guo, Wenping; Vasilios N. Katsikis; Shuai Li

Jerbi, H., Aoun, S. B., Abbassi, R., Kchaou, M., Simos, T. E., Mourtas, S. D., Katsikis, V. N., et al. (2026). An innovative neutrosophic logic adaptive high-order zeroing neural network for solving linear matrix equations: Applications to acoustic source tracking. Journal of Computational and Applied Mathematics, 475, 117058. Publisher's Version Abstract

Scholars have put a lot of emphasis on time-varying linear matrix equations (LMEs) problems because of its importance in science and engineering. The problem of determining the time-varying LME’s minimum-norm least-squares solution (MLLE) is therefore tackled in this work. This is achieved by the use of NHZNN, a recently developed neutrosophic logic/fuzzy adaptive high-order zeroing neural network technique. The NHZNN is an advancement on the conventional zeroing neural network (ZNN) technique, which has shown great promise in solving time-varying tasks. To address the MLLE task for arbitrary-dimensional time-varying matrices, three novel ZNN models are presented. The models perform exceptionally well, as demonstrated by two simulation studies and two real-world applications to acoustic source tracking.

Cao, X., Yang, Y., Li, S., Katsikis, V. N., & Stanimirović, P. S. (2025). A novel competition model for dynamic winner-take-all. International Journal of Systems Science, 1–23. Taylor & Francis. Website

Khan, A. H., Cao, X., Luo, C., Zhang, S., Guo, W., Katsikis, V. N., & Li, S. (2025). Spiking Neural Networks: A Comprehensive Survey of Training Methodologies, Hardware Implementations and Applications. Artificial Intelligence Science and Engineering, IEEEXplore, 1, 175-207.

Cao, X., Yang, Y., Li, S., & Katsikis, V. N. (2025). k-Winner-Take-All Competition Based on Novel Dynamic Neural Networks. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 1-11.

Gupta, R., Bartolucci, F., Katsikis, V. N., & Patnaik, S. (2025). Recent Developments in Computational Finance and Business Analytics: Proceedings of the 3rd International Conference on Computational Finance and Business Analytics. Learning and Analytics in Intelligent Systems. Springer. Website

Mourtas, S. D., Li, S., Cao, X., Liao, B., & Katsikis, V. N. (2025). Current Trends and Challenges in Applying Metaheuristics to the Innovative Area of Weight and Structure Determination Neuronets. Inventions, 10. Website Abstract

The weights and structure determination (WASD) neuronet (or neural network) is a single-hidden-layer feedforward neuronet that exhibits an excellent approximation ability, despite its simple structure. Thanks to its strong generalization, fast speed, and ease of implementation, the WASD neuronet has been the subject of many modifications, including metaheuristics, and applications in a wide range of scientific fields. As it has garnered significant attention in the last decade, the aim of this study is to provide an extensive overview of the WASD framework. Furthermore, the WASD has been effectively used in numerous real-time learning tasks like regression, multiclass classification, and binary classification due to its exceptional performance. In addition, we present WASD’s applications in social science, business, engineering, economics, and medicine. We aim to report these developments and provide some avenues for further research.

He, Y., Wang, X., Tie, Y., Yang, H., Simos, T. E., Mourtas, S. D., & Katsikis, V. N. (2025). Solving Lur'e equations through zeroing neural networks. Information Sciences, 718, 122418. Website Abstract

Solving Lur'e equations plays a critical role in addressing linear-quadratic optimal control (LQOC) problems, especially in cases where the control cost matrices are singular. This paper introduces, for the first time, two novel zeroing neural network (ZNN) models—ZNNLE and ZNNLE-LQOC—specifically designed to solve the Lur'e equation system and the LQOC problem, respectively. The proposed models extend the applicability of the ZNN methodology to these challenging scenarios by offering robust and efficient solutions to time-varying matrix equations. Theoretical analyses confirm the validity of both models, while numerical simulations and practical applications demonstrate their effectiveness. Moreover, a comparative study with an enhanced alternating-direction implicit (ADI) method highlights the superior performance of the ZNNLE-LQOC model in solving LQOC problems.

Katsikis, V. N., Liao, B., & Hua, C. (2025). Survey of Neurodynamic Methods for Control and Computation in Multi-Agent Systems. Symmetry, 17. Website Abstract

Neurodynamics is recognized as a powerful tool for addressing various problems in engineering, control, and intelligent systems. Over the past decade, neurodynamics-based methods and models have been rapidly developed, particularly in emerging areas such as neural computation and multi-agent systems. In this paper, we provide a brief survey of neurodynamics applied to computation and multi-agent systems. Specifically, we highlight key models and approaches related to time-varying computation, as well as cooperative and competitive behaviors in multi-agent systems. Furthermore, we discuss current challenges, potential opportunities, and promising future directions in this evolving field.

Yang, Y., Wu, P., Katsikis, V. N., Li, S., & Feng, W. (2025). A novel real-time noise-resilient zeroing neural network and its applications to matrix problem solving. Mathematics and Computers in Simulation. Website Abstract

Given the critical role of zeroing neural networks (ZNN) in various fields and the practical demand for models in effectively resisting real-time noise, this study introduces a novel anti-noise integral zeroing neural network (AN-IZNN) model alongside its enhanced counterpart (EAN-IZNN), for the applications of matrix problem solving. Theoretical analysis demonstrates their ability to achieve convergence even under different noise conditions. Both theoretical analyses and simulation validations highlight the superior performance of the proposed models over existing neural network models. Notably, the root mean square error of the proposed AN-IZNN and EAN-IZNN models is reduced by 92.6249% and 91.4178%, respectively, compared to scenarios without the proposed method, demonstrating the effectiveness of the solution.

Cao, X., Yang, Y., Li, S., Stanimirović, P. S., & Katsikis, V. N. (2025). Artificial Neural Dynamics for Portfolio Allocation: An Optimization Perspective. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 1-12.

Vasilios Katsikis

Professor, Economics

Spiking Neural Networks: A Comprehensive Survey of Training Methodologies, Hardware Implementations and Applications

Citation:

Contact Details

Recent Publications

Publications per year