摘要
脉冲神经网络(spiking neural network, SNN)由于在神经形态芯片上低功耗和高速计算的独特性质而受到广泛的关注。深度神经网络(deep neural network, DNN)到SNN的转换方法是有效的脉冲神经网络训练方法之一,然而从DNN到SNN的转换过程中存在近似误差,转换后的SNN在短时间步长下遭受严重的性能退化。通过对转换过程中的误差进行详细分析,将其分解为量化和裁剪误差以及不均匀误差,提出了一种改进SNN阈值平衡的自适应阈值算法。通过使用最小化均方误差(MMSE)更好地平衡量化误差和裁剪误差;此外,基于IF神经元模型引入了双阈值记忆机制,有效解决了不均匀误差。实验结果表明,改进算法在CIFAR-10、CIFAR-100数据集以及MIT-BIH心律失常数据库上取得了很好的性能,对于CIFAR10数据集,仅用16个时间步长就实现了93.22%的高精度,验证了算法的有效性。
SNN has gained widespread attention due to its low power consumption and high-speed computing capabilities on neuromorphic chips.The conversion from DNN to SNN is an effective training method for SNN.However,there are approximation errors in the conversion process,leading to significant performance degradation of the converted SNN under short time steps.Through a detailed analysis of the errors in the conversion process,this paper decomposed them into quantization and pruning errors and asymmetric errors,and proposed an improved adaptive threshold algorithm to balance the threshold of SNN.It used the mean square error(MMSE)to achieve a better balance between quantization and pruning errors.Additionally,this algorithm introduced a dual-threshold memory mechanism based on the IF neuron model to effectively address the asymmetric errors.Experimental results demonstrate that the improved algorithm achieves excellent performance on the CIFAR-10,CIFAR-100 datasets,and the MIT-BIH arrhythmia dataset.For the CIFAR-10 dataset,it achieves a high accuracy of 93.22%with only 16 time steps,validating the effectiveness of the algorithm.
作者
王浩杰
刘闯
Wang Haojie;Liu Chuang(School of Information Engineering,Shenyang University,Shenyang 110044,China)
出处
《计算机应用研究》
CSCD
北大核心
2024年第1期177-182,187,共7页
Application Research of Computers
基金
辽宁省自然科学基金资助项目(2023-MS-322)
辽宁省自然科学基金计划重点项目(20170520364)
中国博士后科学基金会资助项目(2021M693858)
沈阳市中青年科技创新人才支持计划资助项目(RC210400)。
关键词
脉冲神经网络
高精度转换
双阈值记忆神经元
自适应阈值
spiking neural network
high precision conversion
dual-threshold memory neuron
adaptive threshold
作者简介
王浩杰(1998-),男,山东临沂人,硕士研究生,主要研究方向为深度学习、脉冲神经网络(whj283874793@163.com);通信作者:刘闯(1984-),男,辽宁沈阳人,教授,硕导,博士,主要研究方向为多目标优化、进化计算、进化神经网络、物联网以及复杂工业系统的建模和控制.
