Spike-based neural networks,which use spikes or action potentialsto represent information,have gained a lot of attention because of their high energyefficiency and low power consumption.To fully leverage its advantage...Spike-based neural networks,which use spikes or action potentialsto represent information,have gained a lot of attention because of their high energyefficiency and low power consumption.To fully leverage its advantages,convertingthe external analog signals to spikes is an essential prerequisite.Conventionalapproaches including analog-to-digital converters or ring oscillators,and sensorssuffer from high power and area costs.Recent efforts are devoted to constructingartificial sensory neurons based on emerging devices inspired by the biologicalsensory system.They can simultaneously perform sensing and spike conversion,overcoming the deficiencies of traditional sensory systems.This review summarizesand benchmarks the recent progress of artificial sensory neurons.It starts with thepresentation of various mechanisms of biological signal transduction,followed bythe systematic introduction of the emerging devices employed for artificial sensoryneurons.Furthermore,the implementations with different perceptual capabilitiesare briefly outlined and the key metrics and potential applications are also provided.Finally,we highlight the challenges and perspectives for the future development of artificial sensory neurons.展开更多
We propose a fractional-order improved Fitz Hugh–Nagumo(FHN)neuron model in terms of a generalized Caputo fractional derivative.Following the existence of a unique solution for the proposed model,we derive the numeri...We propose a fractional-order improved Fitz Hugh–Nagumo(FHN)neuron model in terms of a generalized Caputo fractional derivative.Following the existence of a unique solution for the proposed model,we derive the numerical solution using a recently proposed L1 predictor–corrector method.The given method is based on the L1-type discretization algorithm and the spline interpolation scheme.We perform the error and stability analyses for the given method.We perform graphical simulations demonstrating that the proposed FHN neuron model generates rich electrical activities of periodic spiking patterns,chaotic patterns,and quasi-periodic patterns.The motivation behind proposing a fractional-order improved FHN neuron model is that such a system can provide a more nuanced description of the process with better understanding and simulation of the neuronal responses by incorporating memory effects and non-local dynamics,which are inherent to many biological systems.展开更多
The brain is a complex network system in which a large number of neurons are widely connected to each other and transmit signals to each other.The memory characteristic of memristors makes them suitable for simulating...The brain is a complex network system in which a large number of neurons are widely connected to each other and transmit signals to each other.The memory characteristic of memristors makes them suitable for simulating neuronal synapses with plasticity.In this paper,a memristor is used to simulate a synapse,a discrete small-world neuronal network is constructed based on Rulkov neurons and its dynamical behavior is explored.We explore the influence of system parameters on the dynamical behaviors of the discrete small-world network,and the system shows a variety of firing patterns such as spiking firing and triangular burst firing when the neuronal parameterαis changed.The results of a numerical simulation based on Matlab show that the network topology can affect the synchronous firing behavior of the neuronal network,and the higher the reconnection probability and number of the nearest neurons,the more significant the synchronization state of the neurons.In addition,by increasing the coupling strength of memristor synapses,synchronization performance is promoted.The results of this paper can boost research into complex neuronal networks coupled with memristor synapses and further promote the development of neuroscience.展开更多
The FitzHugh–Nagumo neuron circuit integrates a piezoelectric ceramic to form a piezoelectric sensing neuron,which can capture external sound signals and simulate the auditory neuron system.Two piezoelectric sensing ...The FitzHugh–Nagumo neuron circuit integrates a piezoelectric ceramic to form a piezoelectric sensing neuron,which can capture external sound signals and simulate the auditory neuron system.Two piezoelectric sensing neurons are coupled by a parallel circuit consisting of a Josephson junction and a linear resistor,and a binaural auditory system is established.Considering the non-singleness of external sound sources,the high–low frequency signal is used as the input signal to study the firing mode transition and synchronization of this system.It is found that the angular frequency of the high–low frequency signal is a key factor in determining whether the dynamic behaviors of two coupled neurons are synchronous.When they are in synchronization at a specific angular frequency,the changes in physical parameters of the input signal and the coupling strength between them will not destroy their synchronization.In addition,the firing mode of two coupled auditory neurons in synchronization is affected by the characteristic parameters of the high–low frequency signal rather than the coupling strength.The asynchronous dynamic behavior and variations in firing modes will harm the auditory system.These findings could help determine the causes of hearing loss and devise functional assistive devices for patients.展开更多
This article proposes a novel fractional heterogeneous neural network by coupling a Rulkov neuron with a Hopfield neural network(FRHNN),utilizing memristors for emulating neural synapses.The study firstly demonstrates...This article proposes a novel fractional heterogeneous neural network by coupling a Rulkov neuron with a Hopfield neural network(FRHNN),utilizing memristors for emulating neural synapses.The study firstly demonstrates the coexistence of multiple firing patterns through phase diagrams,Lyapunov exponents(LEs),and bifurcation diagrams.Secondly,the parameter related firing behaviors are described through two-parameter bifurcation diagrams.Subsequently,local attraction basins reveal multi-stability phenomena related to initial values.Moreover,the proposed model is implemented on a microcomputer-based ARM platform,and the experimental results correspond to the numerical simulations.Finally,the article explores the application of digital watermarking for medical images,illustrating its features of excellent imperceptibility,extensive key space,and robustness against attacks including noise and cropping.展开更多
Research on discrete memristor-based neural networks has received much attention.However,current research mainly focuses on memristor–based discrete homogeneous neuron networks,while memristor-coupled discrete hetero...Research on discrete memristor-based neural networks has received much attention.However,current research mainly focuses on memristor–based discrete homogeneous neuron networks,while memristor-coupled discrete heterogeneous neuron networks are rarely reported.In this study,a new four-stable discrete locally active memristor is proposed and its nonvolatile and locally active properties are verified by its power-off plot and DC V–I diagram.Based on two-dimensional(2D)discrete Izhikevich neuron and 2D discrete Chialvo neuron,a heterogeneous discrete neuron network is constructed by using the proposed discrete memristor as a coupling synapse connecting the two heterogeneous neurons.Considering the coupling strength as the control parameter,chaotic firing,periodic firing,and hyperchaotic firing patterns are revealed.In particular,multiple coexisting firing patterns are observed,which are induced by different initial values of the memristor.Phase synchronization between the two heterogeneous neurons is discussed and it is found that they can achieve perfect synchronous at large coupling strength.Furthermore,the effect of Gaussian white noise on synchronization behaviors is also explored.We demonstrate that the presence of noise not only leads to the transition of firing patterns,but also achieves the phase synchronization between two heterogeneous neurons under low coupling strength.展开更多
Memristors are extensively used to estimate the external electromagnetic stimulation and synapses for neurons.In this paper,two distinct scenarios,i.e.,an ideal memristor serves as external electromagnetic stimulation...Memristors are extensively used to estimate the external electromagnetic stimulation and synapses for neurons.In this paper,two distinct scenarios,i.e.,an ideal memristor serves as external electromagnetic stimulation and a locally active memristor serves as a synapse,are formulated to investigate the impact of a memristor on a two-dimensional Hindmarsh-Rose neuron model.Numerical simulations show that the neuronal models in different scenarios have multiple burst firing patterns.The introduction of the memristor makes the neuronal model exhibit complex dynamical behaviors.Finally,the simulation circuit and DSP hardware implementation results validate the physical mechanism,as well as the reliability of the biological neuron model.展开更多
Artificial neural networks(ANN) have been extensively researched due to their significant energy-saving benefits.Hardware implementations of ANN with dropout function would be able to avoid the overfitting problem. Th...Artificial neural networks(ANN) have been extensively researched due to their significant energy-saving benefits.Hardware implementations of ANN with dropout function would be able to avoid the overfitting problem. This letter reports a dropout neuronal unit(1R1T-DNU) based on one memristor–one electrolyte-gated transistor with an ultralow energy consumption of 25 p J/spike. A dropout neural network is constructed based on such a device and has been verified by MNIST dataset, demonstrating high recognition accuracies(> 90%) within a large range of dropout probabilities up to40%. The running time can be reduced by increasing dropout probability without a significant loss in accuracy. Our results indicate the great potential of introducing such 1R1T-DNUs in full-hardware neural networks to enhance energy efficiency and to solve the overfitting problem.展开更多
The Hodgkin–Huxley model assumes independent ion channel activation,although mutual interactions are common in biological systems.This raises the problem why neurons would favor independent over cooperative channel a...The Hodgkin–Huxley model assumes independent ion channel activation,although mutual interactions are common in biological systems.This raises the problem why neurons would favor independent over cooperative channel activation.In this study,we evaluate how cooperative activation of sodium channels affects the neuron’s information processing and energy consumption.Simulations of the stochastic Hodgkin–Huxley model with cooperative activation of sodium channels show that,while cooperative activation enhances neuronal information processing capacity,it greatly increases the neuron’s energy consumption.As a result,cooperative activation of sodium channel degrades the energy efficiency for neuronal information processing.This discovery improves our understanding of the design principles for neural systems,and may provide insights into future designs of the neuromorphic computing devices as well as systematic understanding of pathological mechanisms for neural diseases.展开更多
The paper presents a method of using single neuron adaptive PID control for adjusting system or servo system to implement timber drying process control, which combines the thought of parameter adaptive PID control and...The paper presents a method of using single neuron adaptive PID control for adjusting system or servo system to implement timber drying process control, which combines the thought of parameter adaptive PID control and the character of neural network on exactly describing nonlinear and uncertainty dynamic process organically. The method implements functions of adaptive and self-learning by adjusting weighting parameters. Adaptive neural network can make some output trail given hoping value to decouple in static state. The simulation result indicates the validity, veracity and robustness of the method used in the timber drying process展开更多
In this paper, the multisensor data fusion technique of a fault tolerant integrated navigation system is discussed. A neural approach for data fusion is proposed for multisensor integrated systems. The simulation res...In this paper, the multisensor data fusion technique of a fault tolerant integrated navigation system is discussed. A neural approach for data fusion is proposed for multisensor integrated systems. The simulation results show that this neural approach for data fusion is feasible.展开更多
由于传统的互补金属-氧化物-半导体(Complementary Metal Oxide Semiconductor,CMOS)神经元电路与生物学的契合性较差且电路复杂,提出了一种基于忆阻器的多端口输入的泄露-整合-激发(Leaky-Integrate-Fire,LIF)神经元电路。该电路由运...由于传统的互补金属-氧化物-半导体(Complementary Metal Oxide Semiconductor,CMOS)神经元电路与生物学的契合性较差且电路复杂,提出了一种基于忆阻器的多端口输入的泄露-整合-激发(Leaky-Integrate-Fire,LIF)神经元电路。该电路由运放、逻辑门等器件以及忆阻器构成,主要分为信号叠加模块和神经元信号产生模块。通过施加多个双尖峰脉冲信号并调节输入信号的数量和频率,模拟了生物神经元受到的不同程度刺激。研究发现施加到神经元上信号的数量和频率达到一定的值,神经元电路才会输出电压信号,这与生物体中只有受到一定程度的刺激时才会做出反应的现象是一致的。进一步,调节该电路中神经元信号产生模块的阈值电压大小,研究发现输入相同的信号,只有当电路的阈值电压较低时,神经元电路才能输出电压信号,这与生物中不同部位受到相同的刺激,神经元兴奋程度越高,越容易做出反应的现象一致。由此,该文所提出的LIF神经元电路不仅解决了传统电路输入信号单一、输入信号波形与生物信号波形差异大等问题,而且能模拟生物神经元的兴奋程度,这为人工神经网络的设计提供理论依据。展开更多
The low Earth orbit(LEO)satellite networks have outstanding advantages such as wide coverage area and not being limited by geographic environment,which can provide a broader range of communication services and has bec...The low Earth orbit(LEO)satellite networks have outstanding advantages such as wide coverage area and not being limited by geographic environment,which can provide a broader range of communication services and has become an essential supplement to the terrestrial network.However,the dynamic changes and uneven distribution of satellite network traffic inevitably bring challenges to multipath routing.Even worse,the harsh space environment often leads to incomplete collection of network state data for routing decision-making,which further complicates this challenge.To address this problem,this paper proposes a state-incomplete intelligent dynamic multipath routing algorithm(SIDMRA)to maximize network efficiency even with incomplete state data as input.Specifically,we model the multipath routing problem as a markov decision process(MDP)and then combine the deep deterministic policy gradient(DDPG)and the K shortest paths(KSP)algorithm to solve the optimal multipath routing policy.We use the temporal correlation of the satellite network state to fit the incomplete state data and then use the message passing neuron network(MPNN)for data enhancement.Simulation results show that the proposed algorithm outperforms baseline algorithms regarding average end-to-end delay and packet loss rate and performs stably under certain missing rates of state data.展开更多
基金supported by the Key-Area Research and Development Program of Guangdong Province(Grants No.2021B0909060002)National Natural Science Foundation of China(Grants No.62204219,62204140)Major Program of Natural Science Foundation of Zhejiang Province(Grants No.LDT23F0401).
文摘Spike-based neural networks,which use spikes or action potentialsto represent information,have gained a lot of attention because of their high energyefficiency and low power consumption.To fully leverage its advantages,convertingthe external analog signals to spikes is an essential prerequisite.Conventionalapproaches including analog-to-digital converters or ring oscillators,and sensorssuffer from high power and area costs.Recent efforts are devoted to constructingartificial sensory neurons based on emerging devices inspired by the biologicalsensory system.They can simultaneously perform sensing and spike conversion,overcoming the deficiencies of traditional sensory systems.This review summarizesand benchmarks the recent progress of artificial sensory neurons.It starts with thepresentation of various mechanisms of biological signal transduction,followed bythe systematic introduction of the emerging devices employed for artificial sensoryneurons.Furthermore,the implementations with different perceptual capabilitiesare briefly outlined and the key metrics and potential applications are also provided.Finally,we highlight the challenges and perspectives for the future development of artificial sensory neurons.
文摘We propose a fractional-order improved Fitz Hugh–Nagumo(FHN)neuron model in terms of a generalized Caputo fractional derivative.Following the existence of a unique solution for the proposed model,we derive the numerical solution using a recently proposed L1 predictor–corrector method.The given method is based on the L1-type discretization algorithm and the spline interpolation scheme.We perform the error and stability analyses for the given method.We perform graphical simulations demonstrating that the proposed FHN neuron model generates rich electrical activities of periodic spiking patterns,chaotic patterns,and quasi-periodic patterns.The motivation behind proposing a fractional-order improved FHN neuron model is that such a system can provide a more nuanced description of the process with better understanding and simulation of the neuronal responses by incorporating memory effects and non-local dynamics,which are inherent to many biological systems.
基金Project supported by the Key Projects of Hunan Provincial Department of Education (Grant No.23A0133)the Natural Science Foundation of Hunan Province (Grant No.2022JJ30572)the National Natural Science Foundations of China (Grant No.62171401)。
文摘The brain is a complex network system in which a large number of neurons are widely connected to each other and transmit signals to each other.The memory characteristic of memristors makes them suitable for simulating neuronal synapses with plasticity.In this paper,a memristor is used to simulate a synapse,a discrete small-world neuronal network is constructed based on Rulkov neurons and its dynamical behavior is explored.We explore the influence of system parameters on the dynamical behaviors of the discrete small-world network,and the system shows a variety of firing patterns such as spiking firing and triangular burst firing when the neuronal parameterαis changed.The results of a numerical simulation based on Matlab show that the network topology can affect the synchronous firing behavior of the neuronal network,and the higher the reconnection probability and number of the nearest neurons,the more significant the synchronization state of the neurons.In addition,by increasing the coupling strength of memristor synapses,synchronization performance is promoted.The results of this paper can boost research into complex neuronal networks coupled with memristor synapses and further promote the development of neuroscience.
基金Project supported by the National Natural Science Foundation of China(Grant No.11605014)。
文摘The FitzHugh–Nagumo neuron circuit integrates a piezoelectric ceramic to form a piezoelectric sensing neuron,which can capture external sound signals and simulate the auditory neuron system.Two piezoelectric sensing neurons are coupled by a parallel circuit consisting of a Josephson junction and a linear resistor,and a binaural auditory system is established.Considering the non-singleness of external sound sources,the high–low frequency signal is used as the input signal to study the firing mode transition and synchronization of this system.It is found that the angular frequency of the high–low frequency signal is a key factor in determining whether the dynamic behaviors of two coupled neurons are synchronous.When they are in synchronization at a specific angular frequency,the changes in physical parameters of the input signal and the coupling strength between them will not destroy their synchronization.In addition,the firing mode of two coupled auditory neurons in synchronization is affected by the characteristic parameters of the high–low frequency signal rather than the coupling strength.The asynchronous dynamic behavior and variations in firing modes will harm the auditory system.These findings could help determine the causes of hearing loss and devise functional assistive devices for patients.
文摘This article proposes a novel fractional heterogeneous neural network by coupling a Rulkov neuron with a Hopfield neural network(FRHNN),utilizing memristors for emulating neural synapses.The study firstly demonstrates the coexistence of multiple firing patterns through phase diagrams,Lyapunov exponents(LEs),and bifurcation diagrams.Secondly,the parameter related firing behaviors are described through two-parameter bifurcation diagrams.Subsequently,local attraction basins reveal multi-stability phenomena related to initial values.Moreover,the proposed model is implemented on a microcomputer-based ARM platform,and the experimental results correspond to the numerical simulations.Finally,the article explores the application of digital watermarking for medical images,illustrating its features of excellent imperceptibility,extensive key space,and robustness against attacks including noise and cropping.
基金Project supported by the National Natural Science Foundations of China(Grant Nos.62171401 and 62071411).
文摘Research on discrete memristor-based neural networks has received much attention.However,current research mainly focuses on memristor–based discrete homogeneous neuron networks,while memristor-coupled discrete heterogeneous neuron networks are rarely reported.In this study,a new four-stable discrete locally active memristor is proposed and its nonvolatile and locally active properties are verified by its power-off plot and DC V–I diagram.Based on two-dimensional(2D)discrete Izhikevich neuron and 2D discrete Chialvo neuron,a heterogeneous discrete neuron network is constructed by using the proposed discrete memristor as a coupling synapse connecting the two heterogeneous neurons.Considering the coupling strength as the control parameter,chaotic firing,periodic firing,and hyperchaotic firing patterns are revealed.In particular,multiple coexisting firing patterns are observed,which are induced by different initial values of the memristor.Phase synchronization between the two heterogeneous neurons is discussed and it is found that they can achieve perfect synchronous at large coupling strength.Furthermore,the effect of Gaussian white noise on synchronization behaviors is also explored.We demonstrate that the presence of noise not only leads to the transition of firing patterns,but also achieves the phase synchronization between two heterogeneous neurons under low coupling strength.
基金supported by the National Natural Science Foundation of China(Grant No.62061014)Technological Innovation Projects in the Field of Artificial Intelligence in Liaoning province(Grant No.2023JH26/10300011)Basic Scientific Research Projects in Department of Education of Liaoning Province(Grant No.JYTZD2023021).
文摘Memristors are extensively used to estimate the external electromagnetic stimulation and synapses for neurons.In this paper,two distinct scenarios,i.e.,an ideal memristor serves as external electromagnetic stimulation and a locally active memristor serves as a synapse,are formulated to investigate the impact of a memristor on a two-dimensional Hindmarsh-Rose neuron model.Numerical simulations show that the neuronal models in different scenarios have multiple burst firing patterns.The introduction of the memristor makes the neuronal model exhibit complex dynamical behaviors.Finally,the simulation circuit and DSP hardware implementation results validate the physical mechanism,as well as the reliability of the biological neuron model.
基金Project supported by the National Key Research and Development Program of China (Grant Nos. 2021YFA1202600 and 2023YFE0208600)in part by the National Natural Science Foundation of China (Grant Nos. 62174082, 92364106, 61921005, 92364204, and 62074075)。
文摘Artificial neural networks(ANN) have been extensively researched due to their significant energy-saving benefits.Hardware implementations of ANN with dropout function would be able to avoid the overfitting problem. This letter reports a dropout neuronal unit(1R1T-DNU) based on one memristor–one electrolyte-gated transistor with an ultralow energy consumption of 25 p J/spike. A dropout neural network is constructed based on such a device and has been verified by MNIST dataset, demonstrating high recognition accuracies(> 90%) within a large range of dropout probabilities up to40%. The running time can be reduced by increasing dropout probability without a significant loss in accuracy. Our results indicate the great potential of introducing such 1R1T-DNUs in full-hardware neural networks to enhance energy efficiency and to solve the overfitting problem.
基金supported by the Fundamental Research Funds for the Central Universities(Grant No.lzujbky-2021-62)the Shanghai Municipal Science and Technology Major Project(Grant No.2018SHZDZX01)Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence(LCNBI)and ZJLab,and the National Natural Science Foundation of China(Grant No.12247101).
文摘The Hodgkin–Huxley model assumes independent ion channel activation,although mutual interactions are common in biological systems.This raises the problem why neurons would favor independent over cooperative channel activation.In this study,we evaluate how cooperative activation of sodium channels affects the neuron’s information processing and energy consumption.Simulations of the stochastic Hodgkin–Huxley model with cooperative activation of sodium channels show that,while cooperative activation enhances neuronal information processing capacity,it greatly increases the neuron’s energy consumption.As a result,cooperative activation of sodium channel degrades the energy efficiency for neuronal information processing.This discovery improves our understanding of the design principles for neural systems,and may provide insights into future designs of the neuromorphic computing devices as well as systematic understanding of pathological mechanisms for neural diseases.
基金the Key Technologies R&D Program of Harbin (0111211102).
文摘The paper presents a method of using single neuron adaptive PID control for adjusting system or servo system to implement timber drying process control, which combines the thought of parameter adaptive PID control and the character of neural network on exactly describing nonlinear and uncertainty dynamic process organically. The method implements functions of adaptive and self-learning by adjusting weighting parameters. Adaptive neural network can make some output trail given hoping value to decouple in static state. The simulation result indicates the validity, veracity and robustness of the method used in the timber drying process
文摘In this paper, the multisensor data fusion technique of a fault tolerant integrated navigation system is discussed. A neural approach for data fusion is proposed for multisensor integrated systems. The simulation results show that this neural approach for data fusion is feasible.
文摘由于传统的互补金属-氧化物-半导体(Complementary Metal Oxide Semiconductor,CMOS)神经元电路与生物学的契合性较差且电路复杂,提出了一种基于忆阻器的多端口输入的泄露-整合-激发(Leaky-Integrate-Fire,LIF)神经元电路。该电路由运放、逻辑门等器件以及忆阻器构成,主要分为信号叠加模块和神经元信号产生模块。通过施加多个双尖峰脉冲信号并调节输入信号的数量和频率,模拟了生物神经元受到的不同程度刺激。研究发现施加到神经元上信号的数量和频率达到一定的值,神经元电路才会输出电压信号,这与生物体中只有受到一定程度的刺激时才会做出反应的现象是一致的。进一步,调节该电路中神经元信号产生模块的阈值电压大小,研究发现输入相同的信号,只有当电路的阈值电压较低时,神经元电路才能输出电压信号,这与生物中不同部位受到相同的刺激,神经元兴奋程度越高,越容易做出反应的现象一致。由此,该文所提出的LIF神经元电路不仅解决了传统电路输入信号单一、输入信号波形与生物信号波形差异大等问题,而且能模拟生物神经元的兴奋程度,这为人工神经网络的设计提供理论依据。
文摘The low Earth orbit(LEO)satellite networks have outstanding advantages such as wide coverage area and not being limited by geographic environment,which can provide a broader range of communication services and has become an essential supplement to the terrestrial network.However,the dynamic changes and uneven distribution of satellite network traffic inevitably bring challenges to multipath routing.Even worse,the harsh space environment often leads to incomplete collection of network state data for routing decision-making,which further complicates this challenge.To address this problem,this paper proposes a state-incomplete intelligent dynamic multipath routing algorithm(SIDMRA)to maximize network efficiency even with incomplete state data as input.Specifically,we model the multipath routing problem as a markov decision process(MDP)and then combine the deep deterministic policy gradient(DDPG)and the K shortest paths(KSP)algorithm to solve the optimal multipath routing policy.We use the temporal correlation of the satellite network state to fit the incomplete state data and then use the message passing neuron network(MPNN)for data enhancement.Simulation results show that the proposed algorithm outperforms baseline algorithms regarding average end-to-end delay and packet loss rate and performs stably under certain missing rates of state data.
