TMN: A Lightweight Neuron Model for Efficient Nonlinear Spike Representation
TMN: A Lightweight Neuron Model for Efficient Nonlinear Spike Representation
Spike trains serve as the primary medium for information transmission in Spiking Neural Networks, playing a crucial role in determining system efficiency. Existing encoding schemes based on spike counts or timing often face severe limitations under low-timestep constraints, while more expressive alternatives typically involve complex neuronal dynamics or system designs, which hinder scalability and practical deployment. To address these challenges, we propose the Ternary Momentum Neuron (TMN), a novel neuron model featuring two key innovations: (1) a lightweight momentum mechanism that realizes exponential input weighting by doubling the membrane potential before integration, and (2) a ternary predictive spiking scheme which employs symmetric sub-thresholds $\pm\frac{1}{2}v_{th}$ to enable early spiking and correct over-firing. Extensive experiments across diverse tasks and network architectures demonstrate that the proposed approach achieves high-precision encoding with significantly fewer timesteps, providing a scalable and hardware-aware solution for next-generation SNN computing.
Kejie Huang、Yiwen Gu、Junchuan Gu、Haibin Shen
计算技术、计算机技术
Kejie Huang,Yiwen Gu,Junchuan Gu,Haibin Shen.TMN: A Lightweight Neuron Model for Efficient Nonlinear Spike Representation[EB/OL].(2025-06-29)[2025-07-21].https://arxiv.org/abs/2408.17245.点此复制
评论