Advancing Spiking Neural Networks towards Deep Residual Learning

This repo covers the implementation of the following paper:

"Advancing Spiking Neural Networks towards Deep Residual Learning". Paper.

The most straightforward way of training higher quality models is by increasing their size. In this work, we would like to see that deepening network structures could get rid of the degradation problem and always be a trustworthy way to achieve satisfying accuracy for the direct training of SNNs.

This repository contains the source code for the training of our MS-ResNet on ImageNet. The models are defined in models/MS_ResNet.py .

Running

1. Install Python 3.7, PyTorch 1.8 and Tensorboard.

2. Change the data paths vardir,traindir to the image folders of ImageNet dataset.

3. To train the model, please run CUDA_VISIBLE_DEVICES=GPU_IDs python -m torch.distributed.launch --master_port=1234 --nproc_per_node=NUM_GPU_USED train_amp.py -net resnet34 -b 256 -lr 0.1 .

   -net option supports resnet18/34/104 .

Citation

If you find this repo useful for your research, please consider citing the paper

@misc{hu2023advancing,
      title={Advancing Spiking Neural Networks towards Deep Residual Learning}, 
      author={Yifan Hu and Lei Deng and Yujie Wu and Man Yao and Guoqi Li},
      year={2023},
      eprint={2112.08954},
      archivePrefix={arXiv},
      primaryClass={cs.NE}
}