Skip to content

A minimalist unofficial implementation of "Self-Distillation from the Last Mini-Batch for Consistency Regularization"

Notifications You must be signed in to change notification settings

dongkyunk/DLB-Pytorch

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

DLB-Pytorch

A minimalist unofficial implementation of "Self-Distillation from the Last Mini-Batch for Consistency Regularization"

reference: https://arxiv.org/pdf/2203.16172.pdf

Prerequisites

  • PyTorch
  • PyTorch Lightning
  • timm
  • torchmetrics
  • torchvision
  • python3
  • CUDA

Citations

@misc{https://doi.org/10.48550/arxiv.2203.16172,
  doi = {10.48550/ARXIV.2203.16172},
  url = {https://arxiv.org/abs/2203.16172},
  author = {Shen, Yiqing and Xu, Liwu and Yang, Yuzhe and Li, Yaqian and Guo, Yandong},
  keywords = {Computer Vision and Pattern Recognition (cs.CV), FOS: Computer and information sciences, FOS: Computer and information sciences},
  title = {Self-Distillation from the Last Mini-Batch for Consistency Regularization},
  publisher = {arXiv},
  year = {2022},
  copyright = {Creative Commons Attribution 4.0 International}
}

About

A minimalist unofficial implementation of "Self-Distillation from the Last Mini-Batch for Consistency Regularization"

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages