distillation

• Knowledge Distillation
  • Introduction of model compression methods
  • SSLD
    • Introduction
    • Data selection
  • Experiments
    • Choice of teacher model
    • Distillation using large-scale dataset
    • finetuning using ImageNet1k
    • Data agmentation and Fix strategy
    • Some phenomena during the experiment
  • Application of the distillation model
    • Instructions
    • Transfer learning
    • Object detection
  • Practice
    • Configuration
    • Begin to train the network
    • Note
  • Reference