Code

[Augusta-A]

Hi, Luting. thanks for the excellent work, I really appreciate the open-source code. You provided code for the heterogenous architecture, what about the homogenous architecture(such as retinanet for both teacher and student)? Could you please provide the code as well? Thanks a lot.

[LutingWang]

You are very welcome! I'm currently busy on another project. I'll see if I can get it done next week.

[LutingWang]

Since HEAD is designed for heterogeneous KD, it degenerates to FitNet when applied to homogeneous architectures. Therefore, I provided a baseline experiment for your reference. Performance might benefit from hyper-parameter tuning or extra distillation losses between the heads.