Motivation  

Our proposed framework RoS-KD learns a smooth, well-informed, and robust student manifold by distilling knowledge from multiple teachers trained on noisy medical imaging datasets.

Please refer to the paper for more details: https://arxiv.org/abs/2210.08388