dkozlov/awesome-knowledge-distillation

This is a curated collection of research papers focused on 'knowledge distillation,' a technique in machine learning. It helps practitioners who need to make large, complex machine learning models more efficient for real-world deployment. You'll find papers detailing how to compress high-performing but resource-intensive models into smaller, faster ones, while retaining much of their accuracy. This resource is for machine learning engineers, data scientists, or researchers who are optimizing model performance for deployment in resource-constrained environments.

3,825 stars. Actively maintained with 1 commit in the last 30 days.