Skip to content

ML Systems Engineering — Field Guide

Distillation

Home
1. LLM Post-Training
2. Distributed Training
3. ML Inference & Serving
4. Data at Scale
5. Recommender Systems
6. Transformers Deep Dive
7. RL for LLMs
8. MLOps & Infrastructure
Target Roles
Reading List

ML Systems Engineering — Field Guide

Home
1. LLM Post-Training
1. LLM Post-Training
2. Distributed Training
2. Distributed Training
3. ML Inference & Serving
3. ML Inference & Serving
4. Data at Scale
4. Data at Scale
5. Recommender Systems
5. Recommender Systems
6. Transformers Deep Dive
6. Transformers Deep Dive
7. RL for LLMs
7. RL for LLMs
8. MLOps & Infrastructure
8. MLOps & Infrastructure
Target Roles
Reading List

Distillation

# Knowledge Distillation

Coming soon — teacher-student training, logit matching, dataset distillation.

Made with Zensical