tinker_cookbook.distillation.DatasetWithTeacher
Generated from tinker-cookbook at commit 8486b8d. Source links point at that snapshot.
class tinker_cookbook.distillation.DatasetWithTeacher()
Pairs a supervised dataset with its teacher model.
Each domain in multi-teacher distillation gets one of these. The teacher's highest-probability tokens are used as soft targets for training.
Fields:
- dataset_builder (SupervisedDatasetBuilder)
- teacher_config (TeacherConfig)
- weight (float, default:
1.0)