tinker_cookbook.distillation.DatasetWithTeacher

class tinker_cookbook.distillation.DatasetWithTeacher(**)

Pairs a supervised dataset with its teacher model.

Parameters:

• dataset_builder – Builds the supervised dataset for this domain.
• teacher_config – Teacher model to distill from.
• weight – Relative sampling weight when blending multiple domains.

Fields:

• dataset_builder (SupervisedDatasetBuilder)
• teacher_config (TeacherConfig)
• weight (float) – Default: 1.0