Skip to content

tinker_cookbook.preference.ComparisonRenderer

class tinker_cookbook.preference.ComparisonRenderer(**)

Abstract renderer for converting Comparisons to model inputs for preference training.

build_generation_prompt(comparison)

Build a model input for generating a preference label.

Parameters:

  • comparison (Comparison) – The comparison to render as a prompt.

Returns: types.ModelInput: Token-level model input ready for sampling.

to_model_input_weights(labeled_comparison)

Convert a labeled comparison to model input and per-token loss weights.

Parameters:

  • labeled_comparison (LabeledComparison) – A comparison annotated with a preference label.

Returns: A tuple of (model_input, weights) for training.

property tokenizer

The tokenizer associated with this renderer.

Returns: Tokenizer: The tokenizer instance.