tinker_cookbook.preference.ComparisonRendererFromChatRenderer
Generated from tinker-cookbook at commit 8486b8d. Source links point at that snapshot.
class tinker_cookbook.preference.ComparisonRendererFromChatRenderer(ComparisonRenderer)
Wraps a chat Renderer to render Comparisons for preference training.
Formats comparisons by concatenating the prompt conversation with labeled sections for Completion A and Completion B, separated by system markers.
build_generation_prompt(comparison)
Build a model input prompt for generating a preference label.
Parameters:
- comparison (Comparison) – The comparison to render.
Returns: types.ModelInput – Token-level model input ending at the "==== Preference ====" marker, ready for sampling.
property tokenizer
The tokenizer from the underlying chat renderer.
Returns: Tokenizer – The tokenizer instance.