Skip to content

tinker_cookbook.completers.TinkerMessageCompleter

class tinker_cookbook.completers.TinkerMessageCompleter(MessageCompleter)

Message completer that uses a tinker.SamplingClient to generate responses.

Parameters:

  • sampling_client – Client used to sample from the model.
  • renderer – Renderer that converts between messages and token sequences.
  • max_tokens – Maximum number of tokens to generate per call.
  • stop_condition – Custom stop condition. If None, uses the renderer's default stop sequences.
  • temperature – Sampling temperature. Default: 1.0.