tinker_cookbook.completers.TokenCompleter
class tinker_cookbook.completers.TokenCompleter()
Abstract interface for generating tokens from a prompt.
__call__(model_input, stop, max_tokens)
Generate a token sequence from the given model input.
Parameters:
- model_input (tinker.ModelInput) – The tokenized prompt to complete from.
- stop (StopCondition) – Stop sequences (strings) or stop token IDs that terminate generation.
- max_tokens (int | None) – Optional per-call cap on the number of generated tokens. When set, implementations should generate at most this many tokens (combined with any implementation-level limit by taking the minimum).
None(default) means no per-call override. Rollout runners use this to enforce per-turn token budgets.
Returns: TokensWithLogprobs – The generated tokens with their log-probabilities and stop reason.