tinker_cookbook.completers.TokenCompleter

class tinker_cookbook.completers.TokenCompleter(**)

Abstract interface for generating tokens from a prompt.

__call__(model_input, stop)

Generate a token sequence from the given model input.

Parameters:

• model_input (tinker.ModelInput) – The tokenized prompt to complete from.
• stop (StopCondition) – Stop sequences (strings) or stop token IDs that terminate generation.

Returns: TokensWithLogprobs: The generated tokens with their log-probabilities and stop reason.