tinker.types.SamplingParams

class tinker.types.SamplingParams(BaseModel)

Fields:

• max_tokens – Maximum number of tokens to generate
• seed – Random seed for reproducible generation
• stop – Stop sequences for generation
• temperature – Sampling temperature
• top_k – Top-k sampling parameter (-1 for no limit)
• top_p – Nucleus sampling probability