Skip to content

tinker.types.SampleResponse

class tinker.types.SampleResponse(BaseModel)

Fields:

  • sequences
  • type
  • prompt_logprobs – If prompt_logprobs was set to true in the request, logprobs are computed for every token in the prompt. The prompt_logprobs response contains a float32 value for every token in the prompt.
  • topk_prompt_logprobs – If topk_prompt_logprobs was set to a positive integer k in the request, the top-k logprobs are computed for every token in the prompt. The topk_prompt_logprobs response contains, for every token in the prompt, a list of up to k (token_id, logprob) tuples.