Copy as Markdown View as Markdown

tinker_cookbook.completers.TinkerMessageCompleter

Generated from tinker-cookbook at commit 8486b8d. Source links point at that snapshot.

class tinker_cookbook.completers.TinkerMessageCompleter(MessageCompleter)

Message completer that uses a tinker.SamplingClient to generate responses.

completer = TinkerMessageCompleter(sampling_client, renderer, max_tokens=512)
response = await completer([
{"role": "user", "content": "What is 2+2?"}
])
print(response["content"])