Skip to content
View as Markdown

tinker_cookbook.tokenizer_utils.unregister_tokenizer

Generated from tinker-cookbook at commit 8486b8d. Source links point at that snapshot.

tinker_cookbook.tokenizer_utils.unregister_tokenizer(name)

Unregister a custom tokenizer factory.

Parameters:

  • name (str) – The tokenizer name to unregister.

Returns: True if the tokenizer was unregistered, False if it wasn't registered.