Skip to content

tinker_cookbook.tokenizer_utils.unregister_tokenizer

tinker_cookbook.tokenizer_utils.unregister_tokenizer(name)

Unregister a custom tokenizer factory.

Parameters:

  • name (str) – The tokenizer name to unregister.

Returns: True if the tokenizer was unregistered, False if it wasn't registered.