Copy as Markdown View as Markdown

tinker_cookbook.tokenizer_utils.is_tokenizer_registered

Generated from tinker-cookbook at commit 8486b8d. Source links point at that snapshot.

tinker_cookbook.tokenizer_utils.is_tokenizer_registered(name)

Check if a tokenizer name is registered.

Parameters:

• name (str) – The tokenizer name to check.

Returns: bool – True if the name has been registered via register_tokenizer.