tinker_cookbook.hyperparam_utils.get_lr

tinker_cookbook.hyperparam_utils.get_lr(model_name, is_lora)

Get a recommended learning rate for the given model.

Parameters:

• model_name (str) – HuggingFace model identifier.
• is_lora (bool) – If True, scale the base LR by the LoRA multiplier (10x).

Returns: The recommended learning rate.