tinker_cookbook.hyperparam_utils.get_full_finetune_lr_multiplier
Generated from tinker-cookbook at commit 8486b8d. Source links point at that snapshot.
tinker_cookbook.hyperparam_utils.get_full_finetune_lr_multiplier(model_name)
Get a model-specific LR multiplier for full fine-tuning, proportional to 1/sqrt(param_count).
Parameters:
- model_name (str) – HuggingFace model identifier.
Returns: The LR multiplier for full fine-tuning.