Skip to content

tinker_cookbook.hyperparam_utils.get_full_finetune_lr_multiplier

tinker_cookbook.hyperparam_utils.get_full_finetune_lr_multiplier(model_name)

Get a model-specific LR multiplier for full fine-tuning, proportional to 1/sqrt(param_count).

Parameters:

  • model_name (str) – HuggingFace model identifier.

Returns: The LR multiplier for full fine-tuning.