Skip to content

tinker_cookbook.hyperparam_utils.get_lora_lr_multiplier

tinker_cookbook.hyperparam_utils.get_lora_lr_multiplier(model_name)

Get a model-specific multiplier for the LR, when training with LoRA.

Parameters:

  • model_name (str) – HuggingFace model identifier.

Returns: The LoRA LR multiplier combining full-finetune scaling and LoRA factor.