kanshan/minimind
1
0
Fork 0
mirror of https://github.com/jingyaogong/minimind.git synced 2026-04-25 08:48:16 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

Merge pull request #571 from dyhuachi/dyhuachi-patch-1

Browse Source 
[fix] Refactor get_lr function to include min_lr calculation
This commit is contained in:
jingyaogong 2025-12-09 12:59:11 +08:00 committed by GitHub
commit aa7dc0f61e
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 2 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
trainer/trainer_utils.py
View File

@ -23,7 +23,8 @@ def Logger(content):
def get_lr(current_step, total_steps, lr):
return lr / 10 + 0.5 * lr * (1 + math.cos(math.pi * current_step / total_steps))
min_lr = lr / 10
return min_lr + 0.5 * (lr - min_lr) * (1 + math.cos(math.pi * current_step / total_steps))
def init_distributed_mode():