max_lr and lr_scheduler
#4
by colourful-tree - opened
Hi, I'm working on continuing pretraining, and I'd like to know some information about this model, such as the max_lr and lr_scheduler during the pretraining phase.
Hi, I'm working on continuing pretraining, and I'd like to know some information about this model, such as the max_lr and lr_scheduler during the pretraining phase.