linear
Field |
Default |
Description |
Type |
---|---|---|---|
name |
??? |
The referenced name of the object to construct |
str |
warmup_steps |
??? |
Number of warmup steps |
int |
total_steps |
${task.max_steps} |
Total number of steps to run |
int |
warmup_percent |
0.01 |
Percentage of total steps to use as warmup steps, if not specified |
float |
min_scale |
0.0001 |
Minimum learning rate scale |
float |
decay |
True |
Whether to decay the learning rate after warmup |
bool |