linear

Fields

Field

Default

Description

Type

name

???

The referenced name of the object to construct

str

warmup_steps

???

Number of warmup steps

int

total_steps

${task.max_steps}

Total number of steps to run

int

warmup_percent

0.01

Percentage of total steps to use as warmup steps, if not specified

float

min_scale

0.0001

Minimum learning rate scale

float

decay

True

Whether to decay the learning rate after warmup

bool