sgd

Fields

Field

Default

Description

Type

name

???

The referenced name of the object to construct

str

lr

0.001

Learning rate

float

momentum

0.0

Momentum term for all parameters

float

dampening

0.0

Dampening for momentum

float

nesterov

False

Enable Nesterov momentum

bool

weight_decay

1e-05

Weight decay regularization to use

float

default_decay

True

Whether to decay module params which aren’t explicitly specified

bool