adan

Fields

Field	Default	Description	Type
name	???	The referenced name of the object to construct	str
lr	0.001	Learning rate	float
betas	(0.1, 0.1, 0.001)	Beta coefficients	tuple[float, float, float]
eps	0.0001	Epsilon term	float
weight_decay	1e-05	Weight decay regularization to use	float
default_decay	True	Whether to decay module params which aren’t explicitly specified	bool