lion-stable

Fields

Field	Default	Description	Type
name	???	The referenced name of the object to construct	str
lr	0.0001	Learning rate.	float
betas	(0.95, 0.98)	Beta coefficients.	tuple[float, float]
weight_decay	0.01	Weight decay.	float
default_decay	True	Whether to decay module params which aren’t explicitly specified	bool
use_triton	True	Whether to use Triton for faster updates.	bool