lion
Field |
Default |
Description |
Type |
|---|---|---|---|
name |
??? |
The referenced name of the object to construct |
str |
lr |
0.0001 |
Learning rate. |
float |
betas |
(0.9, 0.99) |
Beta coefficients. |
tuple[float, float] |
weight_decay |
0.01 |
Weight decay. |
float |
default_decay |
True |
Whether to decay module params which aren’t explicitly specified |
bool |
use_triton |
True |
Whether to use Triton for faster updates. |
bool |