lion-stable
===========


.. list-table:: Fields
    :widths: 20 20 40 20
    :header-rows: 1

    * - Field
      - Default
      - Description
      - Type

    * - name
      - ???
      - The referenced name of the object to construct
      - str

    * - lr
      - 0.0001
      - Learning rate.
      - float

    * - betas
      - (0.95, 0.98)
      - Beta coefficients.
      - tuple[float, float]

    * - weight_decay
      - 0.01
      - Weight decay.
      - float

    * - default_decay
      - True
      - Whether to decay module params which aren't explicitly specified
      - bool

    * - use_triton
      - True
      - Whether to use Triton for faster updates.
      - bool