adan
====


.. list-table:: Fields
    :widths: 20 20 40 20
    :header-rows: 1

    * - Field
      - Default
      - Description
      - Type

    * - name
      - ???
      - The referenced name of the object to construct
      - str

    * - lr
      - 0.001
      - Learning rate
      - float

    * - betas
      - (0.1, 0.1, 0.001)
      - Beta coefficients
      - tuple[float, float, float]

    * - eps
      - 0.0001
      - Epsilon term
      - float

    * - weight_decay
      - 1e-05
      - Weight decay regularization to use
      - float

    * - default_decay
      - True
      - Whether to decay module params which aren't explicitly specified
      - bool