Optimizers
==========

.. toctree::
    :maxdepth: 2
    :caption: Contents:

    registry.optimizers.adam
    registry.optimizers.adan
    registry.optimizers.gan
    registry.optimizers.gpt-3-large
    registry.optimizers.gpt-3-medium
    registry.optimizers.gpt-3-small
    registry.optimizers.lion
    registry.optimizers.lion-stable
    registry.optimizers.roberta-base
    registry.optimizers.roberta-large
    registry.optimizers.sgd
    registry.optimizers.shampoo