kach/gradient-descent-the-ultimate-optimizer

Code for our NeurIPS 2022 paper

/ 100

Emerging

371 stars and 119 monthly downloads. No commits in the last 6 months. Available on PyPI.

Stale 6m No Dependents

Maintenance 0 / 25

Adoption 15 / 25

Maturity 18 / 25

Community 12 / 25

Stars

371

Forks

Language

Python

License

MIT

Category

Last pushed

Jan 13, 2023

Monthly downloads

119

Commits (30d)

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/kach/gradient-descent-the-ultimate-optimizer"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

metaopt/torchopt

TorchOpt is an efficient library for differentiable optimization built upon PyTorch.

SimplexLab/TorchJD

Library for Jacobian descent with PyTorch. It enables the optimization of neural networks with...

opthub-org/pytorch-bsf

PyTorch implementation of Bezier simplex fitting

pytorch/xla

Enabling PyTorch on XLA Devices (e.g. Google TPU)

clovaai/AdamP

AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights (ICLR 2021)