thetechdude124/Adam-Optimization-From-Scratch

📈Implementing the ADAM optimizer from the ground up with PyTorch and comparing its performance on six 3-D objective functions (each progressively more difficult to optimize) against SGD, AdaGrad, and RMSProp.

21
/ 100
Experimental

No commits in the last 6 months.

No License Stale 6m No Package No Dependents
Maintenance 0 / 25
Adoption 6 / 25
Maturity 1 / 25
Community 14 / 25

How are scores calculated?

Stars

22

Forks

4

Language

Jupyter Notebook

License

—

Category

gradient-descent-optimizers

Last pushed

Jul 02, 2022

Commits (30d)

0

GitHub
Gradient Descent Optimizers · 67 frameworks

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/thetechdude124/Adam-Optimization-From-Scratch"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

metaopt/torchopt

TorchOpt is an efficient library for differentiable optimization built upon PyTorch.

68

SimplexLab/TorchJD

Library for Jacobian descent with PyTorch. It enables the optimization of neural networks with...

65

clovaai/AdamP

AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights (ICLR 2021)

62

nschaetti/EchoTorch

A Python toolkit for Reservoir Computing and Echo State Network experimentation based on...

60

gpauloski/kfac-pytorch

Distributed K-FAC preconditioner for PyTorch

58

Explore ML Frameworks

All categories Trending ML Framework directory Insights