Development of hyper efficient optimizers that can match/exceed AdamW, while using reduced memory
l
hyper_efficient_optimizers
public
5 stars
1 forks
1 issues
Commits
List of commits on branch main.Verified
45fd3be14cb5e23697b8370f6c9caec7e8618f19Create AdaNorm.py
llessw2020 committed 8 months ago
Verified
a2b0baa3d594eb4bb7d61219cdb745e149ec9aaaCreate adaplus.py
llessw2020 committed 9 months ago
Verified
0e4acf8a5f7bb7246ab16cced0f7b202abe19c8fCreate readme.md
llessw2020 committed 9 months ago
Verified
4dbf152671241ce0d37afed2c6daa6b76073f593Create readme.md
llessw2020 committed 9 months ago
Verified
2593033d111c452550f4a9e618f9a0a6a16d3dbaCreate fourbit_functional.py
llessw2020 committed 9 months ago
Verified
c44b4754a50e181832a981e9dd83912ed0ee0e70Create fourbit_adamw.py
llessw2020 committed 9 months ago