Skip to content

Added mathematical description to AdaBelief docstring - #869

Merged
copybara-service[bot] merged 2 commits into
google-deepmind:mainfrom
hmludwig:main
Mar 16, 2024
Merged

Added mathematical description to AdaBelief docstring#869
copybara-service[bot] merged 2 commits into
google-deepmind:mainfrom
hmludwig:main

Conversation

@hmludwig

Copy link
Copy Markdown
Contributor

I took the Adam docstring and adjusted it to match the implementation of AdaBelief.

The resulting doc entry
Screenshot 2024-03-15 at 18 07 29

@vroulet vroulet left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That's perfect (just a tiny typo and I'll approve).
Thank you very much @hmludwig. Having simple docstrings like that to understand the algorithm mathematically in a few seconds is really great, in particular to understand how they all differ. So thank you very much! (and your docs are extremely well detailed :).

Comment thread optax/_src/alias.py Outdated
@copybara-service
copybara-service Bot merged commit 46d6d0b into google-deepmind:main Mar 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants