Skip to content

fix the default learning rate in prodigy - #740

Merged
copybara-service[bot] merged 2 commits into
google-deepmind:mainfrom
konstmish:main
Feb 1, 2024
Merged

fix the default learning rate in prodigy#740
copybara-service[bot] merged 2 commits into
google-deepmind:mainfrom
konstmish:main

Conversation

@konstmish

Copy link
Copy Markdown
Contributor

fixing the current version of Prodigy that has a typo: the learning was set to 0.1 instead of 1.0

@fabianp

fabianp commented Jan 28, 2024

Copy link
Copy Markdown
Member

Thanks Konstantin! The changes look good to me.

The tests are failing, seems to me for unrelated reasons .... i'm looking into it

@fabianp fabianp left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Konstantin!

@vroulet

vroulet commented Jan 28, 2024

Copy link
Copy Markdown
Collaborator

Thanks @konstmish! The prodigy test fails with this default learning rate. To fix this, it suffices to change the test for the algorithm to run for 100 000 iterations instead of 10 000 iterations. Could you take care of it in this PR? Thanks!

@fabianp

fabianp commented Jan 29, 2024

Copy link
Copy Markdown
Member

There seems to be anyway something wrong with the CI. Everything is failing with an obscure ==== ERROR ../::tmp - PermissionError: [Errno 13] Permission denied: '/tmp/snap-private-tmp/__init__.py'

@fabianp

fabianp commented Jan 29, 2024

Copy link
Copy Markdown
Member

seems its a problem with the most recent release of pytest. Downgrading it seemed to solve the issue: #743

@fabianp

fabianp commented Jan 29, 2024

Copy link
Copy Markdown
Member

should be fixed now in main (2e69e7f). Please update this branch and 🤞🏼

@copybara-service
copybara-service Bot merged commit def75e9 into google-deepmind:main Feb 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants