Skip to content

Make sure eval subset is sampled without replacing - #3651

Merged
shahules786 merged 1 commit into
mainfrom
fix_max_eval_sampling
Aug 14, 2023
Merged

Make sure eval subset is sampled without replacing#3651
shahules786 merged 1 commit into
mainfrom
fix_max_eval_sampling

Conversation

@andreaskoepf

Copy link
Copy Markdown
Collaborator

Explicitly specify replace=False for numpy.random.choice (it was missing and default is replace=True which could lead to duplicate examples in the evaluation set).

@shahules786 shahules786 left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice catch

@shahules786
shahules786 merged commit 90e442a into main Aug 14, 2023
@shahules786
shahules786 deleted the fix_max_eval_sampling branch August 14, 2023 10:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants