-
Notifications
You must be signed in to change notification settings - Fork 3.6k
Pull requests: EleutherAI/lm-evaluation-harness
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
fix: avoid passing None as add_special_tokens in TemplateAPI.tok_encode
#4129
opened Sep 10, 2026 by
pujitha24
Loading…
Fix exact_match batch scoring with an empty regex list
#4128
opened Sep 10, 2026 by
Doribelove
Loading…
feat: add FinProof Bench — BFSI adversarial guardrail benchmark (17 categories, RBI/SEBI/EU AI Act)
#4127
opened Sep 10, 2026 by
msrkrishna-ship-it
Loading…
fix(bbh): guard find_match against an all-empty capture tuple
#4125
opened Sep 9, 2026 by
vaibhavhariram
Loading…
fix(cache): invalidate requests when task configuration changes
#4123
opened Sep 9, 2026 by
Excelius-Wang
Loading…
feat(theoremqa): add TheoremQA text-only task
#4122
opened Sep 9, 2026 by
bongho
Contributor
Loading…
6 tasks done
fix(csatqa): load CSAT-QA without the removed dataset script
#4121
opened Sep 8, 2026 by
linhongyu510
Loading…
feat(econ_logic_qa): add EconLogicQA economic sequential-reasoning task
#4120
opened Sep 7, 2026 by
LangxiaoXie
Loading…
7 tasks done
fix(unitxt): rename the misspelled formated_source local to formatted_source
#4119
opened Sep 7, 2026 by
simpleqt
Loading…
docs(tasks): drop doubled 'and' in bibtex author lists
#4118
opened Sep 7, 2026 by
simpleqt
Loading…
docs(tasks): fix mmlu_redux README link and a duplicated word in NON_GREEDY
#4117
opened Sep 7, 2026 by
simpleqt
Loading…
docs(tasks): document the actual 'results' parameter in esbbq/cabbq aggregators
#4116
opened Sep 7, 2026 by
simpleqt
Loading…
Add regression tests for simple_evaluate() input validation (addresses #1883)
#4114
opened Sep 7, 2026 by
CJstate
Loading…
fix(tasks): define the missing --save_prefix_path argument in mmlusr config.py
#4110
opened Sep 6, 2026 by
simpleqt
Loading…
fix(tasks): fix three shell bugs in score/non_greedy.sh
#4109
opened Sep 6, 2026 by
simpleqt
Loading…
fix(okapi): preserve multilingual ARC question and choice content
#4106
opened Sep 5, 2026 by
Abdullah-m7
Loading…
Previous Next
ProTip!
Adding no:label will show everything without a label.