huggingface / lm-evaluation-harness
File Change Frequency

File change frequency (churn) shows the distribution of file updates (days with at least one commit).

Overview
File Change Frequency Overall
  • There are 3,012 files with 51,606 lines of code.
    • 6 files changed more than 100 times (3,465 lines of code)
    • 6 files changed 51-100 times (1,132 lines of code)
    • 37 files changed 21-50 times (2,456 lines of code)
    • 1,013 files changed 6-20 times (15,861 lines of code)
    • 1,950 files changed 1-5 times (28,692 lines of code)
6% | 2% | 4% | 30% | 55%
Legend:
101+
51-100
21-50
6-20
1-5

explore: grouped by folders | grouped by update frequency | data
Contributors Count Frequency Overall
  • There are 3,012 files with 51,606 lines of code.
    • 8 files changed by more than 25 contributors (3,563 lines of code)
    • 36 files changed by 11-25 contributors (3,487 lines of code)
    • 207 files changed by 6-10 contributors (9,772 lines of code)
    • 2,257 files changed by 2-5 contributors (31,080 lines of code)
    • 504 files changed by 1 contributor (3,704 lines of code)
6% | 6% | 18% | 60% | 7%
Legend:
26+
11-25
6-10
2-5
1

explore: grouped by folders | grouped by contributors count | data
File Change Frequency per File Extension
yaml, json, py, md, pkl, txt, sh, ipynb, cpp, ini, gitignore, toml, bib
File Change Frequency per Extension
The number of recorded file updates
101+
51-100
21-50
6-20
1-5
py15% | 4% | 8% | 28% | 43%
toml0% | 100% | 0% | 0% | 0%
yaml0% | 0% | 1% | 32% | 65%
cpp0% | 0% | 0% | 100% | 0%
bib0% | 0% | 0% | 0% | 100%
File Change Frequency per Logical Decomposition
primary
primary (file change frequency)
The number of recorded file updates
101+
51-100
21-50
6-20
1-5
lm_eval6% | 1% | 4% | 29% | 56%
ROOT1% | 89% | 0% | 0% | 9%
scripts0% | 5% | 5% | 70% | 18%
templates0% | 0% | 0% | 0% | 100%
Most Frequently Changed Files (Top 50)

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
__init__.py
in lm_eval/tasks
 471 34 2020-09-07 2024-10-29 205 69 email@jasonphang.com nathan.habib19@gmail.com
evaluator.py
in lm_eval
 466 4 2021-02-04 2024-10-29 185 50 pfarrington@gmail.com nathan.habib19@gmail.com
task.py
in lm_eval/api
 1218 79 2023-04-19 2024-10-29 154 28 hailey.schoelkopf@yale.edu nathan.habib19@gmail.com
huggingface.py
in lm_eval/models
 1037 35 2023-01-17 2024-10-31 147 45 hailey.schoelkopf@yale.edu nathan.habib@huggingface.co
utils.py
in lm_eval
 271 32 2020-09-07 2024-10-29 142 47 email@jasonphang.com nathan.habib19@gmail.com
setup.py
in root
 2 - 2021-02-01 2023-12-20 108 40 leogao31@gmail.com 92168766+baberabb@users.nor...
model.py
in lm_eval/api
 183 26 2023-04-19 2024-10-29 61 20 hailey.schoelkopf@yale.edu nathan.habib19@gmail.com
__init__.py
in lm_eval/models
 20 - 2020-09-07 2024-04-16 60 29 email@jasonphang.com michael@neuralmagic.com
__main__.py
in lm_eval
 401 6 2023-10-04 2024-10-31 54 22 hailey@eleuther.ai 30601243+nathanhb@users.nor...
write_out.py
in scripts
 78 2 2021-02-05 2024-06-27 52 33 jeffhsu3@gmail.com nathan.habib@huggingface.co
98 - 2023-08-25 2025-02-14 52 24 ethan@ethanhs.me kydlicek.hynek@gmail.com
metrics.py
in lm_eval/api
 352 44 2023-04-19 2024-10-29 51 14 hailey.schoelkopf@yale.edu nathan.habib19@gmail.com
dummy.py
in lm_eval/models
 27 5 2020-09-07 2024-10-31 50 23 email@jasonphang.com 30601243+nathanhb@users.nor...
openai_completions.py
in lm_eval/models
 342 24 2023-06-12 2024-05-05 48 24 65563625+haileyschoelkopf@u... djstrong@gmail.com
anthropic_llms.py
in lm_eval/models
 238 23 2023-06-08 2024-06-27 45 17 jasonphang@nyu.edu nathan.habib@huggingface.co
samplers.py
in lm_eval/api
 117 8 2023-04-19 2024-10-29 40 18 hailey.schoelkopf@yale.edu nathan.habib19@gmail.com
vllm_causallms.py
in lm_eval/models
 412 18 2023-11-21 2024-10-29 38 14 92168766+baberabb@users.nor... nathan.habib19@gmail.com
t5-prompt.yaml
in lm_eval/tasks/super_glue/wsc
 20 - 2023-05-15 2024-10-29 37 11 lintang@sutawika.com nathan.habib19@gmail.com
textsynth.py
in lm_eval/models
 108 14 2022-11-04 2024-06-27 35 18 41410219+jon-tow@users.nore... nathan.habib@huggingface.co
registry.py
in lm_eval/api
 140 12 2023-06-07 2024-04-26 35 12 lintang@sutawika.com nikitml@gmail.com
extraction.py
in lm_eval/filters
 122 6 2023-04-19 2024-07-15 34 16 hailey.schoelkopf@yale.edu lintang@eleuther.ai
__init__.py
in lm_eval/filters
 15 1 2023-04-19 2024-04-26 33 14 hailey.schoelkopf@yale.edu nikitml@gmail.com
gsm8k.yaml
in lm_eval/tasks/gsm8k
 45 - 2023-06-08 2024-10-29 31 11 lintang@sutawika.com nathan.habib19@gmail.com
arc_easy.yaml
in lm_eval/tasks/arc
 23 - 2023-05-13 2024-10-29 30 14 lintang@sutawika.com nathan.habib19@gmail.com
__init__.py
in lm_eval/prompts
 89 4 2023-04-19 2024-02-26 30 10 hailey.schoelkopf@yale.edu lsinev@users.noreply.github...
t5-prompt.yaml
in lm_eval/tasks/super_glue/record
 22 - 2023-05-15 2024-10-29 29 11 lintang@sutawika.com nathan.habib19@gmail.com
piqa.yaml
in lm_eval/tasks/piqa
 23 - 2023-06-02 2024-06-27 28 12 hailey.schoelkopf@yale.edu nathan.habib@huggingface.co
t5-prompt.yaml
in lm_eval/tasks/super_glue/cb
 25 - 2023-05-15 2024-10-29 28 11 lintang@sutawika.com nathan.habib19@gmail.com
gsm8k-cot.yaml
in lm_eval/tasks/gsm8k
 82 - 2023-06-08 2024-10-29 28 13 lintang@sutawika.com nathan.habib19@gmail.com
t5-prompt.yaml
in lm_eval/tasks/super_glue/copa
 22 - 2023-05-15 2024-10-29 27 11 lintang@sutawika.com nathan.habib19@gmail.com
seq2seq.yaml
in lm_eval/tasks/super_glue/boolq
 26 - 2023-06-22 2024-10-29 27 12 lintang@sutawika.com nathan.habib19@gmail.com
72 6 2021-02-14 2024-03-06 26 18 leogao31@gmail.com lsinev@users.noreply.github...
wikitext.yaml
in lm_eval/tasks/wikitext
 20 - 2023-06-02 2024-03-03 25 11 hailey.schoelkopf@yale.edu vicki@mozilla.ai
sciq.yaml
in lm_eval/tasks/sciq
 21 - 2023-06-02 2023-12-21 25 10 hailey.schoelkopf@yale.edu 65563625+haileyschoelkopf@u...
lambada_openai.yaml
in lm_eval/tasks/lambada
 22 - 2023-06-02 2024-10-29 23 13 hailey.schoelkopf@yale.edu nathan.habib19@gmail.com
hellaswag.yaml
in lm_eval/tasks/hellaswag
 24 - 2023-06-20 2024-10-29 23 13 54780682+nikuya3@users.nore... nathan.habib19@gmail.com
instance.py
in lm_eval/api
 26 2 2023-04-19 2024-03-06 23 10 hailey.schoelkopf@yale.edu lsinev@users.noreply.github...
metric.py
in lm_eval/tasks/realtoxicityprompts
 67 1 2023-08-03 2024-04-18 23 9 lintang@sutawika.com 129434630+sator-labs@users....
arc_challenge.yaml
in lm_eval/tasks/arc
 3 - 2023-05-13 2023-08-29 22 10 lintang@sutawika.com lintang@sutawika.com
preprocess_pubmedqa.py
in lm_eval/tasks/pubmedqa
 6 1 2023-06-30 2023-12-20 22 8 ben.fattori@mail.utoronto.ca 92168766+baberabb@users.nor...
lambada_openai_cloze.yaml
in lm_eval/tasks/lambada_cloze
 20 - 2023-06-02 2024-10-29 22 12 hailey.schoelkopf@yale.edu nathan.habib19@gmail.com
lambada_standard.yaml
in lm_eval/tasks/lambada
 21 - 2023-06-02 2024-10-29 22 12 hailey.schoelkopf@yale.edu nathan.habib19@gmail.com
t5-prompt.yaml
in lm_eval/tasks/super_glue/boolq
 22 - 2023-08-07 2024-10-29 22 8 lintang@sutawika.com nathan.habib19@gmail.com
_generate_configs.py
in lm_eval/tasks/mmlu
 134 1 2023-09-03 2024-10-29 22 8 lintang@sutawika.com nathan.habib19@gmail.com
pubmedqa.yaml
in lm_eval/tasks/pubmedqa
 16 - 2023-06-29 2023-12-21 21 8 ben.fattori@mail.utoronto.ca 65563625+haileyschoelkopf@u...
default.yaml
in lm_eval/tasks/super_glue/boolq
 17 - 2023-06-07 2024-10-29 21 13 lintang@sutawika.com nathan.habib19@gmail.com
t5-prompt.yaml
in lm_eval/tasks/super_glue/wic
 22 - 2023-08-07 2024-10-29 21 8 lintang@sutawika.com nathan.habib19@gmail.com
t5-prompt.yaml
in lm_eval/tasks/super_glue/rte
 22 - 2023-08-07 2024-10-29 21 8 lintang@sutawika.com nathan.habib19@gmail.com
t5-prompt.yaml
in lm_eval/tasks/super_glue/multirc
 23 - 2023-08-07 2024-10-29 21 8 lintang@sutawika.com nathan.habib19@gmail.com
default.yaml
in lm_eval/tasks/super_glue/cb
 17 - 2023-06-07 2024-10-29 20 13 lintang@sutawika.com nathan.habib19@gmail.com
Files With Most Contributors (Top 50)
Based on the number of unique email addresses found in commits.

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
__init__.py
in lm_eval/tasks
 471 34 2020-09-07 2024-10-29 205 69 email@jasonphang.com nathan.habib19@gmail.com
evaluator.py
in lm_eval
 466 4 2021-02-04 2024-10-29 185 50 pfarrington@gmail.com nathan.habib19@gmail.com
utils.py
in lm_eval
 271 32 2020-09-07 2024-10-29 142 47 email@jasonphang.com nathan.habib19@gmail.com
huggingface.py
in lm_eval/models
 1037 35 2023-01-17 2024-10-31 147 45 hailey.schoelkopf@yale.edu nathan.habib@huggingface.co
setup.py
in root
 2 - 2021-02-01 2023-12-20 108 40 leogao31@gmail.com 92168766+baberabb@users.nor...
write_out.py
in scripts
 78 2 2021-02-05 2024-06-27 52 33 jeffhsu3@gmail.com nathan.habib@huggingface.co
__init__.py
in lm_eval/models
 20 - 2020-09-07 2024-04-16 60 29 email@jasonphang.com michael@neuralmagic.com
task.py
in lm_eval/api
 1218 79 2023-04-19 2024-10-29 154 28 hailey.schoelkopf@yale.edu nathan.habib19@gmail.com
98 - 2023-08-25 2025-02-14 52 24 ethan@ethanhs.me kydlicek.hynek@gmail.com
openai_completions.py
in lm_eval/models
 342 24 2023-06-12 2024-05-05 48 24 65563625+haileyschoelkopf@u... djstrong@gmail.com
dummy.py
in lm_eval/models
 27 5 2020-09-07 2024-10-31 50 23 email@jasonphang.com 30601243+nathanhb@users.nor...
__main__.py
in lm_eval
 401 6 2023-10-04 2024-10-31 54 22 hailey@eleuther.ai 30601243+nathanhb@users.nor...
model.py
in lm_eval/api
 183 26 2023-04-19 2024-10-29 61 20 hailey.schoelkopf@yale.edu nathan.habib19@gmail.com
samplers.py
in lm_eval/api
 117 8 2023-04-19 2024-10-29 40 18 hailey.schoelkopf@yale.edu nathan.habib19@gmail.com
textsynth.py
in lm_eval/models
 108 14 2022-11-04 2024-06-27 35 18 41410219+jon-tow@users.nore... nathan.habib@huggingface.co
72 6 2021-02-14 2024-03-06 26 18 leogao31@gmail.com lsinev@users.noreply.github...
anthropic_llms.py
in lm_eval/models
 238 23 2023-06-08 2024-06-27 45 17 jasonphang@nyu.edu nathan.habib@huggingface.co
extraction.py
in lm_eval/filters
 122 6 2023-04-19 2024-07-15 34 16 hailey.schoelkopf@yale.edu lintang@eleuther.ai
metrics.py
in lm_eval/api
 352 44 2023-04-19 2024-10-29 51 14 hailey.schoelkopf@yale.edu nathan.habib19@gmail.com
vllm_causallms.py
in lm_eval/models
 412 18 2023-11-21 2024-10-29 38 14 92168766+baberabb@users.nor... nathan.habib19@gmail.com
__init__.py
in lm_eval/filters
 15 1 2023-04-19 2024-04-26 33 14 hailey.schoelkopf@yale.edu nikitml@gmail.com
arc_easy.yaml
in lm_eval/tasks/arc
 23 - 2023-05-13 2024-10-29 30 14 lintang@sutawika.com nathan.habib19@gmail.com
gsm8k-cot.yaml
in lm_eval/tasks/gsm8k
 82 - 2023-06-08 2024-10-29 28 13 lintang@sutawika.com nathan.habib19@gmail.com
hellaswag.yaml
in lm_eval/tasks/hellaswag
 24 - 2023-06-20 2024-10-29 23 13 54780682+nikuya3@users.nore... nathan.habib19@gmail.com
lambada_openai.yaml
in lm_eval/tasks/lambada
 22 - 2023-06-02 2024-10-29 23 13 hailey.schoelkopf@yale.edu nathan.habib19@gmail.com
default.yaml
in lm_eval/tasks/super_glue/boolq
 17 - 2023-06-07 2024-10-29 21 13 lintang@sutawika.com nathan.habib19@gmail.com
default.yaml
in lm_eval/tasks/super_glue/cb
 17 - 2023-06-07 2024-10-29 20 13 lintang@sutawika.com nathan.habib19@gmail.com
registry.py
in lm_eval/api
 140 12 2023-06-07 2024-04-26 35 12 lintang@sutawika.com nikitml@gmail.com
piqa.yaml
in lm_eval/tasks/piqa
 23 - 2023-06-02 2024-06-27 28 12 hailey.schoelkopf@yale.edu nathan.habib@huggingface.co
seq2seq.yaml
in lm_eval/tasks/super_glue/boolq
 26 - 2023-06-22 2024-10-29 27 12 lintang@sutawika.com nathan.habib19@gmail.com
lambada_openai_cloze.yaml
in lm_eval/tasks/lambada_cloze
 20 - 2023-06-02 2024-10-29 22 12 hailey.schoelkopf@yale.edu nathan.habib19@gmail.com
lambada_standard.yaml
in lm_eval/tasks/lambada
 21 - 2023-06-02 2024-10-29 22 12 hailey.schoelkopf@yale.edu nathan.habib19@gmail.com
janitor.py
in lm_eval/decontamination
 119 15 2022-03-03 2023-12-20 18 12 32028883+researcher2@users.... 92168766+baberabb@users.nor...
decontaminate.py
in lm_eval/decontamination
 115 2 2022-03-03 2024-01-28 13 12 32028883+researcher2@users.... lsinev@users.noreply.github...
t5-prompt.yaml
in lm_eval/tasks/super_glue/wsc
 20 - 2023-05-15 2024-10-29 37 11 lintang@sutawika.com nathan.habib19@gmail.com
gsm8k.yaml
in lm_eval/tasks/gsm8k
 45 - 2023-06-08 2024-10-29 31 11 lintang@sutawika.com nathan.habib19@gmail.com
t5-prompt.yaml
in lm_eval/tasks/super_glue/record
 22 - 2023-05-15 2024-10-29 29 11 lintang@sutawika.com nathan.habib19@gmail.com
t5-prompt.yaml
in lm_eval/tasks/super_glue/cb
 25 - 2023-05-15 2024-10-29 28 11 lintang@sutawika.com nathan.habib19@gmail.com
t5-prompt.yaml
in lm_eval/tasks/super_glue/copa
 22 - 2023-05-15 2024-10-29 27 11 lintang@sutawika.com nathan.habib19@gmail.com
wikitext.yaml
in lm_eval/tasks/wikitext
 20 - 2023-06-02 2024-03-03 25 11 hailey.schoelkopf@yale.edu vicki@mozilla.ai
pile_arxiv.yaml
in lm_eval/tasks/pile
 21 - 2023-06-02 2024-10-29 20 11 hailey.schoelkopf@yale.edu nathan.habib19@gmail.com
lambada_standard_cloze.yaml
in lm_eval/tasks/lambada_cloze
 21 - 2023-06-02 2024-10-29 19 11 hailey.schoelkopf@yale.edu nathan.habib19@gmail.com
qa4mre_2011.yaml
in lm_eval/tasks/qa4mre
 21 - 2023-07-01 2024-10-29 18 11 farzanehnakhaee70@gmail.com nathan.habib19@gmail.com
archiver.py
in lm_eval/decontamination
 134 16 2022-03-03 2024-01-28 13 11 32028883+researcher2@users.... lsinev@users.noreply.github...
__init__.py
in lm_eval/prompts
 89 4 2023-04-19 2024-02-26 30 10 hailey.schoelkopf@yale.edu lsinev@users.noreply.github...
sciq.yaml
in lm_eval/tasks/sciq
 21 - 2023-06-02 2023-12-21 25 10 hailey.schoelkopf@yale.edu 65563625+haileyschoelkopf@u...
instance.py
in lm_eval/api
 26 2 2023-04-19 2024-03-06 23 10 hailey.schoelkopf@yale.edu lsinev@users.noreply.github...
arc_challenge.yaml
in lm_eval/tasks/arc
 3 - 2023-05-13 2023-08-29 22 10 lintang@sutawika.com lintang@sutawika.com
cycle_letters.yaml
in lm_eval/tasks/unscramble
 22 - 2023-07-05 2024-10-29 20 10 hailey@eleuther.ai nathan.habib19@gmail.com
random_insertion.yaml
in lm_eval/tasks/unscramble
 22 - 2023-07-05 2024-10-29 20 10 hailey@eleuther.ai nathan.habib19@gmail.com
Files With Least Contributors (Top 50)
Based on the number of unique email addresses found in commits.

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
neuralmagic.py
in lm_eval/models
 292 16 2024-04-16 2024-04-16 1 1 michael@neuralmagic.com michael@neuralmagic.com
wandb_logger.py
in lm_eval/loggers
 254 11 2024-05-26 2024-05-26 1 1 65563625+haileyschoelkopf@u... 65563625+haileyschoelkopf@u...
utils.py
in lm_eval/tasks/ifeval
 110 4 2023-12-17 2023-12-17 1 1 wkojohnj@gmail.com wkojohnj@gmail.com
utils.py
in lm_eval/tasks/french_bench
 63 9 2024-03-04 2024-03-04 1 1 43467008+manuelfay@users.no... 43467008+manuelfay@users.no...
62 1 2024-02-26 2024-02-26 1 1 inf3rnus@users.noreply.gith... inf3rnus@users.noreply.gith...
utils.py
in lm_eval/tasks/basqueglue
 59 6 2024-04-01 2024-04-01 1 1 juletxara@gmail.com juletxara@gmail.com
configs.py
in lm_eval/tasks/eus_exams
 48 2 2024-04-01 2024-04-01 1 1 juletxara@gmail.com juletxara@gmail.com
tinyGSM8k.yaml
in lm_eval/tasks/tinyBenchmarks
 44 - 2024-05-13 2024-05-13 1 1 35227161+lucweber@users.nor... 35227161+lucweber@users.nor...
agg_functions.py
in lm_eval/tasks/tinyBenchmarks
 37 7 2024-05-13 2024-05-13 1 1 35227161+lucweber@users.nor... 35227161+lucweber@users.nor...
preprocess_wikitext.py
in lm_eval/tasks/french_bench
 37 2 2024-03-04 2024-03-04 1 1 43467008+manuelfay@users.no... 43467008+manuelfay@users.no...
utils.py
in lm_eval/tasks/eq_bench
 36 1 2024-03-06 2024-03-06 1 1 peterbevan@hotmail.co.uk peterbevan@hotmail.co.uk
tinyTruthfulQA_mc1.yaml
in lm_eval/tasks/tinyBenchmarks
 34 - 2024-05-13 2024-05-13 1 1 35227161+lucweber@users.nor... 35227161+lucweber@users.nor...
cache.py
in lm_eval/caching
 32 3 2024-02-26 2024-02-26 1 1 inf3rnus@users.noreply.gith... inf3rnus@users.noreply.gith...
utils.py
in lm_eval/tasks/gpqa/cot_zeroshot
 31 2 2024-03-05 2024-03-05 1 1 92366232+uanu2002@users.nor... 92366232+uanu2002@users.nor...
utils.py
in lm_eval/tasks/gpqa/cot_n_shot
 31 2 2024-03-05 2024-03-05 1 1 92366232+uanu2002@users.nor... 92366232+uanu2002@users.nor...
utils.py
in lm_eval/tasks/gpqa/generative
 31 2 2024-03-05 2024-03-05 1 1 92366232+uanu2002@users.nor... 92366232+uanu2002@users.nor...
noticia.yaml
in lm_eval/tasks/noticia
 29 - 2024-06-06 2024-06-06 1 1 i.garciaferrerosanpelayo@gm... i.garciaferrerosanpelayo@gm...
arc_challenge_mt_is.yaml
in lm_eval/tasks/arc_mt
 22 - 2024-06-25 2024-06-25 1 1 135807120+jonabur@users.nor... 135807120+jonabur@users.nor...
_generate_configs.py
in lm_eval/tasks/gpqa/cot_zeroshot
 22 1 2024-03-05 2024-03-05 1 1 92366232+uanu2002@users.nor... 92366232+uanu2002@users.nor...
_generate_configs.py
in lm_eval/tasks/gpqa/cot_n_shot
 22 1 2024-03-05 2024-03-05 1 1 92366232+uanu2002@users.nor... 92366232+uanu2002@users.nor...
_generate_configs.py
in lm_eval/tasks/gpqa/generative
 22 1 2024-03-05 2024-03-05 1 1 92366232+uanu2002@users.nor... 92366232+uanu2002@users.nor...
utils.py
in lm_eval/tasks/noticia
 21 5 2024-06-06 2024-06-06 1 1 i.garciaferrerosanpelayo@gm... i.garciaferrerosanpelayo@gm...
copa_ar.yaml
in lm_eval/tasks/alghafa/copa_ar
 21 - 2024-06-10 2024-06-10 1 1 90086758+khalil-hennara@use... 90086758+khalil-hennara@use...
piqa_ar.yaml
in lm_eval/tasks/alghafa/piqa_ar
 21 - 2024-06-10 2024-06-10 1 1 90086758+khalil-hennara@use... 90086758+khalil-hennara@use...
21 - 2024-06-06 2024-06-06 1 1 106973776+morisht@users.nor... 106973776+morisht@users.nor...
default.yaml
in lm_eval/tasks/eq_bench
 20 - 2024-03-06 2024-03-06 1 1 peterbevan@hotmail.co.uk peterbevan@hotmail.co.uk
lambada_mt_stablelm_en.yaml
in lm_eval/tasks/lambada_multilingual_stablelm
 20 - 2024-06-06 2024-06-06 1 1 zafir.stojanovski@icloud.com zafir.stojanovski@icloud.com
tinyMMLU.yaml
in lm_eval/tasks/tinyBenchmarks
 19 - 2024-05-13 2024-05-13 1 1 35227161+lucweber@users.nor... 35227161+lucweber@users.nor...
tinyArc.yaml
in lm_eval/tasks/tinyBenchmarks
 19 - 2024-05-13 2024-05-13 1 1 35227161+lucweber@users.nor... 35227161+lucweber@users.nor...
pile_10k.yaml
in lm_eval/tasks/pile_10k
 19 - 2024-05-01 2024-05-01 1 1 gabrielmukobi@gmail.com gabrielmukobi@gmail.com
medmcqa.yaml
in lm_eval/tasks/medmcqa
 18 - 2024-01-11 2024-01-11 1 1 37097934+tmabraham@users.no... 37097934+tmabraham@users.no...
openllm.yaml
in lm_eval/tasks/benchmarks
 18 - 2024-03-05 2024-03-05 1 1 92168766+baberabb@users.nor... 92168766+baberabb@users.nor...
utils_hellaswag.py
in lm_eval/tasks/tinyBenchmarks
 18 2 2024-05-13 2024-05-13 1 1 35227161+lucweber@users.nor... 35227161+lucweber@users.nor...
tinyWinogrande.yaml
in lm_eval/tasks/tinyBenchmarks
 18 - 2024-05-13 2024-05-13 1 1 35227161+lucweber@users.nor... 35227161+lucweber@users.nor...
tinyHellaswag.yaml
in lm_eval/tasks/tinyBenchmarks
 18 - 2024-05-13 2024-05-13 1 1 35227161+lucweber@users.nor... 35227161+lucweber@users.nor...
utils.py
in lm_eval/tasks/eus_reading
 17 2 2024-04-01 2024-04-01 1 1 juletxara@gmail.com juletxara@gmail.com
utils.py
in lm_eval/tasks/eus_trivia
 17 2 2024-04-01 2024-04-01 1 1 juletxara@gmail.com juletxara@gmail.com
medqa.yaml
in lm_eval/tasks/medqa
 16 - 2024-01-11 2024-01-11 1 1 37097934+tmabraham@users.no... 37097934+tmabraham@users.no...
eus_reading.yaml
in lm_eval/tasks/eus_reading
 16 - 2024-04-01 2024-04-01 1 1 juletxara@gmail.com juletxara@gmail.com
tinyBenchmarks.yaml
in lm_eval/tasks/tinyBenchmarks
 16 - 2024-05-13 2024-05-13 1 1 35227161+lucweber@users.nor... 35227161+lucweber@users.nor...
eus_trivia.yaml
in lm_eval/tasks/eus_trivia
 16 - 2024-04-01 2024-04-01 1 1 juletxara@gmail.com juletxara@gmail.com
eus_proficiency.yaml
in lm_eval/tasks/eus_proficiency
 16 - 2024-04-01 2024-04-01 1 1 juletxara@gmail.com juletxara@gmail.com
glianorex_fr.yaml
in lm_eval/tasks/glianorex
 15 - 2024-06-05 2024-06-05 1 1 672982+maximegmd@users.nore... 672982+maximegmd@users.nore...
glianorex_en.yaml
in lm_eval/tasks/glianorex
 15 - 2024-06-05 2024-06-05 1 1 672982+maximegmd@users.nore... 672982+maximegmd@users.nore...
utils.py
in lm_eval/tasks/copal_id
 15 3 2024-05-09 2024-05-09 1 1 68678137+erland366@users.no... 68678137+erland366@users.no...
glianorex.yaml
in lm_eval/tasks/glianorex
 14 - 2024-06-05 2024-06-05 1 1 672982+maximegmd@users.nore... 672982+maximegmd@users.nore...
tinyTruthfulQA_mc2.yaml
in lm_eval/tasks/tinyBenchmarks
 13 - 2024-05-13 2024-05-13 1 1 35227161+lucweber@users.nor... 35227161+lucweber@users.nor...
preprocess_glianorex.py
in lm_eval/tasks/glianorex
 13 5 2024-06-05 2024-06-05 1 1 672982+maximegmd@users.nore... 672982+maximegmd@users.nore...
default.yaml
in lm_eval/tasks/commonsense_qa
 12 - 2024-06-25 2024-06-25 1 1 bmurphy592@gmail.com bmurphy592@gmail.com
utils.py
in lm_eval/tasks/tmmluplus/default
 11 1 2024-04-05 2024-04-05 1 1 zonetwelve159@gmail.com zonetwelve159@gmail.com