openai/evals
File Age & Freshness
File age measurements show the distribution of file ages (days since the first commit) and the file freshness (days since the latest commit).
File Change History Overall
File Age Distribution Overall
Days since first update
  • There are 1,491 files with 41,260 lines of code in files.
    • 1,491 files that are 366+ days old (41,260 lines of code)
    • 0 files that are 181-365 days old (0 lines of code)
    • 0 files that are 91-180 days old (0 lines of code)
    • 0 files that are 31-90 days old (0 lines of code)
    • 0 files that are 1-30 days old (0 lines of code)
100% | 0% | 0% | 0% | 0%
Legend:
366+
181-365
91-180
31-90
1-30

explore: grouped by folders | grouped by age
File Freshness Distribution Overall
Days since last update
  • There are 1,491 files with 41,260 lines of code in files.
    • 1,490 files have been last changed 366+ days ago (41,228 lines of code)
    • 0 files have been last changed 181-365 days ago (0 lines of code)
    • 1 files have been last changed 91-180 days ago (32 lines of code)
    • 0 files have been last changed 31-90 days ago (0 lines of code)
    • 0 files have been last changed 1-30 days ago (0 lines of code)
99% | 0% | <1% | 0% | 0%
Legend:
366+
181-365
91-180
31-90
1-30

explore: grouped by folders | grouped by freshness
File Change History per File Extension
jsonl, yaml, py, txt, md, sh, json, gitignore, ipynb, gitattributes, html, js, yml, in, ini, toml
File Age Distribution per Extension
Days since first update
366+
181-365
91-180
31-90
1-30
py100% | 0% | 0% | 0% | 0%
yaml100% | 0% | 0% | 0% | 0%
jsonl100% | 0% | 0% | 0% | 0%
ipynb100% | 0% | 0% | 0% | 0%
html100% | 0% | 0% | 0% | 0%
js100% | 0% | 0% | 0% | 0%
in100% | 0% | 0% | 0% | 0%
File Freshness Distribution per Extension
Days since last update
366+
181-365
91-180
31-90
1-30
py100% | 0% | 0% | 0% | 0%
yaml99% | 0% | <1% | 0% | 0%
jsonl100% | 0% | 0% | 0% | 0%
ipynb100% | 0% | 0% | 0% | 0%
html100% | 0% | 0% | 0% | 0%
js100% | 0% | 0% | 0% | 0%
in100% | 0% | 0% | 0% | 0%
File Change History per Logical Decomposition
primary
primary (file age distribution)
Days since first update
366+
181-365
91-180
31-90
1-30
evals100% | 0% | 0% | 0% | 0%
scripts100% | 0% | 0% | 0% | 0%
.github100% | 0% | 0% | 0% | 0%
ROOT100% | 0% | 0% | 0% | 0%
primary (file freshness distribution)
Days since last update
366+
181-365
91-180
31-90
1-30
evals100% | 0% | 0% | 0% | 0%
scripts100% | 0% | 0% | 0% | 0%
.github100% | 0% | 0% | 0% | 0%
ROOT11% | 0% | 88% | 0% | 0%
Oldest Files (Top 50)
File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
reverse-string.yaml
in evals/registry/evals
 3 - 2023-03-14 2023-03-14 1 2 120423412+andrew-openai@use... logan@openai.com
jsonl
reverse_string.jsonl
in evals/registry/data/reverse_string
 3 - 2023-03-14 2023-03-14 1 2 120423412+andrew-openai@use... logan@openai.com
48 3 2023-03-15 2024-01-10 6 6 jasonwei@openai.com 140545726+ianmckenzie-oai@u...
7 - 2023-03-15 2023-03-17 2 2 omattos@gmail.com 120423412+andrew-openai@use...
cube-pack.yaml
in evals/registry/evals
 7 - 2023-03-15 2023-03-17 2 2 emil@radix.ai 120423412+andrew-openai@use...
pattern_identification.yaml
in evals/registry/evals
 7 - 2023-03-15 2023-03-16 2 2 jasonwei@openai.com 120423412+andrew-openai@use...
born-first.yaml
in evals/registry/evals
 3 - 2023-03-15 2023-03-17 2 2 njbbaer@gmail.com 120423412+andrew-openai@use...
jsonl
samples.jsonl
in evals/registry/data/map-electronic-component-part-to-fact
 3 - 2023-03-15 2023-03-17 2 2 omattos@gmail.com 120423412+andrew-openai@use...
jsonl
born_first.jsonl
in evals/registry/data/born_first
 3 - 2023-03-15 2023-03-17 2 2 njbbaer@gmail.com 120423412+andrew-openai@use...
jsonl
samples.v0.jsonl
in evals/registry/data/pattern_identification
 3 - 2023-03-15 2023-03-16 2 2 jasonwei@openai.com jasonwei@openai.com
jsonl
samples.jsonl
in evals/registry/data/cube-pack
 3 - 2023-03-15 2023-03-17 3 2 emil@radix.ai 120423412+andrew-openai@use...
record.py
in evals
 450 54 2023-03-16 2024-01-26 12 9 shane@openai.com 140545726+ianmckenzie-oai@u...
185 1 2023-03-16 2024-01-10 6 5 shane@openai.com 140545726+ianmckenzie-oai@u...
classify.py
in evals/elsuite/modelgraded
 97 3 2023-03-16 2023-09-26 19 7 shane@openai.com bomarni@googlemail.com
49 1 2023-03-16 2024-01-10 6 5 shane@openai.com 140545726+ianmckenzie-oai@u...
test-modelgraded-battle.yaml
in evals/registry/evals
 36 - 2023-03-16 2023-04-25 5 3 shane@openai.com 343165+rlbayes@users.norepl...
test-all.yaml
in evals/registry/eval_sets
 21 - 2023-03-16 2023-04-25 5 3 shane@openai.com 343165+rlbayes@users.norepl...
test-modelgraded-generated.yaml
in evals/registry/evals
 9 - 2023-03-16 2023-03-27 3 2 shane@openai.com 343165+rlbayes@users.norepl...
balance-chemical-equation.yaml
in evals/registry/evals
 7 - 2023-03-16 2023-03-17 2 2 scruelt@hotmail.com 120423412+andrew-openai@use...
chess-piece-count.yaml
in evals/registry/evals
 3 - 2023-03-16 2023-03-17 2 2 jatinparab98@gmail.com 120423412+andrew-openai@use...
jsonl
fuzzy_match.jsonl
in evals/registry/data/chess_piece_count
 3 - 2023-03-16 2023-03-17 2 2 jatinparab98@gmail.com 120423412+andrew-openai@use...
jsonl
samples.jsonl
in evals/registry/data/balance_chemical_equation
 3 - 2023-03-16 2023-05-21 3 2 scruelt@hotmail.com scruelt@hotmail.com
data.py
in evals
 148 21 2023-03-17 2024-04-03 9 10 343165+rlbayes@users.norepl... 150190178+josnyder-2@users....
coqa-ex.yaml
in evals/registry/evals
 55 - 2023-03-17 2023-04-25 4 3 343165+rlbayes@users.norepl... 343165+rlbayes@users.norepl...
test-modelgraded.yaml
in evals/registry/eval_sets
 14 - 2023-03-17 2023-04-06 3 2 343165+rlbayes@users.norepl... 343165+rlbayes@users.norepl...
coqa-ex.yaml
in evals/registry/eval_sets
 7 - 2023-03-17 2023-04-25 2 2 343165+rlbayes@users.norepl... 343165+rlbayes@users.norepl...
parse_yaml.py
in .github/workflows
 10 1 2023-03-18 2023-09-26 2 3 120423412+andrew-openai@use... bomarni@googlemail.com
oaieval.py
in evals/cli
 253 6 2023-03-19 2024-09-30 19 18 120423412+andrew-openai@use... steven@openai.com
api_utils.py
in evals/utils
 15 1 2023-03-19 2024-03-26 10 8 120423412+andrew-openai@use... oliver.jaffe@hotmail.co.uk
eval.py
in evals
 170 15 2023-03-20 2024-03-28 9 9 2406911+zhangmarvin@users.n... oliver.jaffe@hotmail.co.uk
registry.py
in evals
 242 27 2023-03-21 2024-03-28 22 17 343165+rlbayes@users.norepl... oliver.jaffe@hotmail.co.uk
oaievalset.py
in evals/cli
 111 8 2023-03-21 2024-01-10 5 4 343165+rlbayes@users.norepl... 140545726+ianmckenzie-oai@u...
test-modelgraded.yaml
in evals/registry/evals
 81 - 2023-03-21 2023-09-19 7 3 343165+rlbayes@users.norepl... 55913678+cholotook@users.no...
base.py
in evals
 51 1 2023-03-21 2023-09-26 5 4 343165+rlbayes@users.norepl... lukevanseters@gmail.com
anagrams.yaml
in evals/registry/evals
 10 - 2023-03-21 2023-03-21 1 1 97240159+l-mutricy@users.no... 97240159+l-mutricy@users.no...
best.yaml
in evals/registry/modelgraded
 10 - 2023-03-21 2023-09-19 4 2 343165+rlbayes@users.norepl... 55913678+cholotook@users.no...
test-comp-sci.yaml
in evals/registry/evals
 9 - 2023-03-21 2023-03-21 1 1 samennis127@gmail.com samennis127@gmail.com
convert-hex-hsl-lightness.yaml
in evals/registry/evals
 8 - 2023-03-21 2023-03-21 1 1 harley@hturan.com harley@hturan.com
complex-replace-characters.yaml
in evals/registry/evals
 8 - 2023-03-21 2023-03-21 1 1 petrgazarov@gmail.com petrgazarov@gmail.com
crepe.yaml
in evals/registry/evals
 7 - 2023-03-21 2023-03-21 1 1 46582003+seacowx@users.nore... 46582003+seacowx@users.nore...
aba-mrpc-true-false.yaml
in evals/registry/evals
 7 - 2023-03-21 2023-03-21 1 1 avery@offerfit.ai avery@offerfit.ai
lat_long_identify.yaml
in evals/registry/evals
 7 - 2023-03-21 2023-03-21 1 1 vishaal16119@iiitd.ac.in vishaal16119@iiitd.ac.in
determinant.yaml
in evals/registry/evals
 7 - 2023-03-21 2023-03-21 1 1 80975912+vitoraqdev@users.n... 80975912+vitoraqdev@users.n...
decrypt-caesar-cipher.yaml
in evals/registry/evals
 7 - 2023-03-21 2023-03-21 1 1 me@mattfalconer.com me@mattfalconer.com
bigrams.yaml
in evals/registry/evals
 7 - 2023-03-21 2023-03-21 1 1 oscar-king@users.noreply.gi... oscar-king@users.noreply.gi...
connect-4.yaml
in evals/registry/evals
 7 - 2023-03-21 2023-03-21 1 1 83553535+kierandon@users.no... 83553535+kierandon@users.no...
chess.yaml
in evals/registry/evals
 3 - 2023-03-21 2023-03-21 1 1 t.zehle@gmail.com t.zehle@gmail.com
last-word-nth.yaml
in evals/registry/evals
 3 - 2023-03-21 2023-03-21 1 1 trevor.annedenise@icloud.com trevor.annedenise@icloud.com
infiniteloop-match.yaml
in evals/registry/evals
 3 - 2023-03-21 2023-03-21 1 1 44745172+dottedant-dooz@use... 44745172+dottedant-dooz@use...
belarusian-lexicon.yaml
in evals/registry/evals
 3 - 2023-03-21 2023-03-21 1 1 50818265+somerandomguyonthe... 50818265+somerandomguyonthe...
Files Not Recently Changed (Top 50)
File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
jsonl
reverse_string.jsonl
in evals/registry/data/reverse_string
 3 - 2023-03-14 2023-03-14 1 2 120423412+andrew-openai@use... logan@openai.com
reverse-string.yaml
in evals/registry/evals
 3 - 2023-03-14 2023-03-14 1 2 120423412+andrew-openai@use... logan@openai.com
jsonl
samples.v0.jsonl
in evals/registry/data/pattern_identification
 3 - 2023-03-15 2023-03-16 2 2 jasonwei@openai.com jasonwei@openai.com
pattern_identification.yaml
in evals/registry/evals
 7 - 2023-03-15 2023-03-16 2 2 jasonwei@openai.com 120423412+andrew-openai@use...
jsonl
samples.jsonl
in evals/registry/data/cube-pack
 3 - 2023-03-15 2023-03-17 3 2 emil@radix.ai 120423412+andrew-openai@use...
jsonl
fuzzy_match.jsonl
in evals/registry/data/chess_piece_count
 3 - 2023-03-16 2023-03-17 2 2 jatinparab98@gmail.com 120423412+andrew-openai@use...
jsonl
born_first.jsonl
in evals/registry/data/born_first
 3 - 2023-03-15 2023-03-17 2 2 njbbaer@gmail.com 120423412+andrew-openai@use...
jsonl
samples.jsonl
in evals/registry/data/map-electronic-component-part-to-fact
 3 - 2023-03-15 2023-03-17 2 2 omattos@gmail.com 120423412+andrew-openai@use...
chess-piece-count.yaml
in evals/registry/evals
 3 - 2023-03-16 2023-03-17 2 2 jatinparab98@gmail.com 120423412+andrew-openai@use...
born-first.yaml
in evals/registry/evals
 3 - 2023-03-15 2023-03-17 2 2 njbbaer@gmail.com 120423412+andrew-openai@use...
cube-pack.yaml
in evals/registry/evals
 7 - 2023-03-15 2023-03-17 2 2 emil@radix.ai 120423412+andrew-openai@use...
balance-chemical-equation.yaml
in evals/registry/evals
 7 - 2023-03-16 2023-03-17 2 2 scruelt@hotmail.com 120423412+andrew-openai@use...
7 - 2023-03-15 2023-03-17 2 2 omattos@gmail.com 120423412+andrew-openai@use...
jsonl
samples.jsonl
in evals/registry/data/crepe
 3 - 2023-03-21 2023-03-21 1 1 46582003+seacowx@users.nore... 46582003+seacowx@users.nore...
jsonl
samples.jsonl
in evals/registry/data/aba_mrpc_true_false
 3 - 2023-03-21 2023-03-21 1 1 avery@offerfit.ai avery@offerfit.ai
jsonl
samples.jsonl
in evals/registry/data/anagrams
 3 - 2023-03-21 2023-03-21 1 1 97240159+l-mutricy@users.no... 97240159+l-mutricy@users.no...
jsonl
fewshot.jsonl
in evals/registry/data/anagrams
 3 - 2023-03-21 2023-03-21 1 1 97240159+l-mutricy@users.no... 97240159+l-mutricy@users.no...
jsonl
samples.jsonl
in evals/registry/data/decrypt_caesar_cipher
 3 - 2023-03-21 2023-03-21 1 1 me@mattfalconer.com me@mattfalconer.com
jsonl
infiniteloop-match.jsonl
in evals/registry/data/infiniteloop-match
 3 - 2023-03-21 2023-03-21 1 1 44745172+dottedant-dooz@use... 44745172+dottedant-dooz@use...
jsonl
match.jsonl
in evals/registry/data/chess
 3 - 2023-03-21 2023-03-21 1 1 t.zehle@gmail.com t.zehle@gmail.com
jsonl
samples.jsonl
in evals/registry/data/complex_replace_characters
 3 - 2023-03-21 2023-03-21 1 1 petrgazarov@gmail.com petrgazarov@gmail.com
jsonl
samples.jsonl
in evals/registry/data/determinant
 3 - 2023-03-21 2023-03-21 1 1 80975912+vitoraqdev@users.n... 80975912+vitoraqdev@users.n...
jsonl
samples.jsonl
in evals/registry/data/last_word_nth
 3 - 2023-03-21 2023-03-21 1 1 trevor.annedenise@icloud.com trevor.annedenise@icloud.com
jsonl
samples.jsonl
in evals/registry/data/belarusian_lexicon
 3 - 2023-03-21 2023-03-21 1 1 50818265+somerandomguyonthe... 50818265+somerandomguyonthe...
jsonl
samples.jsonl
in evals/registry/data/reasoning
 3 - 2023-03-21 2023-03-21 1 1 oscar-king@users.noreply.gi... oscar-king@users.noreply.gi...
jsonl
samples.jsonl
in evals/registry/data/bigrams
 3 - 2023-03-21 2023-03-21 1 1 oscar-king@users.noreply.gi... oscar-king@users.noreply.gi...
jsonl
samples.jsonl
in evals/registry/data/convert-hex-hsl-lightness
 3 - 2023-03-21 2023-03-21 1 1 harley@hturan.com harley@hturan.com
jsonl
samples.jsonl
in evals/registry/data/connect4
 3 - 2023-03-21 2023-03-21 1 1 83553535+kierandon@users.no... 83553535+kierandon@users.no...
jsonl
samples.jsonl
in evals/registry/data/lat_long_identify
 3 - 2023-03-21 2023-03-21 1 1 vishaal16119@iiitd.ac.in vishaal16119@iiitd.ac.in
belarusian-lexicon.yaml
in evals/registry/evals
 3 - 2023-03-21 2023-03-21 1 1 50818265+somerandomguyonthe... 50818265+somerandomguyonthe...
infiniteloop-match.yaml
in evals/registry/evals
 3 - 2023-03-21 2023-03-21 1 1 44745172+dottedant-dooz@use... 44745172+dottedant-dooz@use...
last-word-nth.yaml
in evals/registry/evals
 3 - 2023-03-21 2023-03-21 1 1 trevor.annedenise@icloud.com trevor.annedenise@icloud.com
chess.yaml
in evals/registry/evals
 3 - 2023-03-21 2023-03-21 1 1 t.zehle@gmail.com t.zehle@gmail.com
connect-4.yaml
in evals/registry/evals
 7 - 2023-03-21 2023-03-21 1 1 83553535+kierandon@users.no... 83553535+kierandon@users.no...
bigrams.yaml
in evals/registry/evals
 7 - 2023-03-21 2023-03-21 1 1 oscar-king@users.noreply.gi... oscar-king@users.noreply.gi...
decrypt-caesar-cipher.yaml
in evals/registry/evals
 7 - 2023-03-21 2023-03-21 1 1 me@mattfalconer.com me@mattfalconer.com
determinant.yaml
in evals/registry/evals
 7 - 2023-03-21 2023-03-21 1 1 80975912+vitoraqdev@users.n... 80975912+vitoraqdev@users.n...
lat_long_identify.yaml
in evals/registry/evals
 7 - 2023-03-21 2023-03-21 1 1 vishaal16119@iiitd.ac.in vishaal16119@iiitd.ac.in
aba-mrpc-true-false.yaml
in evals/registry/evals
 7 - 2023-03-21 2023-03-21 1 1 avery@offerfit.ai avery@offerfit.ai
crepe.yaml
in evals/registry/evals
 7 - 2023-03-21 2023-03-21 1 1 46582003+seacowx@users.nore... 46582003+seacowx@users.nore...
complex-replace-characters.yaml
in evals/registry/evals
 8 - 2023-03-21 2023-03-21 1 1 petrgazarov@gmail.com petrgazarov@gmail.com
convert-hex-hsl-lightness.yaml
in evals/registry/evals
 8 - 2023-03-21 2023-03-21 1 1 harley@hturan.com harley@hturan.com
test-comp-sci.yaml
in evals/registry/evals
 9 - 2023-03-21 2023-03-21 1 1 samennis127@gmail.com samennis127@gmail.com
anagrams.yaml
in evals/registry/evals
 10 - 2023-03-21 2023-03-21 1 1 97240159+l-mutricy@users.no... 97240159+l-mutricy@users.no...
jsonl
samples.jsonl
in evals/registry/data/diagrammatic_logic
 3 - 2023-03-22 2023-03-22 1 1 freddie.nicholson123@gmail.com freddie.nicholson123@gmail.com
jsonl
samples.jsonl
in evals/registry/data/first-letters
 3 - 2023-03-22 2023-03-22 1 1 67751757+kallyaleksiev@user... 67751757+kallyaleksiev@user...
jsonl
samples.jsonl
in evals/registry/data/forth_stack_sim
 3 - 2023-03-22 2023-03-22 1 1 gooseus@users.noreply.githu... gooseus@users.noreply.githu...
jsonl
formal_logic_expressions.jsonl
in evals/registry/data/formal_logic
 3 - 2023-03-22 2023-03-22 1 1 christopher@wolfram.com christopher@wolfram.com
formal_logic.yaml
in evals/registry/evals
 3 - 2023-03-22 2023-03-22 1 1 christopher@wolfram.com christopher@wolfram.com
diagrammatic_logic.yaml
in evals/registry/evals
 7 - 2023-03-22 2023-03-22 1 1 freddie.nicholson123@gmail.com freddie.nicholson123@gmail.com
Most Recently Created Files (Top 50)
File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
14 1
config.yml
in .github
 7 -
jsonl
match.jsonl
in evals/registry/data/coqa
 3 -
jsonl
samples.jsonl
in evals/registry/data/coqa
 3 -
imo_exact_answers.yaml
in evals/registry/evals
 8 - 2024-07-13 2024-07-13 1 1 justin@lin.bot justin@lin.bot
jsonl
samples.jsonl
in evals/registry/data/imo_exact_answers
 3 - 2024-07-13 2024-07-13 1 1 justin@lin.bot justin@lin.bot
openai_assistants_solver.py
in evals/solvers/providers/openai
 186 11 2024-03-28 2024-03-28 1 1 oliver.jaffe@hotmail.co.uk oliver.jaffe@hotmail.co.uk
openai_solver.py
in evals/solvers/providers/openai
 181 18 2024-03-28 2024-03-28 1 1 oliver.jaffe@hotmail.co.uk oliver.jaffe@hotmail.co.uk
together_solver.py
in evals/solvers/providers/together
 68 10 2024-03-28 2024-03-28 1 1 oliver.jaffe@hotmail.co.uk oliver.jaffe@hotmail.co.uk
memory.py
in evals/solvers
 50 3 2024-03-28 2024-03-28 1 1 oliver.jaffe@hotmail.co.uk oliver.jaffe@hotmail.co.uk
solver_completion_fn.py
in evals/completion_fns
 47 4 2024-03-28 2024-03-28 1 1 oliver.jaffe@hotmail.co.uk oliver.jaffe@hotmail.co.uk
gemini_solver.py
in evals/solvers/providers/google
 157 9 2024-03-26 2024-03-26 1 1 oliver.jaffe@hotmail.co.uk oliver.jaffe@hotmail.co.uk
gemini.yaml
in evals/registry/solvers
 15 - 2024-03-26 2024-03-26 1 1 oliver.jaffe@hotmail.co.uk oliver.jaffe@hotmail.co.uk
together.yaml
in evals/registry/solvers
 85 - 2024-03-22 2024-03-28 2 2 giulio.starace@gmail.com oliver.jaffe@hotmail.co.uk
actions.py
in evals/elsuite/multistep_web_tasks/webarena/browser_env
 1014 50 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
processors.py
in evals/elsuite/multistep_web_tasks/webarena/browser_env
 495 21 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
session.py
in evals/elsuite/multistep_web_tasks
 416 28 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
plot_experiments.py
in evals/elsuite/hr_ml_agent_bench/scripts
 307 - 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
low_level_actions.py
in evals/elsuite/hr_ml_agent_bench
 304 13 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
environment.py
in evals/elsuite/hr_ml_agent_bench
 283 21 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
constants.py
in evals/elsuite/multistep_web_tasks/webarena/browser_env
 282 - 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
playwright_api.py
in evals/elsuite/multistep_web_tasks/webarena/core
 279 32 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
eval_run.py
in evals/elsuite/multistep_web_tasks/webarena
 277 14 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
evaluators.py
in evals/elsuite/multistep_web_tasks/webarena/evaluation_harness
 273 19 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
basic_browser_env.py
in evals/elsuite/multistep_web_tasks/webarena/browser_env
 191 11 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
high_level_actions.py
in evals/elsuite/hr_ml_agent_bench
 191 4 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
utils.py
in evals/elsuite/multistep_web_tasks/webarena/core
 188 7 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
strong_solver.py
in evals/elsuite/multistep_web_tasks/solvers/strong_solver
 173 12 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
autoeval.py
in evals/elsuite/hr_ml_agent_bench
 172 2 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
app.py
in evals/elsuite/multistep_web_tasks/docker/flask-playwright
 165 8 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
basic_bash_env.py
in evals/elsuite/multistep_web_tasks/webarena/bash_env
 163 13 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
hr-ml-agent-bench.yaml
in evals/registry/evals
 137 - 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
helper_functions.py
in evals/elsuite/multistep_web_tasks/webarena/browser_env
 129 5 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
train.py
in evals/elsuite/hr_ml_agent_bench/benchmarks/ogbn_arxiv/env
 126 5 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
train.py
in evals/elsuite/hr_ml_agent_bench/benchmarks/parkinsons_disease/env
 124 2 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
train.py
in evals/elsuite/hr_ml_agent_bench/benchmarks/vectorization/env
 118 5 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
utils.py
in evals/elsuite/hr_ml_agent_bench
 112 8 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
helper_functions.py
in evals/elsuite/multistep_web_tasks/webarena/evaluation_harness
 110 7 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
index.html
in evals/elsuite/multistep_web_tasks/docker/homepage/templates
 108 - 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
calculator.html
in evals/elsuite/multistep_web_tasks/docker/homepage/templates
 106 - 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
scratchpad.html
in evals/elsuite/multistep_web_tasks/docker/homepage/templates
 105 - 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
train.py
in evals/elsuite/hr_ml_agent_bench/benchmarks/cifar10/env
 105 4 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
auto_login.py
in evals/elsuite/multistep_web_tasks/webarena/browser_env
 100 3 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
prepare.py
in evals/elsuite/hr_ml_agent_bench/benchmarks/parkinsons_disease/scripts
 98 1 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
make_plots.py
in evals/elsuite/multistep_web_tasks/reproducibility
 94 6 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
webarena_solvers.py
in evals/elsuite/multistep_web_tasks/solvers/webarena_solvers
 94 8 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
eval.py
in evals/elsuite/hr_ml_agent_bench
 91 5 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
baseline.py
in evals/elsuite/hr_ml_agent_bench/solvers
 90 3 2024-03-21 2024-03-28 2 2 danesherbs@users.noreply.gi... oliver.jaffe@hotmail.co.uk
anthropic.yaml
in evals/registry/solvers
 90 - 2024-03-21 2024-03-21 1 1 giulio.starace@gmail.com giulio.starace@gmail.com
anthropic_solver.py
in evals/solvers/providers/anthropic
 89 7 2024-03-21 2024-03-26 2 2 giulio.starace@gmail.com oliver.jaffe@hotmail.co.uk
Most Recently Changed Files (Top 50)
File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
14 1
config.yml
in .github
 7 -
jsonl
match.jsonl
in evals/registry/data/coqa
 3 -
jsonl
samples.jsonl
in evals/registry/data/coqa
 3 -
32 - 2023-07-13 2026-04-14 3 3 pan93412@gmail.com 146999853+mcgrew-oai@users....
oaieval.py
in evals/cli
 253 6 2023-03-19 2024-09-30 19 18 120423412+andrew-openai@use... steven@openai.com
imo_exact_answers.yaml
in evals/registry/evals
 8 - 2024-07-13 2024-07-13 1 1 justin@lin.bot justin@lin.bot
jsonl
samples.jsonl
in evals/registry/data/imo_exact_answers
 3 - 2024-07-13 2024-07-13 1 1 justin@lin.bot justin@lin.bot
data.py
in evals
 148 21 2023-03-17 2024-04-03 9 10 343165+rlbayes@users.norepl... 150190178+josnyder-2@users....
theory_of_mind.yaml
in evals/registry/solvers
 394 - 2024-01-29 2024-03-28 3 2 junshern@users.noreply.gith... oliver.jaffe@hotmail.co.uk
defaults.yaml
in evals/registry/solvers
 294 - 2024-01-29 2024-03-28 3 2 junshern@users.noreply.gith... oliver.jaffe@hotmail.co.uk
skill_acquisition.yaml
in evals/registry/solvers
 267 - 2024-03-19 2024-03-28 2 2 inwaves@users.noreply.githu... oliver.jaffe@hotmail.co.uk
registry.py
in evals
 242 27 2023-03-21 2024-03-28 22 17 343165+rlbayes@users.norepl... oliver.jaffe@hotmail.co.uk
openai_assistants_solver.py
in evals/solvers/providers/openai
 186 11 2024-03-28 2024-03-28 1 1 oliver.jaffe@hotmail.co.uk oliver.jaffe@hotmail.co.uk
openai_solver.py
in evals/solvers/providers/openai
 181 18 2024-03-28 2024-03-28 1 1 oliver.jaffe@hotmail.co.uk oliver.jaffe@hotmail.co.uk
function_deduction.yaml
in evals/registry/solvers
 174 - 2024-03-19 2024-03-28 2 2 129281094+james-aung@users.... oliver.jaffe@hotmail.co.uk
eval.py
in evals
 170 15 2023-03-20 2024-03-28 9 9 2406911+zhangmarvin@users.n... oliver.jaffe@hotmail.co.uk
solvers.py
in evals/elsuite/function_deduction
 140 9 2024-03-19 2024-03-28 2 2 129281094+james-aung@users.... oliver.jaffe@hotmail.co.uk
solver.py
in evals/solvers
 125 17 2023-11-09 2024-03-28 4 2 junshern@users.noreply.gith... oliver.jaffe@hotmail.co.uk
self_consistency_solver.py
in evals/solvers/nested
 118 6 2024-01-29 2024-03-28 3 2 junshern@users.noreply.gith... oliver.jaffe@hotmail.co.uk
make-me-pay.yaml
in evals/registry/solvers
 101 - 2024-01-29 2024-03-28 2 2 junshern@users.noreply.gith... oliver.jaffe@hotmail.co.uk
self_prompting.yaml
in evals/registry/solvers
 96 - 2024-01-29 2024-03-28 2 2 junshern@users.noreply.gith... oliver.jaffe@hotmail.co.uk
baseline.py
in evals/elsuite/hr_ml_agent_bench/solvers
 90 3 2024-03-21 2024-03-28 2 2 danesherbs@users.noreply.gi... oliver.jaffe@hotmail.co.uk
strategy_solver.py
in evals/elsuite/bluff
 88 5 2023-11-15 2024-03-28 3 3 33967107+johny-b@users.nore... oliver.jaffe@hotmail.co.uk
together.yaml
in evals/registry/solvers
 85 - 2024-03-22 2024-03-28 2 2 giulio.starace@gmail.com oliver.jaffe@hotmail.co.uk
bluff.yaml
in evals/registry/solvers
 80 - 2024-01-29 2024-03-28 2 2 junshern@users.noreply.gith... oliver.jaffe@hotmail.co.uk
already_said_that.yaml
in evals/registry/solvers
 75 - 2024-03-19 2024-03-28 2 2 giulio.starace@gmail.com oliver.jaffe@hotmail.co.uk
twenty_questions.yaml
in evals/registry/solvers
 75 - 2024-03-19 2024-03-28 2 2 inwaves@users.noreply.githu... oliver.jaffe@hotmail.co.uk
track_the_stat.yaml
in evals/registry/solvers
 75 - 2024-03-19 2024-03-28 2 2 giulio.starace@gmail.com oliver.jaffe@hotmail.co.uk
together_solver.py
in evals/solvers/providers/together
 68 10 2024-03-28 2024-03-28 1 1 oliver.jaffe@hotmail.co.uk oliver.jaffe@hotmail.co.uk
cot_solver.py
in evals/solvers/nested
 61 7 2024-01-29 2024-03-28 3 2 junshern@users.noreply.gith... oliver.jaffe@hotmail.co.uk
memory.py
in evals/solvers
 50 3 2024-03-28 2024-03-28 1 1 oliver.jaffe@hotmail.co.uk oliver.jaffe@hotmail.co.uk
eval.py
in evals/elsuite/make_me_say
 48 3 2023-09-19 2024-03-28 3 2 140545726+ianmckenzie-oai@u... oliver.jaffe@hotmail.co.uk
solver_completion_fn.py
in evals/completion_fns
 47 4 2024-03-28 2024-03-28 1 1 oliver.jaffe@hotmail.co.uk oliver.jaffe@hotmail.co.uk
utils.py
in evals/solvers
 37 2 2023-11-09 2024-03-28 4 2 junshern@users.noreply.gith... oliver.jaffe@hotmail.co.uk
hr-ml-agent-bench.yaml
in evals/registry/solvers
 37 - 2024-03-21 2024-03-28 2 2 danesherbs@users.noreply.gi... oliver.jaffe@hotmail.co.uk
error_recovery.yaml
in evals/registry/solvers
 33 - 2024-03-19 2024-03-28 2 1 oliver.jaffe@hotmail.co.uk oliver.jaffe@hotmail.co.uk
cant_do_that_anymore.yaml
in evals/registry/solvers
 16 - 2024-03-19 2024-03-28 2 1 oliver.jaffe@hotmail.co.uk oliver.jaffe@hotmail.co.uk
task_description.py
in evals/elsuite/bugged_tools
 9 - 2024-03-19 2024-03-28 2 1 oliver.jaffe@hotmail.co.uk oliver.jaffe@hotmail.co.uk
prompts.py
in evals/elsuite/function_deduction
 6 - 2024-03-19 2024-03-28 2 2 129281094+james-aung@users.... oliver.jaffe@hotmail.co.uk
cot.py
in evals/solvers/prompts
 4 - 2023-11-09 2024-03-28 2 2 junshern@users.noreply.gith... oliver.jaffe@hotmail.co.uk
gemini_solver.py
in evals/solvers/providers/google
 157 9 2024-03-26 2024-03-26 1 1 oliver.jaffe@hotmail.co.uk oliver.jaffe@hotmail.co.uk
openai.py
in evals/completion_fns
 147 10 2023-04-11 2024-03-26 5 6 jwang47@users.noreply.githu... oliver.jaffe@hotmail.co.uk
anthropic_solver.py
in evals/solvers/providers/anthropic
 89 7 2024-03-21 2024-03-26 2 2 giulio.starace@gmail.com oliver.jaffe@hotmail.co.uk
api_utils.py
in evals/utils
 15 1 2023-03-19 2024-03-26 10 8 120423412+andrew-openai@use... oliver.jaffe@hotmail.co.uk
gemini.yaml
in evals/registry/solvers
 15 - 2024-03-26 2024-03-26 1 1 oliver.jaffe@hotmail.co.uk oliver.jaffe@hotmail.co.uk
actions.py
in evals/elsuite/multistep_web_tasks/webarena/browser_env
 1014 50 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
processors.py
in evals/elsuite/multistep_web_tasks/webarena/browser_env
 495 21 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
session.py
in evals/elsuite/multistep_web_tasks
 416 28 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
plot_experiments.py
in evals/elsuite/hr_ml_agent_bench/scripts
 307 - 2024-03-21 2024-03-21 1 1 danesherbs@users.noreply.gi... danesherbs@users.noreply.gi...
Summary
  • Number of files: 1,495
  • Daily file updates (only one update per file and date counted): 1763
  • First update: 2023-03-14
  • Latest update: 2026-04-14
  • Days between first and latest update: 1,127 (161 weeks, estimated 805 working days)
  • Active days (at least one file change): 120
  • Files without commit history (ignored): 4 (27 lines of code)
  • Data: