openai/evals
Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
GitHub 
41K
lines of main code
1.5K files
2.6K
lines of test code
52 files
5.8K
lines of other code
121 files
4y
age
1,304 days
<1%
main code touched
1 year (59 LOC)
ABCDE
ease of change
for people* (8/10)
ABCDE
ease of change
for AI* (7/9)
29K
py
8.2K
yaml
JSONL
1.9K
jsonl
1.3K
ipynb
0.3K
html
0.1K
js
IN
0.01K
in
30 days 2026 2024 2023
+0
-0
+5
-5
+32K
-1.1K
+27K
-4.4K
0

1

419

1.5K

0

1

38

561

0

1

0

0

0

1

15

418

2026 2024 2023
Rule-of-thumb estimates

Rebuild value

to rebuild
rebuild value

Maintenance effort

per year to maintain
maintenance cost per year
Rules of thumb, not measurements: one man-year rebuilds about 10,000 lines of main code (design, testing and coordination included), and keeping a code base alive takes about 15% of its rebuild value per year (20 man-years of rebuild value need about 3 man-years of maintenance every year). Your changes are remembered in this browser for every report.