openai/human-eval
Code for the paper "Evaluating Large Language Models Trained on Code"
GitHub 
0.3K
lines of main code
7 files
0
lines of test code
0 files
0.03K
lines of other code
2 files
5y
age
1,911 days
0%
main code touched
1 year (97 LOC)
ABCDE
ease of change
for people* (7/10)
ABCDE
ease of change
for AI* (7/9)
0.3K
py
JSONL
0.01K
jsonl
30 days 2026 2025 2021
+0
-0
 
 
+80
-58
+1
-1
0

0

2

1

0

0

2

1

0

0

1

1

2026 2025 2021
Rule-of-thumb estimates

Rebuild value

to rebuild
rebuild value

Maintenance effort

per year to maintain
maintenance cost per year
Rules of thumb, not measurements: one man-year rebuilds about 10,000 lines of main code (design, testing and coordination included), and keeping a code base alive takes about 15% of its rebuild value per year (20 man-years of rebuild value need about 3 man-years of maintenance every year). Your changes are remembered in this browser for every report.