openai / simple-evals
File Change Frequency

File change frequency (churn) shows the distribution of file updates (days with at least one commit).

Overview
File Change Frequency Overall
  • There are 15 files with 1,557 lines of code.
    • 0 files changed more than 100 times (0 lines of code)
    • 0 files changed 51-100 times (0 lines of code)
    • 0 files changed 21-50 times (0 lines of code)
    • 3 files changed 6-20 times (453 lines of code)
    • 12 files changed 1-5 times (1,104 lines of code)
0% | 0% | 0% | 29% | 70%
Legend:
101+
51-100
21-50
6-20
1-5

explore: grouped by folders | grouped by update frequency | data
Contributors Count Frequency Overall
  • There are 15 files with 1,557 lines of code.
    • 0 files changed by more than 25 contributors (0 lines of code)
    • 0 files changed by 11-25 contributors (0 lines of code)
    • 2 files changed by 6-10 contributors (285 lines of code)
    • 10 files changed by 2-5 contributors (1,118 lines of code)
    • 3 files changed by 1 contributor (154 lines of code)
0% | 0% | 18% | 71% | 9%
Legend:
26+
11-25
6-10
2-5
1

explore: grouped by folders | grouped by contributors count | data
File Change Frequency per File Extension
py, md, txt, gitignore, json
File Change Frequency per Extension
The number of recorded file updates
101+
51-100
21-50
6-20
1-5
py0% | 0% | 0% | 29% | 70%
File Change Frequency per Logical Decomposition
primary
primary (file change frequency)
The number of recorded file updates
101+
51-100
21-50
6-20
1-5
ROOT0% | 0% | 0% | 34% | 65%
sampler0% | 0% | 0% | 0% | 100%
Most Frequently Changed Files (Top 15)

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
224 1 2024-11-20 2025-04-21 10 6 jmcgrath@openai.com jmcgrath@openai.com
common.py
in root
 168 11 2024-05-13 2025-01-31 7 5 openai@openai.com erik@openai.com
61 2 2024-05-13 2025-01-31 6 6 openai@openai.com shanth@openai.com
47 2 2024-04-12 2025-01-31 5 5 openai@openai.com shanth@openai.com
71 5 2025-04-10 2025-04-21 4 2 mgl@openai.com jmcgrath@openai.com
86 3 2024-10-30 2025-04-10 4 5 165065090+kzl-openai@users.... sun@openai.com
113 2 2024-05-13 2025-01-31 4 4 openai@openai.com shanth@openai.com
134 1 2024-09-11 2025-02-01 4 3 erik@openai.com shanth@openai.com
144 6 2024-05-13 2025-04-14 4 5 openai@openai.com jmcgrath@openai.com
220 20 2024-05-13 2025-01-31 2 3 openai@openai.com shanth@openai.com
types.py
in root
 22 2 2024-05-13 2024-05-13 1 1 openai@openai.com openai@openai.com
52 5 2025-01-31 2025-01-31 1 2 erik@openai.com shanth@openai.com
64 5 2024-05-13 2024-05-13 1 1 openai@openai.com openai@openai.com
68 5 2024-05-13 2024-05-13 1 1 openai@openai.com openai@openai.com
83 5 2025-04-10 2025-04-10 1 2 165065090+kzl-openai@users.... sun@openai.com
Files With Most Contributors (Top 15)
Based on the number of unique email addresses found in commits.

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
224 1 2024-11-20 2025-04-21 10 6 jmcgrath@openai.com jmcgrath@openai.com
61 2 2024-05-13 2025-01-31 6 6 openai@openai.com shanth@openai.com
common.py
in root
 168 11 2024-05-13 2025-01-31 7 5 openai@openai.com erik@openai.com
47 2 2024-04-12 2025-01-31 5 5 openai@openai.com shanth@openai.com
86 3 2024-10-30 2025-04-10 4 5 165065090+kzl-openai@users.... sun@openai.com
144 6 2024-05-13 2025-04-14 4 5 openai@openai.com jmcgrath@openai.com
113 2 2024-05-13 2025-01-31 4 4 openai@openai.com shanth@openai.com
134 1 2024-09-11 2025-02-01 4 3 erik@openai.com shanth@openai.com
220 20 2024-05-13 2025-01-31 2 3 openai@openai.com shanth@openai.com
71 5 2025-04-10 2025-04-21 4 2 mgl@openai.com jmcgrath@openai.com
83 5 2025-04-10 2025-04-10 1 2 165065090+kzl-openai@users.... sun@openai.com
52 5 2025-01-31 2025-01-31 1 2 erik@openai.com shanth@openai.com
types.py
in root
 22 2 2024-05-13 2024-05-13 1 1 openai@openai.com openai@openai.com
68 5 2024-05-13 2024-05-13 1 1 openai@openai.com openai@openai.com
64 5 2024-05-13 2024-05-13 1 1 openai@openai.com openai@openai.com
Files With Least Contributors (Top 15)
Based on the number of unique email addresses found in commits.

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
68 5 2024-05-13 2024-05-13 1 1 openai@openai.com openai@openai.com
64 5 2024-05-13 2024-05-13 1 1 openai@openai.com openai@openai.com
types.py
in root
 22 2 2024-05-13 2024-05-13 1 1 openai@openai.com openai@openai.com
83 5 2025-04-10 2025-04-10 1 2 165065090+kzl-openai@users.... sun@openai.com
71 5 2025-04-10 2025-04-21 4 2 mgl@openai.com jmcgrath@openai.com
52 5 2025-01-31 2025-01-31 1 2 erik@openai.com shanth@openai.com
220 20 2024-05-13 2025-01-31 2 3 openai@openai.com shanth@openai.com
134 1 2024-09-11 2025-02-01 4 3 erik@openai.com shanth@openai.com
113 2 2024-05-13 2025-01-31 4 4 openai@openai.com shanth@openai.com
common.py
in root
 168 11 2024-05-13 2025-01-31 7 5 openai@openai.com erik@openai.com
144 6 2024-05-13 2025-04-14 4 5 openai@openai.com jmcgrath@openai.com
86 3 2024-10-30 2025-04-10 4 5 165065090+kzl-openai@users.... sun@openai.com
47 2 2024-04-12 2025-01-31 5 5 openai@openai.com shanth@openai.com
224 1 2024-11-20 2025-04-21 10 6 jmcgrath@openai.com jmcgrath@openai.com
61 2 2024-05-13 2025-01-31 6 6 openai@openai.com shanth@openai.com
Correlations

File Size vs. Number of Changes: 15 points

sampler/responses_sampler.py x: 71 lines of code y: 4 # changes simple_evals.py x: 224 lines of code y: 10 # changes mgsm_eval.py x: 144 lines of code y: 4 # changes browsecomp_eval.py x: 83 lines of code y: 1 # changes simpleqa_eval.py x: 86 lines of code y: 4 # changes run_multilingual_mmlu.py x: 134 lines of code y: 4 # changes common.py x: 168 lines of code y: 7 # changes drop_eval.py x: 220 lines of code y: 2 # changes gpqa_eval.py x: 61 lines of code y: 6 # changes math_eval.py x: 47 lines of code y: 5 # changes mmlu_eval.py x: 113 lines of code y: 4 # changes sampler/o_chat_completion_sampler.py x: 52 lines of code y: 1 # changes sampler/chat_completion_sampler.py x: 64 lines of code y: 1 # changes sampler/claude_sampler.py x: 68 lines of code y: 1 # changes types.py x: 22 lines of code y: 1 # changes
10.0
# changes
  min: 1.0
  average: 3.67
  25th percentile: 1.0
  median: 4.0
  75th percentile: 5.0
  max: 10.0
0 224.0
lines of code
min: 22.0 | average: 103.8 | 25th percentile: 61.0 | median: 83.0 | 75th percentile: 144.0 | max: 224.0

Number of Contributors vs. Number of Changes: 15 points

sampler/responses_sampler.py x: 2 # contributors y: 4 # changes simple_evals.py x: 6 # contributors y: 10 # changes mgsm_eval.py x: 5 # contributors y: 4 # changes browsecomp_eval.py x: 2 # contributors y: 1 # changes run_multilingual_mmlu.py x: 3 # contributors y: 4 # changes common.py x: 5 # contributors y: 7 # changes drop_eval.py x: 3 # contributors y: 2 # changes gpqa_eval.py x: 6 # contributors y: 6 # changes math_eval.py x: 5 # contributors y: 5 # changes mmlu_eval.py x: 4 # contributors y: 4 # changes sampler/chat_completion_sampler.py x: 1 # contributors y: 1 # changes
10.0
# changes
  min: 1.0
  average: 3.67
  25th percentile: 1.0
  median: 4.0
  75th percentile: 5.0
  max: 10.0
0 6.0
# contributors
min: 1.0 | average: 3.4 | 25th percentile: 2.0 | median: 3.0 | 75th percentile: 5.0 | max: 6.0

Number of Contributors vs. File Size: 15 points

sampler/responses_sampler.py x: 2 # contributors y: 71 lines of code simple_evals.py x: 6 # contributors y: 224 lines of code mgsm_eval.py x: 5 # contributors y: 144 lines of code browsecomp_eval.py x: 2 # contributors y: 83 lines of code simpleqa_eval.py x: 5 # contributors y: 86 lines of code run_multilingual_mmlu.py x: 3 # contributors y: 134 lines of code common.py x: 5 # contributors y: 168 lines of code drop_eval.py x: 3 # contributors y: 220 lines of code gpqa_eval.py x: 6 # contributors y: 61 lines of code math_eval.py x: 5 # contributors y: 47 lines of code mmlu_eval.py x: 4 # contributors y: 113 lines of code sampler/o_chat_completion_sampler.py x: 2 # contributors y: 52 lines of code sampler/chat_completion_sampler.py x: 1 # contributors y: 64 lines of code sampler/claude_sampler.py x: 1 # contributors y: 68 lines of code types.py x: 1 # contributors y: 22 lines of code
224.0
lines of code
  min: 22.0
  average: 103.8
  25th percentile: 61.0
  median: 83.0
  75th percentile: 144.0
  max: 224.0
0 6.0
# contributors
min: 1.0 | average: 3.4 | 25th percentile: 2.0 | median: 3.0 | 75th percentile: 5.0 | max: 6.0