openai / mle-bench
File Churn

File change frequency (churn) shows the distribution of file updates (days with at least one commit).

Overview
File Change Frequency Overall
  • There are 5 files with 930 lines of code.
    • 0 files changed more than 100 times (0 lines of code)
    • 0 files changed 51-100 times (0 lines of code)
    • 0 files changed 21-50 times (0 lines of code)
    • 0 files changed 6-20 times (0 lines of code)
    • 5 files changed 1-5 times (930 lines of code)
0% | 0% | 0% | 0% | 100%
Legend:
101+
51-100
21-50
6-20
1-5

explore: grouped by folders | grouped by update frequency | data
Contributors Count Frequency Overall
  • There are 5 files with 930 lines of code.
    • 0 files changed by more than 25 contributors (0 lines of code)
    • 0 files changed by 11-25 contributors (0 lines of code)
    • 0 files changed by 6-10 contributors (0 lines of code)
    • 1 file changed by 2-5 contributors (113 lines of code)
    • 4 files changed by 1 contributor (817 lines of code)
0% | 0% | 0% | 12% | 87%
Legend:
26+
11-25
6-10
2-5
1

explore: grouped by folders | grouped by contributors count | data
File Change Frequency per File Extension
json, py, md, yaml, txt, sh, gitignore, gitattributes, dockerignore, toml, mjs
File Change Frequency per Extension
The number of recorded file updates
101+
51-100
21-50
6-20
1-5
py0% | 0% | 0% | 0% | 100%
yaml0% | 0% | 0% | 0% | 0%
mjs0% | 0% | 0% | 0% | 0%
File Change Frequency per Logical Decomposition
primary
primary (file change frequency)
The number of recorded file updates
101+
51-100
21-50
6-20
1-5
mlebench0% | 0% | 0% | 0% | 100%
experiments0% | 0% | 0% | 0% | 100%
ROOT0% | 0% | 0% | 0% | 0%
environment0% | 0% | 0% | 0% | 0%
extras0% | 0% | 0% | 0% | 0%
agents0% | 0% | 0% | 0% | 0%
Most Frequently Changed Files (Top 50)

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)
# contributorsline
churn
first
contributor
latest
contributor
registry.py
in mlebench
113 10 2024-11-28 2025-01-06 2 2 +15 / -2 giulio.starace@gmail.com 129281094+james-aung@users....
prepare.py
in mlebench/competitions/the-icml-2013-whale-challenge-right-whale-redux
60 1 2024-11-28 2024-11-28 1 1 +1 / -1 giulio.starace@gmail.com giulio.starace@gmail.com
cli.py
in mlebench
200 1 2025-01-06 2025-01-06 1 1 +16 / -1 129281094+james-aung@users.... 129281094+james-aung@users....
data.py
in mlebench
275 14 2024-10-14 2024-10-14 1 1 +1 / -1 aiden.jongseob@gmail.com aiden.jongseob@gmail.com
282 12 2025-11-27 2025-11-27 1 1 +361 / -0 giulio.starace@gmail.com giulio.starace@gmail.com
prepare.py
in agents/mlagentbench/benchmark_dir/scripts
1 -
__init__.py
in mlebench
1 -
__init__.py
in mlebench/competitions
1 -
classes.py
in mlebench/competitions/jigsaw-toxic-comment-classification-challenge
1 -
classes.py
in mlebench/competitions/spooky-author-identification
1 -
__init__.py
in environment
1 -
config.yaml
in agents/dummy
3 -
dogs.py
in mlebench/competitions/dog-breed-identification
3 -
defaults.py
in environment
4 -
templates.py
in agents/opendevin
5 -
checksums.yaml
in mlebench/competitions/herbarium-2021-fgvc8
5 -
checksums.yaml
in mlebench/competitions/dogs-vs-cats-redux-kernels-edition
5 -
checksums.yaml
in mlebench/competitions/movie-review-sentiment-analysis-kernels-only
5 -
checksums.yaml
in mlebench/competitions/alaska2-image-steganalysis
5 -
checksums.yaml
in mlebench/competitions/tensorflow-speech-recognition-challenge
5 -
checksums.yaml
in mlebench/competitions/billion-word-imputation
5 -
checksums.yaml
in mlebench/competitions/denoising-dirty-documents
5 -
checksums.yaml
in mlebench/competitions/statoil-iceberg-classifier-challenge
5 -
checksums.yaml
in mlebench/competitions/herbarium-2020-fgvc7
5 -
checksums.yaml
in mlebench/competitions/the-icml-2013-whale-challenge-right-whale-redux
5 -
checksums.yaml
in mlebench/competitions/ml2021spring-hw2
5 -
checksums.yaml
in mlebench/competitions/plant-seedlings-classification
5 -
checksums.yaml
in mlebench/competitions/smartphone-decimeter-2022
5 -
checksums.yaml
in mlebench/competitions/text-normalization-challenge-english-language
5 -
checksums.yaml
in mlebench/competitions/invasive-species-monitoring
5 -
checksums.yaml
in mlebench/competitions/text-normalization-challenge-russian-language
5 -
checksums.yaml
in mlebench/competitions/mlsp-2013-birds
5 -
checksums.yaml
in mlebench/competitions/3d-object-detection-for-autonomous-vehicles
6 -
checksums.yaml
in mlebench/competitions/histopathologic-cancer-detection
6 -
grade.py
in mlebench/competitions/tabular-playground-series-may-2022
6 1
checksums.yaml
in mlebench/competitions/vesuvius-challenge-ink-detection
6 -
checksums.yaml
in mlebench/competitions/dog-breed-identification
6 -
checksums.yaml
in mlebench/competitions/rsna-miccai-brain-tumor-radiogenomic-classification
6 -
checksums.yaml
in mlebench/competitions/hotel-id-2021-fgvc8
6 -
checksums.yaml
in mlebench/competitions/predict-volcanic-eruptions-ingv-oe
6 -
checksums.yaml
in mlebench/competitions/seti-breakthrough-listen
6 -
checksums.yaml
in mlebench/competitions/plant-pathology-2021-fgvc8
6 -
checksums.yaml
in mlebench/competitions/aerial-cactus-identification
6 -
checksums.yaml
in mlebench/competitions/paddy-disease-classification
6 -
checksums.yaml
in mlebench/competitions/whale-categorization-playground
6 -
checksums.yaml
in mlebench/competitions/plant-pathology-2020-fgvc7
7 -
checksums.yaml
in mlebench/competitions/tgs-salt-identification-challenge
7 -
checksums.yaml
in mlebench/competitions/aptos2019-blindness-detection
7 -
checksums.yaml
in mlebench/competitions/stanford-covid-vaccine
7 -
checksums.yaml
in mlebench/competitions/jigsaw-toxic-comment-classification-challenge
7 -
Files With Most Churn (Top 50)
Based on the number of lines added and deleted across all commits.

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)
# contributorsline
churn
first
contributor
latest
contributor
282 12 2025-11-27 2025-11-27 1 1 +361 / -0 giulio.starace@gmail.com giulio.starace@gmail.com
registry.py
in mlebench
113 10 2024-11-28 2025-01-06 2 2 +15 / -2 giulio.starace@gmail.com 129281094+james-aung@users....
cli.py
in mlebench
200 1 2025-01-06 2025-01-06 1 1 +16 / -1 129281094+james-aung@users.... 129281094+james-aung@users....
prepare.py
in mlebench/competitions/the-icml-2013-whale-challenge-right-whale-redux
60 1 2024-11-28 2024-11-28 1 1 +1 / -1 giulio.starace@gmail.com giulio.starace@gmail.com
data.py
in mlebench
275 14 2024-10-14 2024-10-14 1 1 +1 / -1 aiden.jongseob@gmail.com aiden.jongseob@gmail.com
prepare.py
in agents/mlagentbench/benchmark_dir/scripts
1 -
__init__.py
in mlebench
1 -
__init__.py
in mlebench/competitions
1 -
classes.py
in mlebench/competitions/jigsaw-toxic-comment-classification-challenge
1 -
classes.py
in mlebench/competitions/spooky-author-identification
1 -
__init__.py
in environment
1 -
config.yaml
in agents/dummy
3 -
dogs.py
in mlebench/competitions/dog-breed-identification
3 -
defaults.py
in environment
4 -
templates.py
in agents/opendevin
5 -
checksums.yaml
in mlebench/competitions/herbarium-2021-fgvc8
5 -
checksums.yaml
in mlebench/competitions/dogs-vs-cats-redux-kernels-edition
5 -
checksums.yaml
in mlebench/competitions/movie-review-sentiment-analysis-kernels-only
5 -
checksums.yaml
in mlebench/competitions/alaska2-image-steganalysis
5 -
checksums.yaml
in mlebench/competitions/tensorflow-speech-recognition-challenge
5 -
checksums.yaml
in mlebench/competitions/billion-word-imputation
5 -
checksums.yaml
in mlebench/competitions/denoising-dirty-documents
5 -
checksums.yaml
in mlebench/competitions/statoil-iceberg-classifier-challenge
5 -
checksums.yaml
in mlebench/competitions/herbarium-2020-fgvc7
5 -
checksums.yaml
in mlebench/competitions/the-icml-2013-whale-challenge-right-whale-redux
5 -
checksums.yaml
in mlebench/competitions/ml2021spring-hw2
5 -
checksums.yaml
in mlebench/competitions/plant-seedlings-classification
5 -
checksums.yaml
in mlebench/competitions/smartphone-decimeter-2022
5 -
checksums.yaml
in mlebench/competitions/text-normalization-challenge-english-language
5 -
checksums.yaml
in mlebench/competitions/invasive-species-monitoring
5 -
checksums.yaml
in mlebench/competitions/text-normalization-challenge-russian-language
5 -
checksums.yaml
in mlebench/competitions/mlsp-2013-birds
5 -
checksums.yaml
in mlebench/competitions/3d-object-detection-for-autonomous-vehicles
6 -
checksums.yaml
in mlebench/competitions/histopathologic-cancer-detection
6 -
grade.py
in mlebench/competitions/tabular-playground-series-may-2022
6 1
checksums.yaml
in mlebench/competitions/vesuvius-challenge-ink-detection
6 -
checksums.yaml
in mlebench/competitions/dog-breed-identification
6 -
checksums.yaml
in mlebench/competitions/rsna-miccai-brain-tumor-radiogenomic-classification
6 -
checksums.yaml
in mlebench/competitions/hotel-id-2021-fgvc8
6 -
checksums.yaml
in mlebench/competitions/predict-volcanic-eruptions-ingv-oe
6 -
checksums.yaml
in mlebench/competitions/seti-breakthrough-listen
6 -
checksums.yaml
in mlebench/competitions/plant-pathology-2021-fgvc8
6 -
checksums.yaml
in mlebench/competitions/aerial-cactus-identification
6 -
checksums.yaml
in mlebench/competitions/paddy-disease-classification
6 -
checksums.yaml
in mlebench/competitions/whale-categorization-playground
6 -
checksums.yaml
in mlebench/competitions/plant-pathology-2020-fgvc7
7 -
checksums.yaml
in mlebench/competitions/tgs-salt-identification-challenge
7 -
checksums.yaml
in mlebench/competitions/aptos2019-blindness-detection
7 -
checksums.yaml
in mlebench/competitions/stanford-covid-vaccine
7 -
checksums.yaml
in mlebench/competitions/jigsaw-toxic-comment-classification-challenge
7 -
Files With Most Contributors (Top 50)
Based on the number of unique email addresses found in commits.

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)
# contributorsline
churn
first
contributor
latest
contributor
registry.py
in mlebench
113 10 2024-11-28 2025-01-06 2 2 +15 / -2 giulio.starace@gmail.com 129281094+james-aung@users....
cli.py
in mlebench
200 1 2025-01-06 2025-01-06 1 1 +16 / -1 129281094+james-aung@users.... 129281094+james-aung@users....
prepare.py
in mlebench/competitions/the-icml-2013-whale-challenge-right-whale-redux
60 1 2024-11-28 2024-11-28 1 1 +1 / -1 giulio.starace@gmail.com giulio.starace@gmail.com
data.py
in mlebench
275 14 2024-10-14 2024-10-14 1 1 +1 / -1 aiden.jongseob@gmail.com aiden.jongseob@gmail.com
282 12 2025-11-27 2025-11-27 1 1 +361 / -0 giulio.starace@gmail.com giulio.starace@gmail.com
11 -
defaults.py
in environment
4 -
grading_server.py
in environment
28 3
utils.py
in environment
90 5
__init__.py
in environment
1 -
metrics.py
in mlebench
29 3
grade_helpers.py
in mlebench
171 7
grade.py
in mlebench
110 4
prepare.py
in mlebench/competitions/champs-scalar-coupling
84 1
checksums.yaml
in mlebench/competitions/champs-scalar-coupling
13 -
grade.py
in mlebench/competitions/champs-scalar-coupling
35 3
config.yaml
in mlebench/competitions/champs-scalar-coupling
23 -
classes.py
in mlebench/competitions/ranzcr-clip-catheter-line-classification
11 -
prepare.py
in mlebench/competitions/ranzcr-clip-catheter-line-classification
37 1
checksums.yaml
in mlebench/competitions/ranzcr-clip-catheter-line-classification
7 -
grade.py
in mlebench/competitions/ranzcr-clip-catheter-line-classification
25 1
config.yaml
in mlebench/competitions/ranzcr-clip-catheter-line-classification
27 -
prepare.py
in mlebench/competitions/mlsp-2013-birds
143 2
checksums.yaml
in mlebench/competitions/mlsp-2013-birds
5 -
grade.py
in mlebench/competitions/mlsp-2013-birds
8 1
config.yaml
in mlebench/competitions/mlsp-2013-birds
19 -
prepare.py
in mlebench/competitions/random-acts-of-pizza
57 1
checksums.yaml
in mlebench/competitions/random-acts-of-pizza
7 -
grade.py
in mlebench/competitions/random-acts-of-pizza
11 1
config.yaml
in mlebench/competitions/random-acts-of-pizza
13 -
prepare.py
in mlebench/competitions/siim-covid19-detection
62 1
checksums.yaml
in mlebench/competitions/siim-covid19-detection
7 -
grade.py
in mlebench/competitions/siim-covid19-detection
98 4
config.yaml
in mlebench/competitions/siim-covid19-detection
33 -
prepare.py
in mlebench/competitions/petfinder-pawpularity-score
55 1
checksums.yaml
in mlebench/competitions/petfinder-pawpularity-score
7 -
grade.py
in mlebench/competitions/petfinder-pawpularity-score
29 2
config.yaml
in mlebench/competitions/petfinder-pawpularity-score
19 -
prepare.py
in mlebench/competitions/inaturalist-2019-fgvc6
203 2
checksums.yaml
in mlebench/competitions/inaturalist-2019-fgvc6
8 -
grade.py
in mlebench/competitions/inaturalist-2019-fgvc6
23 2
config.yaml
in mlebench/competitions/inaturalist-2019-fgvc6
13 -
prepare.py
in mlebench/competitions/text-normalization-challenge-russian-language
89 1
checksums.yaml
in mlebench/competitions/text-normalization-challenge-russian-language
5 -
grade.py
in mlebench/competitions/text-normalization-challenge-russian-language
34 2
config.yaml
in mlebench/competitions/text-normalization-challenge-russian-language
19 -
prepare.py
in mlebench/competitions/herbarium-2022-fgvc9
156 1
checksums.yaml
in mlebench/competitions/herbarium-2022-fgvc9
7 -
grade.py
in mlebench/competitions/herbarium-2022-fgvc9
20 2
config.yaml
in mlebench/competitions/herbarium-2022-fgvc9
13 -
Files With Least Contributors (Top 50)
Based on the number of unique email addresses found in commits.

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)
# contributorsline
churn
first
contributor
latest
contributor
prepare.py
in mlebench/competitions/3d-object-detection-for-autonomous-vehicles
324 1
analyze.py
in extras/rule_violation_detector
232 3
mAP_evaluation.py
in mlebench/competitions/3d-object-detection-for-autonomous-vehicles
215 18
familiarity.py
in experiments/familiarity
213 5
prepare.py
in mlebench/competitions/inaturalist-2019-fgvc6
203 2
203 -
utils.py
in mlebench
190 21
prepare.py
in mlebench/competitions/herbarium-2020-fgvc7
176 1
prepare.py
in mlebench/competitions/herbarium-2021-fgvc8
176 1
grade_helpers.py
in mlebench
171 7
utils.py
in mlebench/competitions
167 9
prepare.py
in mlebench/competitions/herbarium-2022-fgvc9
156 1
prepare.py
in mlebench/competitions/rsna-2022-cervical-spine-fracture-detection
153 1
prepare.py
in mlebench/competitions/mlsp-2013-birds
143 2
grade.py
in mlebench/competitions/vinbigdata-chest-xray-abnormalities-detection
136 9
start.py
in agents/opendevin
134 3
config.yaml
in agents/aide
130 -
prepare.py
in mlebench/competitions/google-research-identify-contrails-reduce-global-warming
122 1
download_kernels.py
in extras/kernels
121 2
analyze.py
in extras/plagiarism_detector
118 4
prepare.py
in mlebench/competitions/tgs-salt-identification-challenge
113 1
prepare.py
in mlebench/competitions/iwildcam-2020-fgvc7
112 1
grade.py
in mlebench
110 4
prepare.py
in mlebench/competitions/smartphone-decimeter-2022
104 2
prepare.py
in mlebench/competitions/rsna-breast-cancer-detection
104 1
classes.py
in mlebench/competitions/leaf-classification
101 -
run.py
in agents
100 4
grade.py
in mlebench/competitions/siim-covid19-detection
98 4
prepare.py
in mlebench/competitions/hms-harmful-brain-activity-classification
98 1
prepare.py
in mlebench/competitions/siim-isic-melanoma-classification
97 1
prepare.py
in mlebench/competitions/icecube-neutrinos-in-deep-ice
96 1
prepare.py
in mlebench/competitions/cdiscount-image-classification-challenge
95 1
grade.py
in mlebench/competitions/jigsaw-unintended-bias-in-toxicity-classification
95 6
prepare.py
in mlebench/competitions/stanford-covid-vaccine
95 1
grade.py
in mlebench/competitions/uw-madison-gi-tract-image-segmentation
94 4
prepare.py
in mlebench/competitions/denoising-dirty-documents
93 2
grade.py
in mlebench/competitions/tgs-salt-identification-challenge
93 3
utils.py
in environment
90 5
prepare.py
in mlebench/competitions/text-normalization-challenge-russian-language
89 1
prepare.py
in mlebench/competitions/text-normalization-challenge-english-language
89 1
prepare.py
in mlebench/competitions/uw-madison-gi-tract-image-segmentation
89 2
prepare.py
in mlebench/competitions/vesuvius-challenge-ink-detection
89 1
prepare.py
in mlebench/competitions/vinbigdata-chest-xray-abnormalities-detection
86 1
grade.py
in mlebench/competitions/3d-object-detection-for-autonomous-vehicles
85 3
prepare.py
in mlebench/competitions/champs-scalar-coupling
84 1
prepare.py
in mlebench/competitions/cassava-leaf-disease-classification
84 1
make_submission.py
in experiments
84 1
vocabulary.py
in mlebench/competitions/freesound-audio-tagging-2019
83 -
prepare.py
in mlebench/competitions/tensorflow2-question-answering
82 2
prepare.py
in mlebench/competitions/iwildcam-2019-fgvc6
82 1
Correlations

File Size vs. Number of Changes: 5 points

experiments/aggregate_grading_reports.py x: 282 lines of code y: 1 # changes mlebench/cli.py x: 200 lines of code y: 1 # changes mlebench/registry.py x: 113 lines of code y: 2 # changes mlebench/competitions/the-icml-2013-whale-challenge-right-whale-redux/prepare.py x: 60 lines of code y: 1 # changes mlebench/data.py x: 275 lines of code y: 1 # changes
2.0
# changes
  min: 1.0
  average: 1.2
  25th percentile: 1.0
  median: 1.0
  75th percentile: 1.5
  max: 2.0
0 282.0
lines of code
min: 60.0 | average: 186.0 | 25th percentile: 86.5 | median: 200.0 | 75th percentile: 278.5 | max: 282.0

Number of Contributors vs. Number of Changes: 5 points

experiments/aggregate_grading_reports.py x: 1 # contributors y: 1 # changes mlebench/registry.py x: 2 # contributors y: 2 # changes
2.0
# changes
  min: 1.0
  average: 1.2
  25th percentile: 1.0
  median: 1.0
  75th percentile: 1.5
  max: 2.0
0 2.0
# contributors
min: 1.0 | average: 1.2 | 25th percentile: 1.0 | median: 1.0 | 75th percentile: 1.5 | max: 2.0

Number of Contributors vs. File Size: 5 points

experiments/aggregate_grading_reports.py x: 1 # contributors y: 282 lines of code mlebench/cli.py x: 1 # contributors y: 200 lines of code mlebench/registry.py x: 2 # contributors y: 113 lines of code mlebench/competitions/the-icml-2013-whale-challenge-right-whale-redux/prepare.py x: 1 # contributors y: 60 lines of code mlebench/data.py x: 1 # contributors y: 275 lines of code
282.0
lines of code
  min: 60.0
  average: 186.0
  25th percentile: 86.5
  median: 200.0
  75th percentile: 278.5
  max: 282.0
0 2.0
# contributors
min: 1.0 | average: 1.2 | 25th percentile: 1.0 | median: 1.0 | 75th percentile: 1.5 | max: 2.0

Number of Changes vs. Line Churn: 363 points

README.md x: 39 # changes y: 514 line churn runs/README.md x: 23 # changes y: 73 line churn runs/famou-agent_group7/grading_report_group_7.json x: 1 # changes y: 3 line churn runs/run_group_experiments.csv x: 23 # changes y: 91 line churn environment/Dockerfile x: 2 # changes y: 7 line churn runs/fmagent_group1/grading_report_group_1.json x: 2 # changes y: 6 line churn agents/README.md x: 2 # changes y: 4 line churn experiments/aggregate_grading_reports.py x: 1 # changes y: 361 line churn experiments/splits/all.txt x: 1 # changes y: 75 line churn runs/operand_group1/README.md x: 1 # changes y: 96 line churn experiments/splits/systemcard.txt x: 1 # changes y: 30 line churn environment/entrypoint.sh x: 1 # changes y: 2 line churn mlebench/cli.py x: 1 # changes y: 17 line churn mlebench/registry.py x: 2 # changes y: 17 line churn
514.0
line churn
  min: 2.0
  average: 8.01
  25th percentile: 3.0
  median: 3.0
  75th percentile: 6.0
  max: 514.0
0 39.0
# changes
min: 1.0 | average: 1.52 | 25th percentile: 1.0 | median: 1.0 | 75th percentile: 2.0 | max: 39.0

Number of Contributors vs. Line Churn: 5 points

experiments/aggregate_grading_reports.py x: 1 # contributors y: 361 line churn mlebench/cli.py x: 1 # contributors y: 17 line churn mlebench/registry.py x: 2 # contributors y: 17 line churn mlebench/competitions/the-icml-2013-whale-challenge-right-whale-redux/prepare.py x: 1 # contributors y: 2 line churn
361.0
line churn
  min: 2.0
  average: 79.8
  25th percentile: 2.0
  median: 17.0
  75th percentile: 189.0
  max: 361.0
0 2.0
# contributors
min: 1.0 | average: 1.2 | 25th percentile: 1.0 | median: 1.0 | 75th percentile: 1.5 | max: 2.0

File Size vs. Line Churn: 5 points

experiments/aggregate_grading_reports.py x: 282 lines of code y: 361 line churn mlebench/cli.py x: 200 lines of code y: 17 line churn mlebench/registry.py x: 113 lines of code y: 17 line churn mlebench/competitions/the-icml-2013-whale-challenge-right-whale-redux/prepare.py x: 60 lines of code y: 2 line churn mlebench/data.py x: 275 lines of code y: 2 line churn
361.0
line churn
  min: 2.0
  average: 79.8
  25th percentile: 2.0
  median: 17.0
  75th percentile: 189.0
  max: 361.0
0 282.0
lines of code
min: 60.0 | average: 186.0 | 25th percentile: 86.5 | median: 200.0 | 75th percentile: 278.5 | max: 282.0