openai / mle-bench
File Change Frequency

File change frequency (churn) shows the distribution of file updates (days with at least one commit).

Overview
File Change Frequency Overall
  • There are 5 files with 698 lines of code.
    • 0 files changed more than 100 times (0 lines of code)
    • 0 files changed 51-100 times (0 lines of code)
    • 0 files changed 21-50 times (0 lines of code)
    • 0 files changed 6-20 times (0 lines of code)
    • 5 files changed 1-5 times (698 lines of code)
0% | 0% | 0% | 0% | 100%
Legend:
101+
51-100
21-50
6-20
1-5

explore: grouped by folders | grouped by update frequency | data
Contributors Count Frequency Overall
  • There are 5 files with 698 lines of code.
    • 0 files changed by more than 25 contributors (0 lines of code)
    • 0 files changed by 11-25 contributors (0 lines of code)
    • 0 files changed by 6-10 contributors (0 lines of code)
    • 1 file changed by 2-5 contributors (113 lines of code)
    • 4 files changed by 1 contributor (585 lines of code)
0% | 0% | 0% | 16% | 83%
Legend:
26+
11-25
6-10
2-5
1

explore: grouped by folders | grouped by contributors count | data
File Change Frequency per File Extension
py, md, yaml, json, txt, sh, gitignore, gitattributes, mjs, dockerignore, toml
File Change Frequency per Extension
The number of recorded file updates
101+
51-100
21-50
6-20
1-5
py0% | 0% | 0% | 0% | 100%
toml0% | 0% | 0% | 0% | 100%
mjs0% | 0% | 0% | 0% | 0%
yaml0% | 0% | 0% | 0% | 0%
File Change Frequency per Logical Decomposition
primary
primary (file change frequency)
The number of recorded file updates
101+
51-100
21-50
6-20
1-5
mlebench0% | 0% | 0% | 0% | 100%
ROOT0% | 0% | 0% | 0% | 100%
extras0% | 0% | 0% | 0% | 0%
agents0% | 0% | 0% | 0% | 0%
experiments0% | 0% | 0% | 0% | 0%
environment0% | 0% | 0% | 0% | 0%
Most Frequently Changed Files (Top 50)

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
registry.py
in mlebench
 113 10 2024-11-28 2025-01-06 2 2 giulio.starace@gmail.com 129281094+james-aung@users....
50 - 2025-04-14 2025-04-14 1 1 giulio.starace@gmail.com giulio.starace@gmail.com
prepare.py
in mlebench/competitions/the-icml-2013-whale-challenge-right-whale-redux
 60 1 2024-11-28 2024-11-28 1 1 giulio.starace@gmail.com giulio.starace@gmail.com
cli.py
in mlebench
 200 1 2025-01-06 2025-01-06 1 1 129281094+james-aung@users.... 129281094+james-aung@users....
data.py
in mlebench
 275 14 2024-10-14 2024-10-14 1 1 aiden.jongseob@gmail.com aiden.jongseob@gmail.com
__init__.py
in environment
 1 -
classes.py
in mlebench/competitions/jigsaw-toxic-comment-classification-challenge
 1 -
classes.py
in mlebench/competitions/spooky-author-identification
 1 -
__init__.py
in mlebench/competitions
 1 -
__init__.py
in mlebench
 1 -
prepare.py
in agents/mlagentbench/benchmark_dir/scripts
 1 -
dogs.py
in mlebench/competitions/dog-breed-identification
 3 -
config.yaml
in agents/dummy
 3 -
defaults.py
in environment
 4 -
checksums.yaml
in mlebench/competitions/movie-review-sentiment-analysis-kernels-only
 5 -
checksums.yaml
in mlebench/competitions/billion-word-imputation
 5 -
checksums.yaml
in mlebench/competitions/alaska2-image-steganalysis
 5 -
checksums.yaml
in mlebench/competitions/the-icml-2013-whale-challenge-right-whale-redux
 5 -
checksums.yaml
in mlebench/competitions/invasive-species-monitoring
 5 -
checksums.yaml
in mlebench/competitions/text-normalization-challenge-russian-language
 5 -
checksums.yaml
in mlebench/competitions/statoil-iceberg-classifier-challenge
 5 -
checksums.yaml
in mlebench/competitions/text-normalization-challenge-english-language
 5 -
checksums.yaml
in mlebench/competitions/dogs-vs-cats-redux-kernels-edition
 5 -
checksums.yaml
in mlebench/competitions/mlsp-2013-birds
 5 -
checksums.yaml
in mlebench/competitions/ml2021spring-hw2
 5 -
checksums.yaml
in mlebench/competitions/plant-seedlings-classification
 5 -
checksums.yaml
in mlebench/competitions/denoising-dirty-documents
 5 -
checksums.yaml
in mlebench/competitions/herbarium-2020-fgvc7
 5 -
checksums.yaml
in mlebench/competitions/tensorflow-speech-recognition-challenge
 5 -
checksums.yaml
in mlebench/competitions/smartphone-decimeter-2022
 5 -
checksums.yaml
in mlebench/competitions/herbarium-2021-fgvc8
 5 -
templates.py
in agents/opendevin
 5 -
grade.py
in mlebench/competitions/tabular-playground-series-may-2022
 6 1
checksums.yaml
in mlebench/competitions/whale-categorization-playground
 6 -
checksums.yaml
in mlebench/competitions/plant-pathology-2021-fgvc8
 6 -
checksums.yaml
in mlebench/competitions/histopathologic-cancer-detection
 6 -
checksums.yaml
in mlebench/competitions/aerial-cactus-identification
 6 -
checksums.yaml
in mlebench/competitions/paddy-disease-classification
 6 -
checksums.yaml
in mlebench/competitions/predict-volcanic-eruptions-ingv-oe
 6 -
checksums.yaml
in mlebench/competitions/seti-breakthrough-listen
 6 -
checksums.yaml
in mlebench/competitions/3d-object-detection-for-autonomous-vehicles
 6 -
checksums.yaml
in mlebench/competitions/dog-breed-identification
 6 -
checksums.yaml
in mlebench/competitions/vesuvius-challenge-ink-detection
 6 -
checksums.yaml
in mlebench/competitions/hotel-id-2021-fgvc8
 6 -
checksums.yaml
in mlebench/competitions/rsna-miccai-brain-tumor-radiogenomic-classification
 6 -
checksums.yaml
in mlebench/competitions/uw-madison-gi-tract-image-segmentation
 7 -
checksums.yaml
in mlebench/competitions/chaii-hindi-and-tamil-question-answering
 7 -
checksums.yaml
in mlebench/competitions/jigsaw-unintended-bias-in-toxicity-classification
 7 -
checksums.yaml
in mlebench/competitions/lmsys-chatbot-arena
 7 -
checksums.yaml
in mlebench/competitions/ventilator-pressure-prediction
 7 -
Files With Most Contributors (Top 50)
Based on the number of unique email addresses found in commits.

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
registry.py
in mlebench
 113 10 2024-11-28 2025-01-06 2 2 giulio.starace@gmail.com 129281094+james-aung@users....
50 - 2025-04-14 2025-04-14 1 1 giulio.starace@gmail.com giulio.starace@gmail.com
data.py
in mlebench
 275 14 2024-10-14 2024-10-14 1 1 aiden.jongseob@gmail.com aiden.jongseob@gmail.com
cli.py
in mlebench
 200 1 2025-01-06 2025-01-06 1 1 129281094+james-aung@users.... 129281094+james-aung@users....
prepare.py
in mlebench/competitions/the-icml-2013-whale-challenge-right-whale-redux
 60 1 2024-11-28 2024-11-28 1 1 giulio.starace@gmail.com giulio.starace@gmail.com
203 -
run.py
in extras/rule_violation_detector
 42 -
analyze.py
in extras/rule_violation_detector
 232 3
prompts.py
in extras/rule_violation_detector
 28 -
57 1
download_kernels.py
in extras/kernels
 121 2
run.py
in extras/plagiarism_detector
 30 -
mjs
dolos_wrapper.mjs
in extras/plagiarism_detector
 32 -
analyze.py
in extras/plagiarism_detector
 118 4
templates.py
in agents/opendevin
 5 -
setup.py
in agents/opendevin
 39 -
config.yaml
in agents/opendevin
 13 -
start.py
in agents/opendevin
 134 3
utils.py
in agents/opendevin
 18 1
run.py
in agents
 100 4
registry.py
in agents
 78 4
main.py
in agents/dummy
 19 -
config.yaml
in agents/dummy
 3 -
prepare.py
in agents/mlagentbench/benchmark_dir/scripts
 1 -
train.py
in agents/mlagentbench/benchmark_dir/env
 8 -
config.yaml
in agents/mlagentbench
 20 -
config.yaml
in agents/aide
 130 -
utils.py
in agents
 22 3
__init__.py
in mlebench
 1 -
grade_helpers.py
in mlebench
 171 7
metrics.py
in mlebench
 29 3
prepare.py
in mlebench/competitions/petfinder-pawpularity-score
 55 1
checksums.yaml
in mlebench/competitions/petfinder-pawpularity-score
 7 -
config.yaml
in mlebench/competitions/petfinder-pawpularity-score
 19 -
grade.py
in mlebench/competitions/petfinder-pawpularity-score
 29 2
prepare.py
in mlebench/competitions/ranzcr-clip-catheter-line-classification
 37 1
checksums.yaml
in mlebench/competitions/ranzcr-clip-catheter-line-classification
 7 -
classes.py
in mlebench/competitions/ranzcr-clip-catheter-line-classification
 11 -
config.yaml
in mlebench/competitions/ranzcr-clip-catheter-line-classification
 27 -
grade.py
in mlebench/competitions/ranzcr-clip-catheter-line-classification
 25 1
prepare.py
in mlebench/competitions/hms-harmful-brain-activity-classification
 98 1
checksums.yaml
in mlebench/competitions/hms-harmful-brain-activity-classification
 8 -
constants.py
in mlebench/competitions/hms-harmful-brain-activity-classification
 9 -
kaggle_metric_utilities.py
in mlebench/competitions/hms-harmful-brain-activity-classification
 56 3
config.yaml
in mlebench/competitions/hms-harmful-brain-activity-classification
 24 -
grade.py
in mlebench/competitions/hms-harmful-brain-activity-classification
 28 2
kullback_leibler_divergence.py
in mlebench/competitions/hms-harmful-brain-activity-classification
 60 2
prepare.py
in mlebench/competitions/rsna-miccai-brain-tumor-radiogenomic-classification
 35 1
checksums.yaml
in mlebench/competitions/rsna-miccai-brain-tumor-radiogenomic-classification
 6 -
config.yaml
in mlebench/competitions/rsna-miccai-brain-tumor-radiogenomic-classification
 29 -
Files With Least Contributors (Top 50)
Based on the number of unique email addresses found in commits.

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
prepare.py
in mlebench/competitions/3d-object-detection-for-autonomous-vehicles
 324 1
analyze.py
in extras/rule_violation_detector
 232 3
mAP_evaluation.py
in mlebench/competitions/3d-object-detection-for-autonomous-vehicles
 215 18
familiarity.py
in experiments/familiarity
 213 5
203 -
prepare.py
in mlebench/competitions/inaturalist-2019-fgvc6
 203 2
utils.py
in mlebench
 190 21
prepare.py
in mlebench/competitions/herbarium-2021-fgvc8
 176 1
prepare.py
in mlebench/competitions/herbarium-2020-fgvc7
 176 1
grade_helpers.py
in mlebench
 171 7
utils.py
in mlebench/competitions
 167 9
prepare.py
in mlebench/competitions/herbarium-2022-fgvc9
 156 1
prepare.py
in mlebench/competitions/rsna-2022-cervical-spine-fracture-detection
 153 1
prepare.py
in mlebench/competitions/mlsp-2013-birds
 143 2
grade.py
in mlebench/competitions/vinbigdata-chest-xray-abnormalities-detection
 136 9
start.py
in agents/opendevin
 134 3
config.yaml
in agents/aide
 130 -
prepare.py
in mlebench/competitions/google-research-identify-contrails-reduce-global-warming
 122 1
download_kernels.py
in extras/kernels
 121 2
analyze.py
in extras/plagiarism_detector
 118 4
prepare.py
in mlebench/competitions/tgs-salt-identification-challenge
 113 1
prepare.py
in mlebench/competitions/iwildcam-2020-fgvc7
 112 1
grade.py
in mlebench
 110 4
prepare.py
in mlebench/competitions/smartphone-decimeter-2022
 104 2
prepare.py
in mlebench/competitions/rsna-breast-cancer-detection
 104 1
classes.py
in mlebench/competitions/leaf-classification
 101 -
run.py
in agents
 100 4
prepare.py
in mlebench/competitions/hms-harmful-brain-activity-classification
 98 1
grade.py
in mlebench/competitions/siim-covid19-detection
 98 4
prepare.py
in mlebench/competitions/siim-isic-melanoma-classification
 97 1
prepare.py
in mlebench/competitions/icecube-neutrinos-in-deep-ice
 96 1
prepare.py
in mlebench/competitions/cdiscount-image-classification-challenge
 95 1
prepare.py
in mlebench/competitions/stanford-covid-vaccine
 95 1
grade.py
in mlebench/competitions/jigsaw-unintended-bias-in-toxicity-classification
 95 6
grade.py
in mlebench/competitions/uw-madison-gi-tract-image-segmentation
 94 4
prepare.py
in mlebench/competitions/denoising-dirty-documents
 93 2
grade.py
in mlebench/competitions/tgs-salt-identification-challenge
 93 3
utils.py
in environment
 90 5
prepare.py
in mlebench/competitions/vesuvius-challenge-ink-detection
 89 1
prepare.py
in mlebench/competitions/text-normalization-challenge-english-language
 89 1
prepare.py
in mlebench/competitions/text-normalization-challenge-russian-language
 89 1
prepare.py
in mlebench/competitions/uw-madison-gi-tract-image-segmentation
 89 2
prepare.py
in mlebench/competitions/vinbigdata-chest-xray-abnormalities-detection
 86 1
grade.py
in mlebench/competitions/3d-object-detection-for-autonomous-vehicles
 85 3
prepare.py
in mlebench/competitions/champs-scalar-coupling
 84 1
prepare.py
in mlebench/competitions/cassava-leaf-disease-classification
 84 1
make_submission.py
in experiments
 84 1
vocabulary.py
in mlebench/competitions/freesound-audio-tagging-2019
 83 -
prepare.py
in mlebench/competitions/iwildcam-2019-fgvc6
 82 1
prepare.py
in mlebench/competitions/tensorflow2-question-answering
 82 2
Correlations

File Size vs. Number of Changes: 5 points

pyproject.toml x: 50 lines of code y: 1 # changes mlebench/cli.py x: 200 lines of code y: 1 # changes mlebench/registry.py x: 113 lines of code y: 2 # changes mlebench/competitions/the-icml-2013-whale-challenge-right-whale-redux/prepare.py x: 60 lines of code y: 1 # changes mlebench/data.py x: 275 lines of code y: 1 # changes
2.0
# changes
  min: 1.0
  average: 1.2
  25th percentile: 1.0
  median: 1.0
  75th percentile: 1.5
  max: 2.0
0 275.0
lines of code
min: 50.0 | average: 139.6 | 25th percentile: 55.0 | median: 113.0 | 75th percentile: 237.5 | max: 275.0

Number of Contributors vs. Number of Changes: 5 points

pyproject.toml x: 1 # contributors y: 1 # changes mlebench/registry.py x: 2 # contributors y: 2 # changes
2.0
# changes
  min: 1.0
  average: 1.2
  25th percentile: 1.0
  median: 1.0
  75th percentile: 1.5
  max: 2.0
0 2.0
# contributors
min: 1.0 | average: 1.2 | 25th percentile: 1.0 | median: 1.0 | 75th percentile: 1.5 | max: 2.0

Number of Contributors vs. File Size: 5 points

pyproject.toml x: 1 # contributors y: 50 lines of code mlebench/cli.py x: 1 # contributors y: 200 lines of code mlebench/registry.py x: 2 # contributors y: 113 lines of code mlebench/competitions/the-icml-2013-whale-challenge-right-whale-redux/prepare.py x: 1 # contributors y: 60 lines of code mlebench/data.py x: 1 # contributors y: 275 lines of code
275.0
lines of code
  min: 50.0
  average: 139.6
  25th percentile: 55.0
  median: 113.0
  75th percentile: 237.5
  max: 275.0
0 2.0
# contributors
min: 1.0 | average: 1.2 | 25th percentile: 1.0 | median: 1.0 | 75th percentile: 1.5 | max: 2.0