openai / mle-bench - Conditional Complexity

Intro

Conditional complexity (also called cyclomatic complexity) is a term used to measure the complexity of software. The term refers to the number of possible paths through a program function. A higher value ofter means higher maintenance and testing costs (infosecinstitute.com).
Conditional complexity is calculated by counting all conditions in the program that can affect the execution path (e.g. if statement, loops, switches, and/or operators, try and catch blocks...).
Conditional complexity is measured at the unit level (methods, functions...).
Units are classified in four categories based on the measured McCabe index: 1-5 (simple units), 6-10 (medium complex units), 11-25 (complex units), 26+ (very complex units).

Learn more...

Conditional Complexity Overall

There are 408 units with 9,001 lines of code in units (61.8% of code).

0 very complex units (0 lines of code)
2 complex units (358 lines of code)
29 medium complex units (2,324 lines of code)
67 simple units (2,666 lines of code)
310 very simple units (3,653 lines of code)

Legend:

51+

26-50

11-25

6-10

1-5

Alternative Visuals

3D view of all units

Conditional Complexity per Extension

51+

26-50

11-25

6-10

1-5

Conditional Complexity per Logical Component

primary logical decomposition

51+

26-50

11-25

6-10

1-5

Most Complex Units

Top 50 most complex units

Unit	# lines	McCabe index	# params
def prepare() in mlebench/competitions/3d-object-detection-for-autonomous-vehicles/prepare.py	316	33	3
def calculate_map() in mlebench/competitions/siim-covid19-detection/grade.py	42	29	2
def prepare() in mlebench/competitions/rsna-2022-cervical-spine-fracture-detection/prepare.py	148	24	3
def prepare() in mlebench/competitions/mlsp-2013-birds/prepare.py	124	22	3
def prepare_for_metric() in mlebench/competitions/tensorflow2-question-answering/grade.py	74	22	2
def main() in mlebench/cli.py	190	17	0
def prepare() in mlebench/competitions/google-research-identify-contrails-reduce-global-warming/prepare.py	112	17	3
def prepare_for_metric() in mlebench/competitions/lmsys-chatbot-arena/grade.py	31	17	2
def prepare() in mlebench/competitions/smartphone-decimeter-2022/prepare.py	83	16	3
def rank_score() in mlebench/grade_helpers.py	72	15	3
def prepare() in mlebench/competitions/cdiscount-image-classification-challenge/prepare.py	88	15	3
def process_submission() in extras/plagiarism_detector/analyze.py	52	14	3
def prepare() in mlebench/competitions/kuzushiji-recognition/prepare.py	51	14	3
def prepare() in mlebench/competitions/cassava-leaf-disease-classification/prepare.py	78	14	3
def prepare() in mlebench/competitions/iwildcam-2020-fgvc7/prepare.py	103	13	3
def prepare() in mlebench/competitions/statoil-iceberg-classifier-challenge/prepare.py	73	13	3
def prepare() in mlebench/competitions/rsna-breast-cancer-detection/prepare.py	70	13	3
def prepare() in mlebench/competitions/ventilator-pressure-prediction/prepare.py	41	13	3
def hausdorff_distance() in mlebench/competitions/uw-madison-gi-tract-image-segmentation/grade.py	21	13	2
def download_kernels() in extras/kernels/download_kernels.py	65	12	1
def prepare() in mlebench/competitions/herbarium-2021-fgvc8/prepare.py	167	12	3
def prepare() in mlebench/competitions/herbarium-2020-fgvc7/prepare.py	167	12	3
def prepare() in mlebench/competitions/tgs-salt-identification-challenge/prepare.py	109	12	3
def prepare() in mlebench/competitions/random-acts-of-pizza/prepare.py	52	12	3
def prepare() in mlebench/competitions/siim-covid19-detection/prepare.py	56	11	3
def grade() in mlebench/competitions/3d-object-detection-for-autonomous-vehicles/grade.py	34	11	2
def prepare_for_metric() in mlebench/competitions/osic-pulmonary-fibrosis-progression/grade.py	35	11	2
def prepare() in mlebench/competitions/nomad2018-predict-transparent-conductors/prepare.py	49	11	3
def prepare() in mlebench/competitions/freesound-audio-tagging-2019/prepare.py	46	11	3
def prepare() in mlebench/competitions/whale-categorization-playground/prepare.py	62	11	3
def prepare() in mlebench/competitions/uw-madison-gi-tract-image-segmentation/prepare.py	71	11	3
def __init__() in mlebench/competitions/3d-object-detection-for-autonomous-vehicles/mAP_evaluation.py	38	10	2
def prepare_for_metric() in mlebench/competitions/icecube-neutrinos-in-deep-ice/grade.py	40	10	2
def prepare() in mlebench/competitions/osic-pulmonary-fibrosis-progression/prepare.py	62	10	3
def prepare() in mlebench/competitions/denoising-dirty-documents/prepare.py	69	10	3
def grade() in mlebench/competitions/stanford-covid-vaccine/grade.py	40	10	2
def prepare() in mlebench/competitions/herbarium-2022-fgvc9/prepare.py	147	10	3
def get_per_comp_performance() in experiments/familiarity/familiarity.py	20	10	1
def is_dataset_prepared() in mlebench/data.py	26	9	2
def recall_precision() in mlebench/competitions/3d-object-detection-for-autonomous-vehicles/mAP_evaluation.py	42	9	3
def prepare() in mlebench/competitions/iwildcam-2019-fgvc6/prepare.py	76	9	3
def prepare() in mlebench/competitions/dogs-vs-cats-redux-kernels-edition/prepare.py	46	9	3
def score_page() in mlebench/competitions/kuzushiji-recognition/kuzushiji_metric.py	51	9	2
def kuzushiji_f1() in mlebench/competitions/kuzushiji-recognition/kuzushiji_metric.py	19	9	2
def prepare_for_metric() in mlebench/competitions/inaturalist-2019-fgvc6/grade.py	16	9	2
def prepare() in mlebench/competitions/tensorflow2-question-answering/prepare.py	72	9	3
def grade() in mlebench/competitions/tgs-salt-identification-challenge/grade.py	40	9	2
def prepare() in mlebench/competitions/alaska2-image-steganalysis/prepare.py	55	9	3
def prepare_for_metric() in mlebench/competitions/hms-harmful-brain-activity-classification/grade.py	20	8	2
def prepare() in mlebench/competitions/AI4Code/prepare.py	28	8	3