huggingface / ioi Conditional Complexity

Intro

Conditional complexity (also called cyclomatic complexity) is a term used to measure the complexity of software. The term refers to the number of possible paths through a program function. A higher value ofter means higher maintenance and testing costs (infosecinstitute.com).
Conditional complexity is calculated by counting all conditions in the program that can affect the execution path (e.g. if statement, loops, switches, and/or operators, try and catch blocks...).
Conditional complexity is measured at the unit level (methods, functions...).
Units are classified in four categories based on the measured McCabe index: 1-5 (simple units), 6-10 (medium complex units), 11-25 (complex units), 26+ (very complex units).

Learn more...

Conditional Complexity Overall

There are 30 units with 431 lines of code in units (37.3% of code).

0 very complex units (0 lines of code)
0 complex units (0 lines of code)
1 medium complex units (37 lines of code)
9 simple units (180 lines of code)
20 very simple units (214 lines of code)

Legend:

51+

26-50

11-25

6-10

1-5

Alternative Visuals

3D view of all units

Conditional Complexity per Extension

51+

26-50

11-25

6-10

1-5

Conditional Complexity per Logical Component

primary logical decomposition

51+

26-50

11-25

6-10

1-5

Most Complex Units

Top 30 most complex units

Unit	# lines	McCabe index	# params
def simulate_round_robin() in run_tests/selection_simulator.py	37	13	1
def __init__() in generate/evaluate.py	38	9	17
def get_context_length() in generate/run_ioi_slurm.py	18	9	2
def get_context_length() in generate/get_context_length.py	16	8	1
def get_context_length() in generate/utils/get_context_length.py	16	8	1
def main() in generate/run_ioi_slurm.py	28	7	0
def _extract_single_status() in run_tests/scoring.py	16	7	2
def get_openrouter_usage_and_credits() in generate/utils/open_router_usage.py	21	6	0
def get_tp() in generate/run_ioi_slurm.py	13	6	2
def __init__() in run_tests/piston_client.py	14	6	4
def create_slurm_script() in generate/run_ioi_slurm.py	12	5	2
def get_slurm_piston_endpoints() in run_tests/piston_client.py	13	5	0
def get_problem_scores() in run_tests/selection_simulator.py	10	5	1
def add_includes() in run_tests/utils.py	10	5	2
def extract_code() in generate/evaluate.py	15	4	2
def get_model_name() in generate/evaluate.py	9	4	1
def get_submission_cot_length() in run_tests/selection_simulator.py	8	4	1
def get_piston_client_from_env() in run_tests/piston_client.py	8	3	1
def score() in run_tests/scoring.py	2	3	1
def weighted_score() in run_tests/scoring.py	2	3	1
def batched() in run_tests/utils.py	7	3	2
def get_dummy_response() in generate/evaluate.py	20	2	3
def session() in run_tests/piston_client.py	11	2	1
def status() in run_tests/scoring.py	3	2	1
def to_dict() in run_tests/scoring.py	11	2	1
def load_ioi_tests_for_year() in run_tests/utils.py	6	2	1
def main() in generate/evaluate.py	40	1	0
def get_concurrency() in generate/run_ioi_slurm.py	2	1	2
def parse_args() in generate/run_ioi_slurm.py	23	1	0
def load_ioi_tests() in run_tests/utils.py	2	1	2