huggingface / ProcessBench Conditional Complexity

Intro

Conditional complexity (also called cyclomatic complexity) is a term used to measure the complexity of software. The term refers to the number of possible paths through a program function. A higher value ofter means higher maintenance and testing costs (infosecinstitute.com).
Conditional complexity is calculated by counting all conditions in the program that can affect the execution path (e.g. if statement, loops, switches, and/or operators, try and catch blocks...).
Conditional complexity is measured at the unit level (methods, functions...).
Units are classified in four categories based on the measured McCabe index: 1-5 (simple units), 6-10 (medium complex units), 11-25 (complex units), 26+ (very complex units).

Conditional Complexity Overall

Legend:

51+

26-50

11-25

6-10

1-5

Alternative Visuals

Conditional Complexity per Extension

51+

26-50

11-25

6-10

1-5

Conditional Complexity per Logical Component

primary logical decomposition

51+

26-50

11-25

6-10

1-5

Most Complex Units

Top 18 most complex units

Unit	# lines	McCabe index	# params
def main() in code/run_eval.py	79	25	0
def main() in code/run_eval_prm_rlhflow.py	50	14	0
def main() in code/run_eval_prm_trl.py	97	12	0
def precision_recall() in code/run_eval_prm_trl.py	11	5	2
def results_report() in code/run_eval_prm_trl.py	18	5	3
def __init__() in code/run_eval_prm_trl.py	9	4	3
def __next__() in code/run_eval_prm_trl.py	14	4	1
def f1_score() in code/run_eval_prm_trl.py	4	3	2
def extract_answer() in code/run_eval.py	6	2	1
def prepare_input_boxed() in code/run_eval.py	10	2	2
def get_texts() in code/run_eval_prm_trl.py	5	2	1
def read_results() in code/run_eval_prm_trl.py	6	2	1
def apply_chat_template() in code/run_eval.py	3	1	2
def __iter__() in code/run_eval_prm_trl.py	3	1	1
def get_total_batches() in code/run_eval_prm_trl.py	2	1	1
def process_results() in code/run_eval_prm_trl.py	4	1	0
def get_prediction_index() in code/run_eval_prm_trl.py	2	1	0
def obtain_results() in code/run_eval_prm_trl.py	3	1	0