openai / simple-evals - Conditional Complexity

Intro

Conditional complexity (also called cyclomatic complexity) is a term used to measure the complexity of software. The term refers to the number of possible paths through a program function. A higher value ofter means higher maintenance and testing costs (infosecinstitute.com).
Conditional complexity is calculated by counting all conditions in the program that can affect the execution path (e.g. if statement, loops, switches, and/or operators, try and catch blocks...).
Conditional complexity is measured at the unit level (methods, functions...).
Units are classified in four categories based on the measured McCabe index: 1-5 (simple units), 6-10 (medium complex units), 11-25 (complex units), 26+ (very complex units).

Learn more...

Conditional Complexity Overall

There are 75 units with 1,053 lines of code in units (67.6% of code).

0 very complex units (0 lines of code)
0 complex units (0 lines of code)
2 medium complex units (324 lines of code)
8 simple units (213 lines of code)
65 very simple units (516 lines of code)

Legend:

51+

26-50

11-25

6-10

1-5

Alternative Visuals

3D view of all units

Conditional Complexity per Extension

51+

26-50

11-25

6-10

1-5

Conditional Complexity per Logical Component

primary logical decomposition

51+

26-50

11-25

6-10

1-5

Most Complex Units

Top 50 most complex units

Unit	# lines	McCabe index	# params
def main() in simple_evals.py	202	23	0
def main() in run_multilingual_mmlu.py	122	22	0
def __call__() in simpleqa_eval.py	52	8	2
def __call__() in drop_eval.py	46	8	2
def _match_numbers_if_present() in drop_eval.py	12	7	2
def answer_json_to_strings() in drop_eval.py	20	7	2
def __call__() in sampler/responses_sampler.py	32	7	2
def __call__() in sampler/chat_completion_sampler.py	24	7	2
def parse_answer() in mgsm_eval.py	6	6	2
def __call__() in sampler/o_chat_completion_sampler.py	21	6	2
def _align_bags() in drop_eval.py	11	5	2
def _compute_f1() in drop_eval.py	16	5	2
def __call__() in browsecomp_eval.py	37	5	2
def _compute_stat() in common.py	11	5	2
def _remove_punc() in drop_eval.py	5	4	1
def _normalize_answer() in drop_eval.py	8	4	1
def fuzzy_match() in drop_eval.py	6	4	2
def __call__() in gpqa_eval.py	36	4	2
def __init__() in mmlu_eval.py	10	4	3
def __call__() in mmlu_eval.py	30	4	2
def __call__() in mgsm_eval.py	34	4	2
def normalize_extracted_answer() in common.py	16	4	1
def __init__() in simpleqa_eval.py	11	3	4
def grade_sample() in simpleqa_eval.py	12	3	4
def normalize() in drop_eval.py	7	3	1
def drop_metric() in drop_eval.py	9	3	2
def __init__() in browsecomp_eval.py	11	3	4
def grade_sample() in browsecomp_eval.py	12	3	4
def get_lang_examples() in mgsm_eval.py	11	3	1
def get_all_examples() in mgsm_eval.py	7	3	0
def __call__() in sampler/claude_sampler.py	20	3	2
def _is_number() in drop_eval.py	6	2	1
def _normalize_number() in drop_eval.py	5	2	1
def __init__() in drop_eval.py	18	2	3
def decrypt() in browsecomp_eval.py	5	2	2
def __init__() in gpqa_eval.py	5	2	0
def score_mgsm() in mgsm_eval.py	6	2	2
def __init__() in mgsm_eval.py	4	2	0
def __call__() in math_eval.py	20	2	2
def map_with_progress() in common.py	6	2	3
def url_to_fileobj() in common.py	4	2	2
def __call__() in types.py	2	1	2
def __call__() in types.py	2	1	2
def _remove_articles() in drop_eval.py	3	1	1
def _white_space_fix() in drop_eval.py	2	1	1
def _lower() in drop_eval.py	2	1	1
def _tokenize() in drop_eval.py	2	1	1
def _answer_to_bags() in drop_eval.py	2	1	0
def get_drop_metrics() in drop_eval.py	2	1	0
def answer_json_to_string() in drop_eval.py	2	1	1