huggingface / Math-Verify Conditional Complexity

Intro

Conditional complexity (also called cyclomatic complexity) is a term used to measure the complexity of software. The term refers to the number of possible paths through a program function. A higher value ofter means higher maintenance and testing costs (infosecinstitute.com).
Conditional complexity is calculated by counting all conditions in the program that can affect the execution path (e.g. if statement, loops, switches, and/or operators, try and catch blocks...).
Conditional complexity is measured at the unit level (methods, functions...).
Units are classified in four categories based on the measured McCabe index: 1-5 (simple units), 6-10 (medium complex units), 11-25 (complex units), 26+ (very complex units).

Learn more...

Conditional Complexity Overall

There are 64 units with 621 lines of code in units (37.5% of code).

0 very complex units (0 lines of code)
0 complex units (0 lines of code)
2 medium complex units (61 lines of code)
11 simple units (217 lines of code)
51 very simple units (343 lines of code)

Legend:

51+

26-50

11-25

6-10

1-5

Alternative Visuals

3D view of all units

Conditional Complexity per Extension

51+

26-50

11-25

6-10

1-5

Conditional Complexity per Logical Component

primary logical decomposition

51+

26-50

11-25

6-10

1-5

Most Complex Units

Top 50 most complex units

Unit	# lines	McCabe index	# params
def sympy_compare_symbols() in src/math_verify/grader.py	32	25	2
def extract_expr() in src/math_verify/parser.py	29	16	1
def unwrap_fcs() in src/math_verify/grader.py	14	10	1
def process_answers() in extract_answers.py	34	8	1
def timeout() in src/math_verify/utils.py	46	8	1
def compare_answers() in evaluate_model_outputs.py	11	8	2
def is_atomic_or_pct_atomic() in src/math_verify/grader.py	7	7	2
def is_assignment_relation() in src/math_verify/grader.py	8	7	1
def compare_single_extraction_wrapper() in src/math_verify/grader.py	17	7	2
def process_answers() in evaluate_model_outputs.py	52	7	2
def serialize_sympy_object() in extract_answers.py	9	6	1
def sympy_symbolic_eq() in src/math_verify/grader.py	10	6	2
def serialize_sympy_object() in evaluate_model_outputs.py	9	6	1
def get_last_eq() in src/math_verify/parser.py	6	5	1
def sympy_str_eq() in src/math_verify/grader.py	8	5	2
def is_relation() in src/math_verify/grader.py	6	5	1
def is_equation() in src/math_verify/grader.py	6	5	1
def load_csv_data() in extract_answers.py	9	4	1
def load_csv_data() in evaluate_model_outputs.py	9	4	1
def parse_latex_cached() in src/math_verify/parser.py	19	3	1
def math_hard_prompt_function() in src/math_verify/tasks.py	18	3	2
def math_prompt_function() in src/math_verify/tasks.py	18	3	2
def math_aime24_prompt_function() in src/math_verify/tasks.py	18	3	2
def math_amc23_prompt_function() in src/math_verify/tasks.py	18	3	2
def gsm8k_prompt_function() in src/math_verify/tasks.py	18	3	2
def main() in extract_answers.py	6	2	0
def extract_string() in src/math_verify/parser.py	6	2	2
def safe_sympy_doit() in src/math_verify/grader.py	6	2	1
def unwrap_eq() in src/math_verify/grader.py	4	2	1
def sort_key() in src/math_verify/grader.py	5	2	1
def are_flipped_inequalities_equal() in src/math_verify/grader.py	8	2	2
def take_last_relation() in src/math_verify/grader.py	4	2	1
def take_first_relation() in src/math_verify/grader.py	4	2	1
def main() in evaluate_model_outputs.py	6	2	0
def parse_args() in extract_answers.py	5	1	0
def math_metric() in src/math_verify/metric.py	5	1	1
def get_str_preds_with_timeout() in src/math_verify/metric.py	2	1	0
def sample_level_fn() in src/math_verify/metric.py	2	1	0
def lazy_string_regex() in src/math_verify/parser.py	2	1	0
def lazy_expr_regex() in src/math_verify/parser.py	2	1	0
def make_latex_env_pattern() in src/math_verify/parser.py	2	1	0
def lazy_latex_regex() in src/math_verify/parser.py	2	1	0
def get_extraction_regexes() in src/math_verify/parser.py	2	1	0
def parse_expr_cached() in src/math_verify/parser.py	2	1	1
def convert_to_pct() in src/math_verify/parser.py	2	1	1
def extract_latex() in src/math_verify/parser.py	2	1	0
def extract_match() in src/math_verify/parser.py	2	1	0
def extract_target_from_pred() in src/math_verify/parser.py	5	1	0
def parse() in src/math_verify/parser.py	9	1	2
def as_lighteval_metric() in src/math_verify/tasks.py	4	1	0