openai / safety-rbr-code-and-data - Conditional Complexity

Intro

Conditional complexity (also called cyclomatic complexity) is a term used to measure the complexity of software. The term refers to the number of possible paths through a program function. A higher value ofter means higher maintenance and testing costs (infosecinstitute.com).
Conditional complexity is calculated by counting all conditions in the program that can affect the execution path (e.g. if statement, loops, switches, and/or operators, try and catch blocks...).
Conditional complexity is measured at the unit level (methods, functions...).
Units are classified in four categories based on the measured McCabe index: 1-5 (simple units), 6-10 (medium complex units), 11-25 (complex units), 26+ (very complex units).

Conditional Complexity Overall

Legend:

51+

26-50

11-25

6-10

1-5

Alternative Visuals

Conditional Complexity per Extension

51+

26-50

11-25

6-10

1-5

Conditional Complexity per Logical Component

primary logical decomposition

51+

26-50

11-25

6-10

1-5

Most Complex Units

Top 19 most complex units

Unit	# lines	McCabe index	# params
def get_orderings() in rbr_weight_fitter.py	18	7	1
def get_reward_model_scores() in cached_classes.py	11	4	5
def get_features() in cached_classes.py	11	4	5
def prepare_optimization() in rbr_weight_fitter.py	8	4	1
def fit_weights() in rbr_weight_fitter.py	19	4	1
def read_jsonl() in utils.py	11	4	1
def __init__() in cached_classes.py	5	3	2
def __init__() in cached_classes.py	6	3	1
def get_features() in base_classes.py	2	3	3
def get_reward_model_scores() in base_classes.py	2	3	3
def validate_examples() in rbr_weight_fitter.py	4	2	1
def zero_some_feature_weights() in rbr_weight_fitter.py	4	2	2
def to_string() in utils.py	4	2	1
def add_base_reward() in rbr_weight_fitter.py	2	1	2
def add_features() in rbr_weight_fitter.py	2	1	3
def __init__() in rbr_weight_fitter.py	23	1	13
def get_loss() in rbr_weight_fitter.py	6	1	6
def read_yaml() in utils.py	4	1	1
def get_colors() in utils.py	3	1	2