huggingface / alignment-handbook Conditional Complexity

Intro

Conditional complexity (also called cyclomatic complexity) is a term used to measure the complexity of software. The term refers to the number of possible paths through a program function. A higher value ofter means higher maintenance and testing costs (infosecinstitute.com).
Conditional complexity is calculated by counting all conditions in the program that can affect the execution path (e.g. if statement, loops, switches, and/or operators, try and catch blocks...).
Conditional complexity is measured at the unit level (methods, functions...).
Units are classified in four categories based on the measured McCabe index: 1-5 (simple units), 6-10 (medium complex units), 11-25 (complex units), 26+ (very complex units).

Learn more...

Conditional Complexity Overall

There are 30 units with 733 lines of code in units (31.4% of code).

0 very complex units (0 lines of code)
1 complex units (158 lines of code)
4 medium complex units (417 lines of code)
2 simple units (14 lines of code)
23 very simple units (144 lines of code)

Legend:

51+

26-50

11-25

6-10

1-5

Alternative Visuals

3D view of all units

Conditional Complexity per Extension

51+

26-50

11-25

6-10

1-5

Conditional Complexity per Logical Component

primary logical decomposition

51+

26-50

11-25

6-10

1-5

Most Complex Units

Top 30 most complex units

Unit	# lines	McCabe index	# params
def main() in scripts/run_orpo.py	158	27	0
def main() in scripts/run_dpo.py	155	23	0
def main() in scripts/run_cpt.py	109	21	0
def parse_yaml_and_args() in src/alignment/configs.py	28	19	3
def main() in scripts/run_sft.py	125	19	0
def parse() in src/alignment/configs.py	10	8	1
def is_openai_format() in src/alignment/data.py	4	6	1
def maybe_insert_system_message() in src/alignment/data.py	8	5	2
def load_dataset_column() in src/alignment/decontaminate.py	4	4	4
def get_quantization_config() in src/alignment/model_utils.py	19	4	1
def is_adapter_model() in src/alignment/model_utils.py	6	4	2
def pre_release_work() in src/alignment/release.py	15	3	1
def __post_init__() in src/alignment/configs.py	3	3	1
def extract_docstring() in src/alignment/decontaminate.py	13	2	1
def human_eval_docstrings() in src/alignment/decontaminate.py	4	2	0
def global_version_update() in src/alignment/release.py	3	2	2
def post_release_work() in src/alignment/release.py	9	2	0
def get_current_device() in src/alignment/model_utils.py	2	2	0
def get_kbit_device_map() in src/alignment/model_utils.py	2	2	0
def get_peft_config() in src/alignment/model_utils.py	13	2	1
def get_checkpoint() in src/alignment/model_utils.py	5	2	1
def deps_list() in setup.py	2	2	1
def normalize_whitespace() in src/alignment/decontaminate.py	2	1	1
def decontaminate_humaneval() in src/alignment/decontaminate.py	2	1	0
def update_version_in_file() in src/alignment/release.py	8	1	3
def get_version() in src/alignment/release.py	5	1	0
def apply_chat_template() in src/alignment/data.py	5	1	0
def get_datasets() in src/alignment/data.py	6	1	0
def mix_datasets() in src/alignment/data.py	6	1	0
def get_tokenizer() in src/alignment/model_utils.py	2	1	0