huggingface / picotron_tutorial Conditional Complexity

Intro

Conditional complexity (also called cyclomatic complexity) is a term used to measure the complexity of software. The term refers to the number of possible paths through a program function. A higher value ofter means higher maintenance and testing costs (infosecinstitute.com).
Conditional complexity is calculated by counting all conditions in the program that can affect the execution path (e.g. if statement, loops, switches, and/or operators, try and catch blocks...).
Conditional complexity is measured at the unit level (methods, functions...).
Units are classified in four categories based on the measured McCabe index: 1-5 (simple units), 6-10 (medium complex units), 11-25 (complex units), 26+ (very complex units).

Learn more...

Conditional Complexity Overall

There are 363 units with 3,414 lines of code in units (70.2% of code).

0 very complex units (0 lines of code)
2 complex units (56 lines of code)
5 medium complex units (161 lines of code)
20 simple units (416 lines of code)
336 very simple units (2,781 lines of code)

Legend:

51+

26-50

11-25

6-10

1-5

Alternative Visuals

3D view of all units

Conditional Complexity per Extension

51+

26-50

11-25

6-10

1-5

Conditional Complexity per Logical Component

primary logical decomposition

51+

26-50

11-25

6-10

1-5

Most Complex Units

Top 50 most complex units

Unit	# lines	McCabe index	# params
def pipeline_communicate() in step7_pipeline_parallel_afab/pipeline_parallel.py	28	26	5
def pipeline_communicate() in step8_pipeline_parallel_1f1b/pipeline_parallel.py	28	26	5
def _initialize_buckets() in step7_pipeline_parallel_afab/data_parallel.py	30	15	1
def _initialize_buckets() in step8_pipeline_parallel_1f1b/data_parallel.py	30	15	1
def _initialize_buckets() in step6_data_parallel_bucket/data_parallel.py	30	15	1
def bidirectional_pipeline_communicate() in step8_pipeline_parallel_1f1b/pipeline_parallel.py	23	14	5
def train_step_pipeline_1f1b() in step8_pipeline_parallel_1f1b/pipeline_parallel.py	48	12	5
def __init__() in step7_pipeline_parallel_afab/process_group_manager.py	28	10	4
def __init__() in step5_data_parallel_naive/process_group_manager.py	28	10	4
def __init__() in step2_process_group_manager/process_group_manager.py	28	10	4
def __init__() in step8_pipeline_parallel_1f1b/process_group_manager.py	28	10	4
def __init__() in step3_dataloader/process_group_manager.py	28	10	4
def __init__() in step4_tensor_parallel/process_group_manager.py	28	10	4
def __init__() in step6_data_parallel_bucket/process_group_manager.py	28	10	4
def _make_param_hook() in step7_pipeline_parallel_afab/data_parallel.py	12	6	3
def to_readable_format() in step7_pipeline_parallel_afab/utils.py	17	6	2
def train_step_pipeline_afab() in step7_pipeline_parallel_afab/pipeline_parallel.py	24	6	5
def to_readable_format() in step5_data_parallel_naive/utils.py	17	6	2
def to_readable_format() in step2_process_group_manager/utils.py	17	6	2
def _make_param_hook() in step8_pipeline_parallel_1f1b/data_parallel.py	12	6	3
def to_readable_format() in step8_pipeline_parallel_1f1b/utils.py	17	6	2
def train_step_pipeline_afab() in step8_pipeline_parallel_1f1b/pipeline_parallel.py	24	6	5
def to_readable_format() in step1_modeling/utils.py	17	6	2
def to_readable_format() in step3_dataloader/utils.py	17	6	2
def to_readable_format() in step4_tensor_parallel/utils.py	17	6	2
def _make_param_hook() in step6_data_parallel_bucket/data_parallel.py	12	6	3
def to_readable_format() in step6_data_parallel_bucket/utils.py	17	6	2
def __init__() in step7_pipeline_parallel_afab/data_parallel.py	8	5	4
def apply_tensor_parallel() in step7_pipeline_parallel_afab/tensor_parallel.py	38	5	1
def __init__() in step7_pipeline_parallel_afab/pipeline_parallel.py	7	5	3
def apply_tensor_parallel() in step5_data_parallel_naive/tensor_parallel.py	38	5	1
def __init__() in step8_pipeline_parallel_1f1b/data_parallel.py	8	5	4
def apply_tensor_parallel() in step8_pipeline_parallel_1f1b/tensor_parallel.py	38	5	1
def __init__() in step8_pipeline_parallel_1f1b/pipeline_parallel.py	7	5	3
def apply_tensor_parallel() in step4_tensor_parallel/tensor_parallel.py	38	5	1
def __init__() in step6_data_parallel_bucket/data_parallel.py	8	5	4
def apply_tensor_parallel() in step6_data_parallel_bucket/tensor_parallel.py	38	5	1
def train_step() in step7_pipeline_parallel_afab/train.py	17	4	3
def forward() in step7_pipeline_parallel_afab/tensor_parallel.py	10	4	2
def reset_parameters() in step7_pipeline_parallel_afab/tensor_parallel.py	12	4	1
def reset_parameters() in step7_pipeline_parallel_afab/tensor_parallel.py	12	4	1
def backward() in step7_pipeline_parallel_afab/pipeline_parallel.py	6	4	4
def train_step() in step5_data_parallel_naive/train.py	17	4	3
def forward() in step5_data_parallel_naive/tensor_parallel.py	10	4	2
def reset_parameters() in step5_data_parallel_naive/tensor_parallel.py	12	4	1
def reset_parameters() in step5_data_parallel_naive/tensor_parallel.py	12	4	1
def train_step() in step8_pipeline_parallel_1f1b/train.py	17	4	3
def forward() in step8_pipeline_parallel_1f1b/tensor_parallel.py	10	4	2
def reset_parameters() in step8_pipeline_parallel_1f1b/tensor_parallel.py	12	4	1
def reset_parameters() in step8_pipeline_parallel_1f1b/tensor_parallel.py	12	4	1