huggingface / picotron Conditional Complexity

Intro

Conditional complexity (also called cyclomatic complexity) is a term used to measure the complexity of software. The term refers to the number of possible paths through a program function. A higher value ofter means higher maintenance and testing costs (infosecinstitute.com).
Conditional complexity is calculated by counting all conditions in the program that can affect the execution path (e.g. if statement, loops, switches, and/or operators, try and catch blocks...).
Conditional complexity is measured at the unit level (methods, functions...).
Units are classified in four categories based on the measured McCabe index: 1-5 (simple units), 6-10 (medium complex units), 11-25 (complex units), 26+ (very complex units).

Learn more...

Conditional Complexity Overall

There are 145 units with 1,578 lines of code in units (75.2% of code).

0 very complex units (0 lines of code)
0 complex units (0 lines of code)
7 medium complex units (275 lines of code)
15 simple units (294 lines of code)
123 very simple units (1,009 lines of code)

Legend:

51+

26-50

11-25

6-10

1-5

Alternative Visuals

3D view of all units

Conditional Complexity per Extension

51+

26-50

11-25

6-10

1-5

Conditional Complexity per Logical Component

primary logical decomposition

51+

26-50

11-25

6-10

1-5

Most Complex Units

Top 50 most complex units

Unit	# lines	McCabe index	# params
def train_step_pipeline_1f1b() in picotron/pipeline_parallel/pipeline_parallel.py	48	21	5
def adjust_tensor_size() in picotron/checkpoint.py	50	19	3
def __init__() in picotron/process_group_manager.py	38	19	5
def pipeline_communicate() in picotron/pipeline_parallel/pp_communications.py	25	15	5
def _initialize_buckets() in picotron/data_parallel/bucket.py	30	15	1
def submit_jobs() in submit_slurm_jobs.py	42	12	5
def init_model_with_materialized_weights() in picotron/checkpoint.py	42	11	3
def get_layer_names_in_sft_format() in picotron/checkpoint.py	29	10	1
def process_file() in extract_metrics.py	17	9	1
def bidirectional_pipeline_communicate() in picotron/pipeline_parallel/pp_communications.py	13	9	5
def backward() in picotron/context_parallel/context_parallel.py	45	9	3
def parse_folder_name() in extract_metrics.py	15	7	1
def train_step_pipeline_afab() in picotron/pipeline_parallel/pipeline_parallel.py	24	7	5
def wait() in picotron/context_parallel/cp_communications.py	12	7	1
def forward() in picotron/context_parallel/context_parallel.py	25	7	6
def from_readable_format() in extract_metrics.py	20	6	1
def __init__() in picotron/pipeline_parallel/pipeline_parallel.py	8	6	3
def init_model_with_dematerialized_weights() in picotron/checkpoint.py	23	6	1
def _make_param_hook() in picotron/data_parallel/data_parallel.py	12	6	3
def forward() in picotron/model.py	33	6	6
def __next__() in picotron/data.py	14	6	1
def __init__() in submit_slurm_jobs.py	4	6	3
def create_subdirectory_metrics() in extract_metrics.py	29	5	1
def ring_attention_backward() in picotron/context_parallel/context_parallel.py	16	5	8
def apply_tensor_parallel() in picotron/tensor_parallel/tensor_parallel.py	38	5	1
def to_readable_format() in picotron/utils.py	11	5	2
def get_num_params() in picotron/utils.py	11	5	1
def assert_no_meta_tensors() in picotron/utils.py	9	5	1
def download_model() in picotron/utils.py	13	5	2
def __init__() in picotron/data_parallel/bucket.py	8	5	4
def check_status() in submit_slurm_jobs.py	25	5	1
def aggregate_metrics() in extract_metrics.py	36	4	1
def reset_parameters() in picotron/pipeline_parallel/pipeline_parallel.py	11	4	1
def distribute_layers() in picotron/pipeline_parallel/pipeline_parallel.py	4	4	2
def backward() in picotron/pipeline_parallel/pipeline_parallel.py	6	4	4
def save_checkpoint() in picotron/checkpoint.py	12	4	6
def forward() in picotron/tensor_parallel/tp_communications.py	10	4	2
def get_cos_sin() in picotron/model.py	9	4	3
def __init__() in picotron/model.py	11	4	3
def __init__() in picotron/data.py	35	4	13
def train_step() in train.py	17	4	3
def read_requirements() in setup.py	3	4	0
def parse_log_line() in extract_metrics.py	10	3	1
def forward() in picotron/pipeline_parallel/pipeline_parallel.py	7	3	4
def load_checkpoint() in picotron/checkpoint.py	9	3	4
def send_recv() in picotron/context_parallel/cp_communications.py	12	3	3
def commit() in picotron/context_parallel/cp_communications.py	4	3	1
def forward() in picotron/tensor_parallel/tensor_parallel.py	8	3	2
def forward() in picotron/tensor_parallel/tensor_parallel.py	16	3	2
def set_all_seed() in picotron/utils.py	4	3	1