huggingface / bench_cluster Conditional Complexity

Intro

Conditional complexity (also called cyclomatic complexity) is a term used to measure the complexity of software. The term refers to the number of possible paths through a program function. A higher value ofter means higher maintenance and testing costs (infosecinstitute.com).
Conditional complexity is calculated by counting all conditions in the program that can affect the execution path (e.g. if statement, loops, switches, and/or operators, try and catch blocks...).
Conditional complexity is measured at the unit level (methods, functions...).
Units are classified in four categories based on the measured McCabe index: 1-5 (simple units), 6-10 (medium complex units), 11-25 (complex units), 26+ (very complex units).

Learn more...

Conditional Complexity Overall

There are 44 units with 1,037 lines of code in units (68.0% of code).

0 very complex units (0 lines of code)
0 complex units (0 lines of code)
8 medium complex units (405 lines of code)
14 simple units (390 lines of code)
22 very simple units (242 lines of code)

Legend:

51+

26-50

11-25

6-10

1-5

Alternative Visuals

3D view of all units

Conditional Complexity per Extension

51+

26-50

11-25

6-10

1-5

Conditional Complexity per Logical Component

primary logical decomposition

51+

26-50

11-25

6-10

1-5

Most Complex Units

Top 44 most complex units

Unit	# lines	McCabe index	# params
def parse_logs() in bench_cluster/report.py	107	21	2
def create_global_summary() in bench_cluster/report.py	70	21	2
def parse_profiler() in bench_cluster/report.py	43	20	1
def timed_p2p() in bench_cluster/communication/p2p.py	44	16	8
def run_all_to_all() in bench_cluster/communication/all_to_all.py	57	13	11
def find_combinations_within_global_batch_size_range() in bench_cluster/create_configs.py	21	12	6
def submit_jobs() in bench_cluster/submit_jobs.py	41	12	6
def get_promised_flop_per_sec() in bench_cluster/report.py	22	12	1
def is_enough_layers_for_pp() in bench_cluster/create_configs.py	35	10	2
def run_all_gather() in bench_cluster/communication/all_gather.py	52	10	11
def max_numel() in bench_cluster/communication/utils.py	16	10	4
def run_all_reduce() in bench_cluster/communication/all_reduce.py	42	9	11
def run_broadcast() in bench_cluster/communication/broadcast.py	40	9	11
def update_config_based_on_model() in bench_cluster/create_configs.py	40	8	2
def run_p2p() in bench_cluster/communication/p2p.py	37	8	11
def get_bw() in bench_cluster/communication/utils.py	24	7	4
def parse_range() in main.py	19	6	1
def timed_all_reduce() in bench_cluster/communication/all_reduce.py	20	6	8
def timed_broadcast() in bench_cluster/communication/broadcast.py	20	6	8
def timed_all_to_all() in bench_cluster/communication/all_to_all.py	20	6	9
def timed_all_gather() in bench_cluster/communication/all_gather.py	21	6	9
def __init__() in bench_cluster/submit_jobs.py	4	6	3
def _element_size() in bench_cluster/communication/utils.py	11	5	1
def create_slurm_script() in bench_cluster/submit_jobs.py	36	5	3
def check_status() in bench_cluster/submit_jobs.py	25	5	1
def parse_network() in bench_cluster/report.py	22	5	1
def report() in bench_cluster/report.py	11	5	6
def get_metric_strings() in bench_cluster/communication/utils.py	12	4	4
def units_to_float() in bench_cluster/report.py	9	4	1
def env2int() in bench_cluster/communication/utils.py	5	3	2
def __init__() in bench_cluster/submit_jobs.py	10	3	3
def get_status() in bench_cluster/submit_jobs.py	8	3	1
def keep_only_jobs() in bench_cluster/submit_jobs.py	2	3	2
def filter_out_jobs() in bench_cluster/submit_jobs.py	2	3	2
def launch_dependency() in bench_cluster/submit_jobs.py	9	3	3
def print_rank_0() in bench_cluster/communication/utils.py	3	2	1
def print_header() in bench_cluster/communication/utils.py	11	2	3
def convert_size() in bench_cluster/communication/utils.py	8	2	1
def create_single_config() in bench_cluster/create_configs.py	15	1	0
def create_configs() in bench_cluster/create_configs.py	15	1	0
def init_torch_distributed() in bench_cluster/communication/utils.py	6	1	2
def sync_all() in bench_cluster/communication/utils.py	3	1	0
def set_status() in bench_cluster/submit_jobs.py	5	1	2
def network_bench() in bench_cluster/network_bench.py	14	1	0