huggingface / llm_training_handbook Conditional Complexity

Intro

Conditional complexity (also called cyclomatic complexity) is a term used to measure the complexity of software. The term refers to the number of possible paths through a program function. A higher value ofter means higher maintenance and testing costs (infosecinstitute.com).
Conditional complexity is calculated by counting all conditions in the program that can affect the execution path (e.g. if statement, loops, switches, and/or operators, try and catch blocks...).
Conditional complexity is measured at the unit level (methods, functions...).
Units are classified in four categories based on the measured McCabe index: 1-5 (simple units), 6-10 (medium complex units), 11-25 (complex units), 26+ (very complex units).

Conditional Complexity Overall

Legend:

51+

26-50

11-25

6-10

1-5

Alternative Visuals

Conditional Complexity per Extension

51+

26-50

11-25

6-10

1-5

Conditional Complexity per Logical Component

primary logical decomposition

51+

26-50

11-25

6-10

1-5

Most Complex Units

Top 15 most complex units

Unit	# lines	McCabe index	# params
def __init__() in debug/NicerTrace.py	19	10	5
def globaltrace_lt() in debug/NicerTrace.py	22	8	4
def localtrace_trace_and_count() in debug/NicerTrace.py	15	5	4
def strip_py_dirs() in debug/NicerTrace.py	5	3	2
def timed_allreduce() in throughput/all_reduce_bench.py	14	3	2
def run() in throughput/all_reduce_bench.py	11	3	1
def write() in debug/NicerTrace.py	4	2	2
def flush() in debug/NicerTrace.py	3	2	1
def printflock() in debug/printflock.py	7	1	2
def __init__() in debug/NicerTrace.py	3	1	2
def __getattr__() in debug/NicerTrace.py	2	1	2
def main() in debug/NicerTrace.py	4	1	0
def print() in debug/torch-distributed-gpu-test.py	7	1	2
def printflock() in throughput/all_reduce_bench.py	7	1	1
def init_processes() in throughput/all_reduce_bench.py	4	1	3