huggingface / optimum-benchmark Conditional Complexity

Intro

Conditional complexity (also called cyclomatic complexity) is a term used to measure the complexity of software. The term refers to the number of possible paths through a program function. A higher value ofter means higher maintenance and testing costs (infosecinstitute.com).
Conditional complexity is calculated by counting all conditions in the program that can affect the execution path (e.g. if statement, loops, switches, and/or operators, try and catch blocks...).
Conditional complexity is measured at the unit level (methods, functions...).
Units are classified in four categories based on the measured McCabe index: 1-5 (simple units), 6-10 (medium complex units), 11-25 (complex units), 26+ (very complex units).

Learn more...

Conditional Complexity Overall

There are 493 units with 4,581 lines of code in units (62.7% of code).

0 very complex units (0 lines of code)
1 complex units (92 lines of code)
21 medium complex units (842 lines of code)
34 simple units (705 lines of code)
437 very simple units (2,942 lines of code)

Legend:

51+

26-50

11-25

6-10

1-5

Alternative Visuals

3D view of all units

Conditional Complexity per Extension

51+

26-50

11-25

6-10

1-5

Conditional Complexity per Logical Component

primary logical decomposition

51+

26-50

11-25

6-10

1-5

Most Complex Units

Top 50 most complex units

Unit	# lines	McCabe index	# params
def monitor_gpu_vram_memory() in optimum_benchmark/trackers/memory.py	92	28	3
def run() in optimum_benchmark/scenarios/inference/scenario.py	93	25	2
def __post_init__() in optimum_benchmark/backends/config.py	66	22	1
def __post_init__() in optimum_benchmark/backends/onnxruntime/config.py	28	20	1
def launch() in optimum_benchmark/launchers/torchrun/launcher.py	48	17	4
def launch() in optimum_benchmark/launchers/process/launcher.py	39	15	4
def aggregate_across_processes() in optimum_benchmark/trackers/memory.py	27	15	1
def extract_timm_shapes_from_config() in optimum_benchmark/backends/timm_utils.py	35	15	1
def load_transformers_model() in optimum_benchmark/backends/pytorch/backend.py	50	15	1
def get_gpu_device_ids() in optimum_benchmark/system_utils.py	41	15	0
def quantize_onnx_files() in optimum_benchmark/backends/onnxruntime/backend.py	68	14	1
def trtllm_kwargs() in optimum_benchmark/backends/tensorrt_llm/backend.py	29	14	1
def assert_device_isolation() in optimum_benchmark/launchers/device_isolation_utils.py	36	13	3
def get_gpus() in optimum_benchmark/system_utils.py	36	12	0
def __init__() in optimum_benchmark/trackers/energy.py	53	11	6
def __post_init__() in optimum_benchmark/benchmark/report.py	11	11	1
def aggregate_across_processes() in optimum_benchmark/benchmark/report.py	21	11	1
def __post_init__() in optimum_benchmark/backends/py_txi/config.py	11	11	1
def txi_kwargs() in optimum_benchmark/backends/py_txi/backend.py	23	11	1
def run() in optimum_benchmark/scenarios/energy_star/scenario.py	61	11	2
def __post_init__() in optimum_benchmark/scenarios/inference/config.py	32	11	1
def get_gpu_vram_mb() in optimum_benchmark/system_utils.py	34	11	0
def get_amd_devices_pids() in optimum_benchmark/launchers/device_isolation_utils.py	31	10	1
def get_flat_artifact_dict() in optimum_benchmark/backends/transformers_utils.py	18	10	2
def ortmodel_kwargs() in optimum_benchmark/backends/onnxruntime/backend.py	21	10	1
def __post_init__() in optimum_benchmark/backends/tensorrt_llm/config.py	15	10	1
def __post_init__() in optimum_benchmark/backends/vllm/config.py	25	9	1
def tgi_kwargs() in optimum_benchmark/backends/py_txi/backend.py	19	9	1
def __post_init__() in optimum_benchmark/backends/pytorch/config.py	25	9	1
def __post_init__() in optimum_benchmark/scenarios/energy_star/config.py	25	9	1
def run_text_generation_tracking() in optimum_benchmark/scenarios/energy_star/scenario.py	41	9	1
def __post_init__() in optimum_benchmark/launchers/config.py	19	8	1
def preprocess_function() in optimum_benchmark/preprocessors/dataset_preprocessor.py	13	8	3
def aggregate_across_processes() in optimum_benchmark/trackers/energy.py	11	8	1
def __init__() in optimum_benchmark/trackers/memory.py	33	8	6
def monitor_cpu_ram_memory() in optimum_benchmark/trackers/memory.py	20	8	2
def load() in optimum_benchmark/backends/onnxruntime/backend.py	31	8	1
def __init__() in optimum_benchmark/backends/pytorch/backend.py	24	8	2
def automodel_kwargs() in optimum_benchmark/backends/pytorch/backend.py	18	8	1
def normalize_records() in optimum_benchmark/profilers/ort_profiler.py	20	8	1
def run() in optimum_benchmark/scenarios/training/scenario.py	57	8	2
def entrypoint() in optimum_benchmark/launchers/torchrun/launcher.py	31	7	4
def onnx_files_names() in optimum_benchmark/backends/onnxruntime/backend.py	10	7	1
def prepare_inputs() in optimum_benchmark/backends/onnxruntime/backend.py	11	7	3
def is_exllamav2() in optimum_benchmark/backends/pytorch/backend.py	16	7	1
def ovmodel_kwargs() in optimum_benchmark/backends/openvino/backend.py	15	7	1
def get_hf_libs_info() in optimum_benchmark/import_utils.py	17	7	0
def global_tracking() in optimum_benchmark/scenarios/inference/scenario.py	16	7	2
def aggregate_across_processes() in optimum_benchmark/trackers/latency.py	8	6	1
def to_plain_text() in optimum_benchmark/trackers/memory.py	13	6	1