huggingface / text-generation-inference Conditional Complexity

Intro

Conditional complexity (also called cyclomatic complexity) is a term used to measure the complexity of software. The term refers to the number of possible paths through a program function. A higher value ofter means higher maintenance and testing costs (infosecinstitute.com).
Conditional complexity is calculated by counting all conditions in the program that can affect the execution path (e.g. if statement, loops, switches, and/or operators, try and catch blocks...).
Conditional complexity is measured at the unit level (methods, functions...).
Units are classified in four categories based on the measured McCabe index: 1-5 (simple units), 6-10 (medium complex units), 11-25 (complex units), 26+ (very complex units).

Learn more...

Conditional Complexity Overall

There are 2,995 units with 39,132 lines of code in units (39.9% of code).

0 very complex units (0 lines of code)
7 complex units (1,302 lines of code)
60 medium complex units (4,400 lines of code)
144 simple units (4,388 lines of code)
2,784 very simple units (29,042 lines of code)

Legend:

51+

26-50

11-25

6-10

1-5

Alternative Visuals

3D view of all units

Conditional Complexity per Extension

51+

26-50

11-25

6-10

1-5

Conditional Complexity per Logical Component

primary logical decomposition

51+

26-50

11-25

6-10

1-5

Most Complex Units

Top 50 most complex units

Unit	# lines	McCabe index	# params
fn shard_manager() in launcher/src/main.rs	246	42	33
def concatenate() in backends/gaudi/server/text_generation_server/models/seq2seq_lm.py	178	32	2
def prepare_for_prefill() in server/text_generation_server/models/flash_causal_lm.py	184	32	1
def concatenate() in server/text_generation_server/models/seq2seq_lm.py	178	32	2
fn main() in launcher/src/main.rs	275	30	0
def concatenate() in server/text_generation_server/models/causal_lm.py	153	30	2
def prefill() in backends/neuron/server/text_generation_server/generator.py	88	27	2
def get_weights_row() in server/text_generation_server/layers/gptq/__init__.py	86	22	3
def find_params() in backends/gaudi/server/text_generation_server/layers/gptq/quantize.py	78	21	3
fn spawn_webserver() in launcher/src/main.rs	164	21	7
def concatenate() in server/text_generation_server/models/flash_causal_lm.py	220	21	2
def find_params() in server/text_generation_server/layers/gptq/quantize.py	78	21	3
fn resolve_attention() in launcher/src/main.rs	64	20	2
def get_weights_row() in backends/gaudi/server/text_generation_server/layers/gptq/__init__.py	74	19	3
def static() in backends/gaudi/server/text_generation_server/layers/rotary.py	119	18	5
def __init__() in server/text_generation_server/models/custom_modeling/mpt_modeling.py	67	18	4
def forward() in server/text_generation_server/layers/fp8.py	58	18	2
fn next_batch() in backends/v2/src/queue.rs	114	17	5
def _rope_scaling_validation() in backends/gaudi/server/text_generation_server/models/custom_modeling/flash_phi_moe_modeling.py	60	17	1
fn download_convert_model() in launcher/src/main.rs	108	17	7
def _rope_scaling_validation() in server/text_generation_server/models/custom_modeling/flash_phi_moe_modeling.py	60	17	1
fn build_backend() in backends/trtllm/build.rs	74	16	3
def generate_token() in server/text_generation_server/models/mamba.py	165	16	2
def get_multi_weights_col() in server/text_generation_server/layers/gptq/__init__.py	60	16	4
def get_multi_weights_col() in backends/gaudi/server/text_generation_server/layers/gptq/__init__.py	54	15	4
def get_multi_weights() in backends/gaudi/server/text_generation_server/layers/gptq/__init__.py	49	15	4
fn image_tokens() in router/src/validation.rs	144	15	4
def forward() in server/text_generation_server/models/custom_modeling/idefics_modeling.py	75	15	3
def get_multi_weights_col() in server/text_generation_server/layers/fp8.py	56	15	4
def static() in server/text_generation_server/layers/rotary.py	111	15	5
def get_weights() in server/text_generation_server/layers/gptq/__init__.py	67	15	3
def _get_quantizer_config() in backends/gaudi/server/text_generation_server/utils/quantization.py	67	14	2
def warmup_hpu_graph() in backends/gaudi/server/text_generation_server/models/mllama_causal_lm.py	101	14	2
def warmup_hpu_graph() in backends/gaudi/server/text_generation_server/models/flash_causal_lm.py	100	14	2
def _get_quantizer_config() in server/text_generation_server/utils/quantization.py	67	14	2
def filter() in server/text_generation_server/models/idefics_causal_lm.py	92	14	2
def get_multi_weights_col() in server/text_generation_server/layers/compressed_tensors/w8an_fp.py	42	14	4
fn executor_status_looper() in backends/trtllm/src/looper.rs	90	13	4
def get_multi_weights_col() in backends/gaudi/server/text_generation_server/layers/fp8.py	51	13	4
def get_multi_weights() in backends/gaudi/server/text_generation_server/layers/fp8.py	51	13	4
def prepare_for_prefill() in server/text_generation_server/models/vlm_causal_lm.py	54	13	1
def make_tokenizer_optional() in backends/gaudi/server/text_generation_server/utils/tokens.py	59	12	1
def gather_vision_embeds() in backends/gaudi/server/text_generation_server/models/flash_vlm_causal_lm.py	50	12	1
def get_weights() in backends/gaudi/server/text_generation_server/layers/gptq/__init__.py	51	12	3
def filter() in server/text_generation_server/models/flash_causal_lm.py	157	12	2
def gather_vision_embeds() in server/text_generation_server/models/vlm_causal_lm.py	50	12	1
def concatenate() in server/text_generation_server/models/mamba.py	95	12	2
def forward() in server/text_generation_server/layers/linear.py	32	12	2
def __init__() in server/text_generation_server/layers/gptq/exllama.py	45	12	3
def forward() in server/text_generation_server/layers/layernorm.py	70	12	3