huggingface / yourbench Conditional Complexity

Intro

Conditional complexity (also called cyclomatic complexity) is a term used to measure the complexity of software. The term refers to the number of possible paths through a program function. A higher value ofter means higher maintenance and testing costs (infosecinstitute.com).
Conditional complexity is calculated by counting all conditions in the program that can affect the execution path (e.g. if statement, loops, switches, and/or operators, try and catch blocks...).
Conditional complexity is measured at the unit level (methods, functions...).
Units are classified in four categories based on the measured McCabe index: 1-5 (simple units), 6-10 (medium complex units), 11-25 (complex units), 26+ (very complex units).

Learn more...

Conditional Complexity Overall

There are 117 units with 1,924 lines of code in units (62.4% of code).

0 very complex units (0 lines of code)
1 complex units (177 lines of code)
11 medium complex units (466 lines of code)
26 simple units (564 lines of code)
79 very simple units (717 lines of code)

Legend:

51+

26-50

11-25

6-10

1-5

Alternative Visuals

3D view of all units

Conditional Complexity per Extension

51+

26-50

11-25

6-10

1-5

Conditional Complexity per Logical Component

primary logical decomposition

51+

26-50

11-25

6-10

1-5

Most Complex Units

Top 50 most complex units

Unit	# lines	McCabe index	# params
def run() in yourbench/pipeline/lighteval.py	177	40	2
def create_model_config() in yourbench/main.py	85	25	1
def write_env_file() in yourbench/main.py	33	17	2
def run() in yourbench/pipeline/summarization.py	49	15	2
def _serialize_config_for_card() in yourbench/utils/dataset_engine.py	26	15	2
def _create_cross_document_dataset() in yourbench/utils/dataset_engine.py	44	14	3
def run_multi_hop() in yourbench/pipeline/question_generation.py	41	11	2
def parse_qa_pairs_from_response() in yourbench/utils/parsing_engine.py	20	11	1
def parse_single_shot_responses() in yourbench/utils/parsing_engine.py	52	11	3
def _resolve_organization() in yourbench/utils/dataset_engine.py	19	11	2
def _generate_and_upload_dataset_card() in yourbench/utils/dataset_engine.py	55	11	3
def configure_model_roles() in yourbench/main.py	42	11	1
def run() in yourbench/pipeline/ingestion.py	35	10	2
def _best_effort_json_extract() in yourbench/utils/parsing_engine.py	15	9	1
def parse_multi_hop_responses() in yourbench/utils/parsing_engine.py	46	9	3
def run() in yourbench/pipeline/chunking.py	32	8	2
def run() in yourbench/pipeline/upload_ingest_to_hub.py	33	8	2
def _log_individual_call() in yourbench/utils/inference/inference_tracking.py	16	8	5
def configure_question_generation() in yourbench/main.py	32	8	2
def compute() in yourbench/pipeline/citation_score_filtering.py	10	7	4
def _initialize_markdown_processor() in yourbench/pipeline/ingestion.py	27	7	2
def _build_combine_calls() in yourbench/pipeline/summarization.py	20	7	1
def _load_models() in yourbench/utils/inference/inference_core.py	25	7	3
def build_multi_hop_inference_calls() in yourbench/utils/inference/inference_builders.py	27	7	3
def __post_init__() in yourbench/utils/question_models.py	18	7	1
def run_analysis() in yourbench/analysis/__init__.py	16	7	3
def validate_api_key_format() in yourbench/main.py	8	7	1
def run() in yourbench/pipeline/citation_score_filtering.py	37	6	2
def _get_markdown_content() in yourbench/pipeline/ingestion.py	20	6	2
def run_single_shot() in yourbench/pipeline/question_generation.py	32	6	2
def extract_content_from_xml_tags() in yourbench/utils/parsing_engine.py	14	6	2
def normalize_open_ended() in yourbench/utils/parsing_engine.py	14	6	2
def _expand_env_vars() in yourbench/utils/loading_engine.py	8	6	1
def _count_message_tokens() in yourbench/utils/inference/inference_tracking.py	13	6	3
def _extract_settings() in yourbench/utils/dataset_engine.py	20	6	2
def _validate_repo() in yourbench/utils/dataset_engine.py	13	6	1
def _load_hub() in yourbench/utils/dataset_engine.py	13	6	3
def run() in yourbench/analysis/view_sample_questions.py	20	6	1
def _plot_pipeline_stage_timing() in yourbench/pipeline/handler.py	19	5	0
def _maybe_strip_triple_backticks() in yourbench/utils/parsing_engine.py	11	5	1
def shuffle_mcq() in yourbench/utils/parsing_engine.py	18	5	1
def load() in yourbench/utils/loading_engine.py	19	5	1
def _merge_datasets() in yourbench/utils/dataset_engine.py	8	5	3
def upload_dataset_card() in yourbench/utils/dataset_engine.py	14	5	2
def _extract_markdown_from_html() in yourbench/pipeline/ingestion.py	19	4	1
def chunk_document() in yourbench/pipeline/chunking.py	5	4	3
def _collect_markdown_files() in yourbench/pipeline/upload_ingest_to_hub.py	22	4	1
def normalize_multi_choice() in yourbench/utils/parsing_engine.py	15	4	2
def _write_aggregate_log() in yourbench/utils/inference/inference_tracking.py	15	4	0
def build_single_shot_inference_calls() in yourbench/utils/inference/inference_builders.py	21	4	4