apache / datafusion-ballista - Conditional Complexity

Intro

Conditional complexity (also called cyclomatic complexity) is a term used to measure the complexity of software. The term refers to the number of possible paths through a program function. A higher value ofter means higher maintenance and testing costs (infosecinstitute.com).
Conditional complexity is calculated by counting all conditions in the program that can affect the execution path (e.g. if statement, loops, switches, and/or operators, try and catch blocks...).
Conditional complexity is measured at the unit level (methods, functions...).
Units are classified in four categories based on the measured McCabe index: 1-5 (simple units), 6-10 (medium complex units), 11-25 (complex units), 26+ (very complex units).

Learn more...

Conditional Complexity Overall

There are 358 units with 4,771 lines of code in units (20.8% of code).

0 very complex units (0 lines of code)
0 complex units (0 lines of code)
7 medium complex units (549 lines of code)
16 simple units (703 lines of code)
335 very simple units (3,519 lines of code)

Legend:

51+

26-50

11-25

6-10

1-5

Alternative Visuals

3D view of all units

Conditional Complexity per Extension

51+

26-50

11-25

6-10

1-5

Conditional Complexity per Logical Component

primary logical decomposition

51+

26-50

11-25

6-10

1-5

Most Complex Units

Top 50 most complex units

Unit	# lines	McCabe index	# params
def generate_changelog() in dev/release/generate-changelog.py	46	22	4
fn get_operator_name() in ballista/scheduler/src/state/execution_graph_dot.rs	123	22	1
fn build_exec_plan_diagram() in ballista/core/src/diagram.rs	73	16	5
def main() in dev/release/download-python-wheels.py	70	13	0
def main() in benchmarks/spark/src/main/scala/org/apache/arrow/SparkTpch.scala	68	11	1
fn processing_stages_update() in ballista/scheduler/src/state/execution_graph.rs	56	11	2
fn reset_stages_internal() in ballista/scheduler/src/state/execution_graph.rs	113	11	2
def tableSchema() in benchmarks/spark/src/main/scala/org/apache/arrow/SparkTpch.scala	83	10	1
fn write_plan_recursive() in ballista/scheduler/src/state/execution_graph_dot.rs	48	10	5
fn s3_object_store_builder() in ballista/core/src/object_store.rs	44	9	2
fn test_tolerance() in ballista/core/src/consistent_hash/mod.rs	44	8	0
fn start() in ballista/executor/src/executor_server.rs	125	8	4
fn update_stage_output_links() in ballista/scheduler/src/state/execution_graph.rs	39	7	5
fn pre_visit() in ballista/scheduler/src/state/execution_graph.rs	30	7	2
fn _generate() in ballista/scheduler/src/state/execution_graph_dot.rs	41	7	1
fn get_topology_nodes() in ballista/scheduler/src/cluster/memory.rs	34	7	3
fn get_position_key() in ballista/core/src/consistent_hash/mod.rs	28	7	3
def update_downstream_versions() in dev/update_datafusion_versions.py	15	6	2
def update_cargo_toml() in dev/update_ballista_versions.py	23	6	2
fn get_running_stage_id() in ballista/scheduler/src/state/execution_graph.rs	23	6	2
fn sanitize() in ballista/scheduler/src/state/execution_graph_dot.rs	24	6	2
fn plan_query_stages_internal() in ballista/scheduler/src/planner.rs	76	6	3
fn into() in ballista/core/src/serde/scheduler/from_proto.rs	26	6	1
private def readTable() in benchmarks/spark/src/main/scala/org/apache/arrow/SparkTpch.scala	31	5	5
def update_commit_dependencies() in dev/update_arrow_deps.py	8	5	2
def update_version_cargo_toml() in dev/update_arrow_deps.py	11	5	2
def main() in dev/update_arrow_deps.py	18	5	0
fn prepare_multi_task_definition() in ballista/scheduler/src/state/task_manager.rs	67	5	2
fn expire_dead_executors() in ballista/scheduler/src/scheduler_server/mod.rs	49	5	1
fn send_fetch_partitions() in ballista/core/src/execution_plans/shuffle_reader.rs	43	5	3
fn with_settings() in ballista/core/src/config.rs	16	5	1
def main() in dev/update_datafusion_versions.py	19	4	0
def main() in dev/update_ballista_versions.py	26	4	0
fn new_with_ballista() in ballista/core/src/extension.rs	42	4	0
fn try_into() in ballista/core/src/serde/scheduler/from_proto.rs	30	4	1
fn test_topology() in ballista/core/src/consistent_hash/mod.rs	24	4	0
fn read_partition() in ballista/executor/src/flight_service.rs	26	4	2
def ans_shape() in benchmarks/db-benchmark/groupby-datafusion.py	9	3	1
def ans_shape() in benchmarks/db-benchmark/join-datafusion.py	9	3	1
def print_pulls() in dev/release/generate-changelog.py	8	3	3
fn get_file_scan() in ballista/scheduler/src/state/execution_graph_dot.rs	32	3	1
fn from() in ballista/scheduler/src/state/task_manager.rs	17	3	1
fn get_result() in ballista/scheduler/src/cluster/mod.rs	13	3	1
fn to_key_value_pairs() in ballista/core/src/extension.rs	10	3	1
fn update_from_key_value_pair_mut() in ballista/core/src/extension.rs	27	3	2
fn into() in ballista/core/src/serde/scheduler/from_proto.rs	11	3	1
fn try_any() in ballista/core/src/serde/mod.rs	17	3	2
fn execute() in ballista/core/src/execution_plans/shuffle_writer.rs	52	3	3
fn execute() in ballista/core/src/execution_plans/shuffle_reader.rs	39	3	3
fn from() in ballista/core/src/error.rs	15	3	1