huggingface / dataset-dedupe-estimator Conditional Complexity

Intro

Conditional complexity (also called cyclomatic complexity) is a term used to measure the complexity of software. The term refers to the number of possible paths through a program function. A higher value ofter means higher maintenance and testing costs (infosecinstitute.com).
Conditional complexity is calculated by counting all conditions in the program that can affect the execution path (e.g. if statement, loops, switches, and/or operators, try and catch blocks...).
Conditional complexity is measured at the unit level (methods, functions...).
Units are classified in four categories based on the measured McCabe index: 1-5 (simple units), 6-10 (medium complex units), 11-25 (complex units), 26+ (very complex units).

Learn more...

Conditional Complexity Overall

There are 38 units with 490 lines of code in units (34.6% of code).

0 very complex units (0 lines of code)
0 complex units (0 lines of code)
1 medium complex units (28 lines of code)
3 simple units (92 lines of code)
34 very simple units (370 lines of code)

Legend:

51+

26-50

11-25

6-10

1-5

Alternative Visuals

3D view of all units

Conditional Complexity per Extension

51+

26-50

11-25

6-10

1-5

Conditional Complexity per Logical Component

primary logical decomposition

51+

26-50

11-25

6-10

1-5

Most Complex Units

Top 38 most complex units

Unit	# lines	McCabe index	# params
def generate_data() in de/synthetic.py	28	14	3
def param_impact() in de/cli.py	54	8	4
fn interpolate_sample() in src/show.rs	29	6	2
def get_page_chunk_sizes() in de/fileutils.py	9	6	1
fn generate_color_sequence() in src/show.rs	35	4	1
def checkout_file_revisions() in de/fileutils.py	46	4	2
def update_rows() in de/synthetic.py	11	4	5
def write_and_compare_json() in de/synthetic.py	15	4	4
def write_and_compare_sqlite() in de/synthetic.py	17	4	4
def pretty_print_stats() in de/cli.py	23	3	1
def revisions() in de/cli.py	5	3	2
def page_chunks() in de/cli.py	26	3	1
def delete_rows() in de/synthetic.py	10	3	4
def insert_rows() in de/synthetic.py	9	3	4
def convert_dedupe_images_to_png() in de/synthetic.py	8	3	1
fn estimate() in src/lib.rs	13	2	1
def rewrite_to_parquet() in de/fileutils.py	17	2	4
def pyarrow_has_cdc() in de/cli.py	11	2	0
def cli() in de/cli.py	4	2	0
def rewrite() in de/cli.py	5	2	1
def render_readme() in de/cli.py	5	2	1
fn getcolor() in src/show.rs	3	1	1
def rewrite_to_jsonlines() in de/fileutils.py	3	1	3
def rewrite_to_sqlite() in de/fileutils.py	3	1	3
def synthetic() in de/cli.py	12	1	0
def stats() in de/cli.py	16	1	0
def dedup() in de/cli.py	10	1	1
def calculate_parameter_impact() in de/cli.py	2	1	0
def estimate_de() in de/estimate.py	8	1	1
def estimate_xtool() in de/estimate.py	23	1	1
def __init__() in de/synthetic.py	3	1	3
def generate_table() in de/synthetic.py	2	1	2
def append_rows() in de/synthetic.py	3	1	3
def generate_synthetic_tables() in de/synthetic.py	7	1	3
def __init__() in de/synthetic.py	4	1	3
def generate_table() in de/synthetic.py	5	1	2
def write_parquet() in de/synthetic.py	4	1	3
def write_and_compare_parquet() in de/synthetic.py	2	1	0