huggingface / datasets Conditional Complexity

Intro

Conditional complexity (also called cyclomatic complexity) is a term used to measure the complexity of software. The term refers to the number of possible paths through a program function. A higher value ofter means higher maintenance and testing costs (infosecinstitute.com).
Conditional complexity is calculated by counting all conditions in the program that can affect the execution path (e.g. if statement, loops, switches, and/or operators, try and catch blocks...).
Conditional complexity is measured at the unit level (methods, functions...).
Units are classified in four categories based on the measured McCabe index: 1-5 (simple units), 6-10 (medium complex units), 11-25 (complex units), 26+ (very complex units).

Learn more...

Conditional Complexity Overall

There are 1,447 units with 12,085 lines of code in units (59.3% of code).

2 very complex units (324 lines of code)
10 complex units (789 lines of code)
67 medium complex units (2,265 lines of code)
119 simple units (2,047 lines of code)
1,249 very simple units (6,660 lines of code)

Legend:

51+

26-50

11-25

6-10

1-5

Alternative Visuals

3D view of all units

Conditional Complexity per Extension

51+

26-50

11-25

6-10

1-5

Conditional Complexity per Logical Component

primary logical decomposition

51+

26-50

11-25

6-10

1-5

Most Complex Units

Top 50 most complex units

Unit	# lines	McCabe index	# params
def _cast_to_python_objects() in src/datasets/features/features.py	157	70	3
def _iter() in src/datasets/iterable_dataset.py	167	69	1
def _split_generators() in src/datasets/packaged_modules/folder_based_builder/folder_based_builder.py	159	46	2
def _iter_arrow() in src/datasets/iterable_dataset.py	83	34	1
def _iter_arrow() in src/datasets/iterable_dataset.py	66	31	2
def save_code() in src/datasets/utils/_dill.py	119	31	2
def _arrow_to_datasets_dtype() in src/datasets/features/features.py	60	29	1
def __arrow_array__() in src/datasets/arrow_writer.py	93	29	2
def _single_map_nested() in src/datasets/utils/py_utils.py	33	28	1
def _generate_examples() in src/datasets/packaged_modules/folder_based_builder/folder_based_builder.py	53	28	5
def _to_yaml_list() in src/datasets/features/features.py	48	26	1
def _read_metadata() in src/datasets/packaged_modules/folder_based_builder/folder_based_builder.py	75	26	3
def _from_yaml_list() in src/datasets/features/features.py	56	25	2
def _generate_tables() in src/datasets/packaged_modules/json/json.py	71	24	2
def get_module() in src/datasets/load.py	135	24	1
def string_to_arrow() in src/datasets/features/features.py	126	22	1
def decode_nested_example() in src/datasets/features/features.py	34	22	6
def _generate_tables() in src/datasets/packaged_modules/text/text.py	40	22	2
def subsplit() in src/datasets/splits.py	41	21	5
def _tensorize() in src/datasets/formatting/torch_formatter.py	29	21	2
def _infer_custom_type_and_encode() in src/datasets/arrow_writer.py	20	21	1
def __iter__() in src/datasets/utils/tf_utils.py	75	20	1
def _tensorize() in src/datasets/formatting/jax_formatter.py	32	19	2
def _tensorize() in src/datasets/formatting/np_formatter.py	25	18	2
def encode_example() in src/datasets/features/audio.py	40	18	6
def _get_data_files_patterns() in src/datasets/data_files.py	33	18	2
def convert_file_size_to_int() in src/datasets/utils/py_utils.py	29	17	2
def asdict() in src/datasets/utils/py_utils.py	22	17	1
def encode_nested_example() in src/datasets/features/features.py	28	17	3
def sanitize_patterns() in src/datasets/data_files.py	28	17	3
def from_tables() in src/datasets/table.py	47	17	4
def get_module() in src/datasets/load.py	81	17	1
def _iter_pytorch() in src/datasets/iterable_dataset.py	51	16	1
def _fingerprint() in src/datasets/fingerprint.py	41	16	1
def generate_from_dict() in src/datasets/features/features.py	21	16	1
def encode_example() in src/datasets/features/video.py	29	16	7
def write_examples_on_file() in src/datasets/arrow_writer.py	28	16	1
def save() in src/datasets/utils/_dill.py	30	15	3
def _tensorize() in src/datasets/formatting/tf_formatter.py	22	15	2
def _check_if_features_can_be_aligned() in src/datasets/features/features.py	14	15	1
def __post_init__() in src/datasets/arrow_reader.py	12	15	1
def _split_generators() in src/datasets/packaged_modules/webdataset/webdataset.py	42	15	2
def __iter__() in src/datasets/iterable_dataset.py	31	14	1
def temp_seed() in src/datasets/utils/py_utils.py	39	14	3
def _save_code() in src/datasets/utils/_dill.py	71	14	2
def to_dataset_card_data() in src/datasets/info.py	33	14	2
def pd_read_csv_kwargs() in src/datasets/packaged_modules/csv/csv.py	55	14	1
def _generate_tables() in src/datasets/packaged_modules/parquet/parquet.py	31	14	2
def embed_array_storage() in src/datasets/table.py	28	14	3
def __iter__() in src/datasets/iterable_dataset.py	31	13	1