G

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

32% duplication:

2,531 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
819 duplicated lines

49 duplicates

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
04-module-working-with-online-store/custom_library (61%) --> utilities (4%)	134	2 file pairs	details...
05-module-scalable-batch-ingestion/scripts (36%) --> utilities (2%)	88	3 file pairs	details...
06-module-automated-pipeline (12%) --> utilities (1%)	56	2 file pairs	details...

Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 20 longest duplicates.

See data for all 49 duplicates...

Size	#	Folders	Files	Lines	Code
33	x 2	utilities utilities	Utils.py feature_store_helper.py	499:533 (6%) 1695:1729 (3%)	view
31	x 2	utilities utilities	feature_store_helper.py feature_store_helper.py	332:368 (3%) 473:509 (3%)	view
22	x 2	utilities utilities	feature_store_helper.py feature_store_helper.py	269:330 (2%) 427:471 (2%)	view
20	x 2	06-module-automated-pipeline utilities	pipeline_utils.py feature_store_helper.py	244:269 (10%) 998:1023 (1%)	view
18	x 2	utilities utilities	Utils.py feature_store_helper.py	616:633 (3%) 1810:1827 (1%)	view
17	x 2	utilities utilities	Utils.py Utils.py	396:418 (3%) 425:447 (3%)	view
15	x 2	utilities utilities	Utils.py feature_store_helper.py	562:578 (3%) 1758:1774 (1%)	view
15	x 2	utilities utilities	Utils.py Utils.py	429:446 (3%) 466:483 (3%)	view
15	x 2	utilities utilities	Utils.py Utils.py	400:417 (3%) 466:483 (3%)	view
13	x 2	04-module-working-with-online-store/custom_library utilities	helper.py Utils.py	72:86 (11%) 274:288 (2%)	view
12	x 2	utilities utilities	Utils.py feature_store_helper.py	588:601 (2%) 1783:1796 (1%)	view
11	x 2	utilities utilities	Utils.py feature_store_helper.py	199:211 (2%) 1194:1206 (1%)	view
11	x 2	utilities utilities	Utils.py feature_store_helper.py	74:87 (2%) 677:690 (1%)	view
11	x 2	05-module-scalable-batch-ingestion/scripts utilities	batch_ingest_sm_pyspark.py batch_ingest_sm_pyspark_top.py	35:47 (15%) 35:46 (34%)	view
10	x 2	04-module-working-with-online-store/custom_library utilities	helper.py feature_store_helper.py	75:86 (9%) 818:829 (<1%)	view
10	x 2	utilities utilities	Utils.py feature_store_helper.py	277:288 (2%) 818:829 (<1%)	view
10	x 2	05-module-scalable-batch-ingestion/scripts utilities	batch_ingest_sm_pyspark.py batch_ingest_sm_pyspark_bottom.py	99:111 (13%) 21:33 (40%)	view
9	x 2	utilities utilities	feature_store_helper.py feature_store_helper.py	1563:1573 (<1%) 1613:1622 (<1%)	view
9	x 2	utilities utilities	Utils.py feature_store_helper.py	547:555 (1%) 1743:1751 (<1%)	view
9	x 2	04-module-working-with-online-store/custom_library utilities	helper.py feature_store_helper.py	97:108 (8%) 939:950 (<1%)	view

Duplicated Units

The list of top 6 duplicated units.

See data for all 6 unit duplicates...

Size	#	Folders	Files	Lines	Code
33	x 2	utilities utilities	Utils.py feature_store_helper.py	0:0 0:0	view
19	x 2	utilities utilities	Utils.py feature_store_helper.py	0:0 0:0	view
12	x 2	04-module-working-with-online-store/custom_library utilities	helper.py Utils.py	0:0 0:0	view
9	x 2	utilities utilities	Utils.py feature_store_helper.py	0:0 0:0	view
9	x 2	utilities utilities	Utils.py feature_store_helper.py	0:0 0:0	view
7	x 2	05-module-scalable-batch-ingestion/scripts utilities	batch_ingest_sm_sklearn.py batch_ingest_sm_sklearn_bottom.py	0:0 0:0	view