azure / Databricks360

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

60% duplication:

1,150 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
691 duplicated lines

41 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
bundle_adb_360 (22%) --> content-adb-360 (102%)	424	6 file pairs	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 41 longest duplicates.

See data for all 41 duplicates...

Size	#	Folders	Files	Lines	Code
157	x 2	bundle_adb_360/src/tools content-adb-360/tools	azure-diagnostic-logs-etl-unity-catal... azure-diagnostic-logs-etl-unity-catal...	11:234 (100%) 11:234 (100%)	view
29	x 2	bundle_adb_360/src/b_historical bundle_adb_360/src/b_historical	3c_loadSCD1DimensionsHist.py 3d_loadSCD2DimensionsHist.py	126:154 (32%) 81:109 (46%)	view
20	x 2	bundle_adb_360/src/c_Incremental bundle_adb_360/src/c_Incremental	13_Scd1ToGold.py 14_Scd2ToGold.py	128:161 (26%) 204:237 (16%)	view
17	x 2	bundle_adb_360/src/tools/views content-adb-360/tools/views	2_goldtables.py 2_goldtables.py	19:88 (100%) 19:88 (100%)	view
16	x 2	bundle_adb_360/src/tools/views content-adb-360/tools/views	1_silvertables.py 1_silvertables.py	7:69 (100%) 7:69 (100%)	view
16	x 2	bundle_adb_360/src/tools/views content-adb-360/tools/views	0_bronzetables.py 0_bronzetables.py	7:65 (100%) 7:65 (100%)	view
13	x 2	bundle_adb_360/src/b_historical bundle_adb_360/src/c_Incremental	1_createhistbronzeparquets.py 11_IncDataGeneration.py	65:77 (14%) 54:68 (19%)	view
11	x 2	bundle_adb_360/src/b_historical bundle_adb_360/src/c_Incremental	1_createhistbronzeparquets.py 11_IncDataGeneration.py	98:110 (12%) 73:85 (16%)	view
9	x 2	bundle_adb_360/src/c_Incremental bundle_adb_360/src/c_Incremental	14_Scd2ToGold.py 14_Scd2ToGold.py	69:77 (7%) 109:117 (7%)	view
9	x 2	bundle_adb_360/src/c_Incremental bundle_adb_360/src/c_Incremental	14_Scd2ToGold.py 14_Scd2ToGold.py	140:148 (7%) 161:169 (7%)	view
9	x 2	bundle_adb_360/src/c_Incremental bundle_adb_360/src/c_Incremental	13_Scd1ToGold.py 14_Scd2ToGold.py	25:56 (12%) 25:56 (7%)	view
8	x 2	bundle_adb_360/src/c_Incremental bundle_adb_360/src/c_Incremental	14_Scd2ToGold.py 14_Scd2ToGold.py	69:76 (6%) 161:168 (6%)	view
8	x 2	bundle_adb_360/src/c_Incremental bundle_adb_360/src/c_Incremental	14_Scd2ToGold.py 14_Scd2ToGold.py	88:95 (6%) 161:168 (6%)	view
8	x 2	bundle_adb_360/src/c_Incremental bundle_adb_360/src/c_Incremental	14_Scd2ToGold.py 14_Scd2ToGold.py	69:76 (6%) 140:147 (6%)	view
8	x 2	bundle_adb_360/src/c_Incremental bundle_adb_360/src/c_Incremental	14_Scd2ToGold.py 14_Scd2ToGold.py	69:76 (6%) 88:95 (6%)	view
8	x 2	bundle_adb_360/src/c_Incremental bundle_adb_360/src/c_Incremental	14_Scd2ToGold.py 14_Scd2ToGold.py	109:116 (6%) 161:168 (6%)	view
8	x 2	bundle_adb_360/src/c_Incremental bundle_adb_360/src/c_Incremental	14_Scd2ToGold.py 14_Scd2ToGold.py	109:116 (6%) 140:147 (6%)	view
8	x 2	bundle_adb_360/src/c_Incremental bundle_adb_360/src/c_Incremental	14_Scd2ToGold.py 14_Scd2ToGold.py	88:95 (6%) 109:116 (6%)	view
8	x 2	bundle_adb_360/src/c_Incremental bundle_adb_360/src/c_Incremental	14_Scd2ToGold.py 14_Scd2ToGold.py	88:95 (6%) 140:147 (6%)	view
7	x 2	bundle_adb_360/src/b_historical bundle_adb_360/src/c_Incremental	1_createhistbronzeparquets.py 11_IncDataGeneration.py	22:36 (7%) 17:40 (10%)	view
7	x 2	bundle_adb_360/src/b_historical bundle_adb_360/src/b_historical	1_createhistbronzeparquets.py 1_createhistbronzeparquets.py	121:127 (7%) 133:139 (7%)	view
7	x 2	bundle_adb_360/src/b_historical bundle_adb_360/src/c_Incremental	3d_loadSCD2DimensionsHist.py 14_Scd2ToGold.py	63:69 (11%) 70:76 (5%)	view
7	x 2	bundle_adb_360/src/b_historical bundle_adb_360/src/c_Incremental	3d_loadSCD2DimensionsHist.py 14_Scd2ToGold.py	63:69 (11%) 141:147 (5%)	view
7	x 2	bundle_adb_360/src/b_historical bundle_adb_360/src/c_Incremental	3d_loadSCD2DimensionsHist.py 14_Scd2ToGold.py	63:69 (11%) 110:116 (5%)	view
7	x 2	bundle_adb_360/src/b_historical bundle_adb_360/src/c_Incremental	3d_loadSCD2DimensionsHist.py 14_Scd2ToGold.py	63:69 (11%) 89:95 (5%)	view
7	x 2	bundle_adb_360/src/b_historical bundle_adb_360/src/c_Incremental	3d_loadSCD2DimensionsHist.py 14_Scd2ToGold.py	63:69 (11%) 162:168 (5%)	view
6	x 2	bundle_adb_360/src/b_historical bundle_adb_360/src/b_historical	3c_loadSCD1DimensionsHist.py 3c_loadSCD1DimensionsHist.py	135:140 (6%) 142:147 (6%)	view
6	x 2	bundle_adb_360/src/b_historical bundle_adb_360/src/tools/views	0_deleteAllHistorical.py 0_bronzetables.py	12:20 (66%) 7:15 (37%)	view
6	x 2	bundle_adb_360/src/b_historical bundle_adb_360/src/b_historical	3c_loadSCD1DimensionsHist.py 3d_loadSCD2DimensionsHist.py	142:147 (6%) 90:95 (9%)	view
6	x 2	bundle_adb_360/src/b_historical bundle_adb_360/src/c_Incremental	3d_loadSCD2DimensionsHist.py 14_Scd2ToGold.py	85:90 (9%) 223:228 (4%)	view
6	x 2	bundle_adb_360/src/c_Incremental content-adb-360/tools/views	10_IncDataDeleteOnBronze.py 0_bronzetables.py	16:24 (75%) 7:15 (37%)	view
6	x 2	bundle_adb_360/src/b_historical bundle_adb_360/src/c_Incremental	3d_loadSCD2DimensionsHist.py 13_Scd1ToGold.py	85:90 (9%) 147:152 (8%)	view
6	x 2	bundle_adb_360/src/c_Incremental bundle_adb_360/src/tools/views	10_IncDataDeleteOnBronze.py 0_bronzetables.py	16:24 (75%) 7:15 (37%)	view
6	x 2	bundle_adb_360/src/b_historical content-adb-360/tools/views	0_deleteAllHistorical.py 0_bronzetables.py	12:20 (66%) 7:15 (37%)	view
6	x 2	bundle_adb_360/src/b_historical bundle_adb_360/src/c_Incremental	3c_loadSCD1DimensionsHist.py 14_Scd2ToGold.py	130:135 (6%) 223:228 (4%)	view
6	x 2	bundle_adb_360/src/b_historical bundle_adb_360/src/b_historical	2b_createsilverdbandtables.sql 3b_creategolddbandtables.sql	55:60 (11%) 61:66 (9%)	view
6	x 2	bundle_adb_360/src/b_historical bundle_adb_360/src/c_Incremental	3c_loadSCD1DimensionsHist.py 13_Scd1ToGold.py	130:135 (6%) 147:152 (8%)	view
6	x 2	bundle_adb_360/src/c_Incremental bundle_adb_360/src/c_Incremental	13_Scd1ToGold.py 13_Scd1ToGold.py	64:69 (8%) 94:99 (8%)	view
6	x 2	bundle_adb_360/src/b_historical bundle_adb_360/src/c_Incremental	0_deleteAllHistorical.py 10_IncDataDeleteOnBronze.py	12:20 (66%) 16:24 (75%)	view
6	x 2	bundle_adb_360/src/b_historical bundle_adb_360/src/b_historical	3c_loadSCD1DimensionsHist.py 3d_loadSCD2DimensionsHist.py	135:140 (6%) 97:102 (9%)	view
6	x 2	bundle_adb_360/src/b_historical bundle_adb_360/src/b_historical	3d_loadSCD2DimensionsHist.py 3d_loadSCD2DimensionsHist.py	90:95 (9%) 97:102 (9%)	view

Duplicated Units

The list of top 1 duplicated units.

See data for all 1 unit duplicate

Size	#	Folders	Files	Lines	Code
33	x 2	content-adb-360/tools bundle_adb_360/src/tools	azure-diagnostic-logs-etl-unity-catal... azure-diagnostic-logs-etl-unity-catal...	0:0 0:0	view