GoogleCloudPlatform / data-beans

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

97% duplication:

40,946 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
40,086 duplicated lines

199,060 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
colab-enterprise (100%) --> qwiklabs (89%)	35860	324 file pairs	details...
qwiklabs (6%) --> terraform-modules (92%)	2677	102 file pairs	details...
qwiklabs (2%) --> terraform (87%)	820	2 file pairs	details...
qwiklabs (1%) --> sql-scripts (99%)	676	2 file pairs	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 199,060 duplicates...

Size	#	Folders	Files	Lines	Code
3895	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Video-Generation-GenAI.ipynb Video-Generation-GenAI.ipynb	1:3895 (100%) 1:3895 (100%)	view
1485	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Sample-Synthetic-Data-Generation-GenA... Sample-Synthetic-Data-Generation-GenA...	1:1485 (47%) 1:1485 (47%)	view
1397	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Menu-Synthetic-Data-Generation-GenAI.... Menu-Synthetic-Data-Generation-GenAI....	1:1397 (100%) 1:1397 (100%)	view
1374	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Marketing-Campaign-Generate-Insight-G... Marketing-Campaign-Generate-Insight-G...	1:1374 (100%) 1:1374 (100%)	view
1292	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Sample-Synthetic-Data-Generation-GenA... Sample-Synthetic-Data-Generation-GenA...	1486:2777 (41%) 1487:2778 (41%)	view
1249	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Menu-A-B-Testing-Generate-Insight-Gen... Menu-A-B-Testing-Generate-Insight-Gen...	1:1249 (100%) 1:1249 (100%)	view
999	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Menu-A-B-Testing-Generate-Campaign-Ge... Menu-A-B-Testing-Generate-Campaign-Ge...	1:999 (100%) 1:999 (100%)	view
951	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Common-Themes-RAG.ipynb Common-Themes-RAG.ipynb	1:951 (100%) 1:951 (100%)	view
814	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Weather-Generate-Insight-GenAI.ipynb Weather-Generate-Insight-GenAI.ipynb	1:814 (100%) 1:814 (100%)	view
585	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Customer-Reviews-Synthetic-Data-Gener... Customer-Reviews-Synthetic-Data-Gener...	1:585 (100%) 1:585 (100%)	view
517	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Customer-Reviews-Generate-Insight-Gen... Customer-Reviews-Generate-Insight-Gen...	1:517 (100%) 1:517 (100%)	view
467	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Event-Populate-Table.ipynb Event-Populate-Table.ipynb	1:467 (100%) 1:467 (100%)	view
459	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Menu-A-B-Testing-Generate-Insight-Gen... Menu-A-B-Testing-Generate-Campaign-Ge...	129:587 (36%) 123:581 (45%)	view
459	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Menu-A-B-Testing-Generate-Campaign-Ge... Menu-A-B-Testing-Generate-Insight-Gen...	123:581 (45%) 129:587 (36%)	view
459	x 2	colab-enterprise/gen-ai-demo colab-enterprise/gen-ai-demo	Menu-A-B-Testing-Generate-Campaign-Ge... Menu-A-B-Testing-Generate-Insight-Gen...	123:581 (45%) 129:587 (36%)	view
459	x 2	qwiklabs/colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Menu-A-B-Testing-Generate-Campaign-Ge... Menu-A-B-Testing-Generate-Insight-Gen...	123:581 (45%) 129:587 (36%)	view
452	x 2	colab-enterprise/gen-ai-demo colab-enterprise/gen-ai-demo	Menu-A-B-Testing-Generate-Insight-Gen... Menu-Synthetic-Data-Generation-GenAI....	150:601 (36%) 146:597 (32%)	view
452	x 2	qwiklabs/colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Menu-A-B-Testing-Generate-Insight-Gen... Menu-Synthetic-Data-Generation-GenAI....	150:601 (36%) 146:597 (32%)	view
452	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Menu-A-B-Testing-Generate-Insight-Gen... Menu-Synthetic-Data-Generation-GenAI....	150:601 (36%) 146:597 (32%)	view
452	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Menu-Synthetic-Data-Generation-GenAI.... Menu-A-B-Testing-Generate-Insight-Gen...	146:597 (32%) 150:601 (36%)	view
438	x 2	colab-enterprise/gen-ai-demo colab-enterprise/gen-ai-demo	Menu-A-B-Testing-Generate-Campaign-Ge... Menu-Synthetic-Data-Generation-GenAI....	144:581 (43%) 146:583 (31%)	view
438	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Menu-Synthetic-Data-Generation-GenAI.... Menu-A-B-Testing-Generate-Campaign-Ge...	146:583 (31%) 144:581 (43%)	view
438	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Menu-A-B-Testing-Generate-Campaign-Ge... Menu-Synthetic-Data-Generation-GenAI....	144:581 (43%) 146:583 (31%)	view
438	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Event-Generate-Insight-GenAI.ipynb Event-Generate-Insight-GenAI.ipynb	1:438 (100%) 1:438 (100%)	view
438	x 2	qwiklabs/colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Menu-A-B-Testing-Generate-Campaign-Ge... Menu-Synthetic-Data-Generation-GenAI....	144:581 (43%) 146:583 (31%)	view
405	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Weather-Populate-Table.ipynb Weather-Populate-Table.ipynb	1:405 (100%) 1:405 (100%)	view
378	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Customer-Reviews-Detect-Themes-GenAI.... Customer-Reviews-Detect-Themes-GenAI....	1:378 (100%) 1:378 (100%)	view
374	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Customer-Reviews-Generate-Recommended... Customer-Reviews-Generate-Recommended...	1:374 (100%) 1:374 (100%)	view
366	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Sample-Synthetic-Data-Generation-GenA... Sample-Synthetic-Data-Generation-GenA...	2779:3144 (11%) 2779:3144 (11%)	view
358	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Audio-Generation-Pipeline.ipynb Audio-Generation-Pipeline.ipynb	1:358 (100%) 1:358 (100%)	view
354	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Customer-Reviews-Generate-Customer-Re... Customer-Reviews-Generate-Customer-Re...	1:354 (100%) 1:354 (100%)	view
342	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Marketing-Campaign-Generate-Insight-G... Menu-Synthetic-Data-Generation-GenAI....	125:466 (24%) 105:446 (24%)	view
342	x 2	qwiklabs/colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Marketing-Campaign-Generate-Insight-G... Menu-Synthetic-Data-Generation-GenAI....	125:466 (24%) 105:446 (24%)	view
342	x 2	colab-enterprise/gen-ai-demo colab-enterprise/gen-ai-demo	Marketing-Campaign-Generate-Insight-G... Menu-Synthetic-Data-Generation-GenAI....	125:466 (24%) 105:446 (24%)	view
342	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Menu-Synthetic-Data-Generation-GenAI.... Marketing-Campaign-Generate-Insight-G...	105:446 (24%) 125:466 (24%)	view
309	x 2	qwiklabs/sql-scripts/data_beans_curated sql-scripts/data_beans_curated	create-artifact-table.sql create-artifact-table.sql	17:349 (100%) 17:349 (100%)	view
301	x 2	qwiklabs/colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Marketing-Campaign-Generate-Insight-G... Menu-A-B-Testing-Generate-Campaign-Ge...	166:466 (21%) 144:444 (30%)	view
301	x 2	qwiklabs/colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Marketing-Campaign-Generate-Insight-G... Menu-A-B-Testing-Generate-Insight-Gen...	166:466 (21%) 150:450 (24%)	view
301	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Marketing-Campaign-Generate-Insight-G... Menu-A-B-Testing-Generate-Insight-Gen...	166:466 (21%) 150:450 (24%)	view
301	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Menu-A-B-Testing-Generate-Campaign-Ge... Marketing-Campaign-Generate-Insight-G...	144:444 (30%) 166:466 (21%)	view
301	x 2	colab-enterprise/gen-ai-demo colab-enterprise/gen-ai-demo	Marketing-Campaign-Generate-Insight-G... Menu-A-B-Testing-Generate-Insight-Gen...	166:466 (21%) 150:450 (24%)	view
301	x 2	colab-enterprise/gen-ai-demo colab-enterprise/gen-ai-demo	Marketing-Campaign-Generate-Insight-G... Menu-A-B-Testing-Generate-Campaign-Ge...	166:466 (21%) 144:444 (30%)	view
301	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Menu-A-B-Testing-Generate-Insight-Gen... Marketing-Campaign-Generate-Insight-G...	150:450 (24%) 166:466 (21%)	view
301	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Marketing-Campaign-Generate-Insight-G... Menu-A-B-Testing-Generate-Campaign-Ge...	166:466 (21%) 144:444 (30%)	view
235	x 2	qwiklabs/terraform-modules/resources terraform-modules/resources	tf-resources.tf tf-resources.tf	172:449 (68%) 195:472 (66%)	view
233	x 2	qwiklabs/terraform-modules/apis-batch-enable terraform-modules/apis-batch-enable	tf-batch-enable-apis.tf tf-batch-enable-apis.tf	26:357 (100%) 26:357 (100%)	view
231	x 2	colab-enterprise/gen-ai-demo qwiklabs/colab-enterprise/gen-ai-demo	Customer-Reviews-Word-Cloud.ipynb Customer-Reviews-Word-Cloud.ipynb	1:231 (100%) 1:231 (100%)	view
177	x 2	qwiklabs terraform	variables.tf tf-variables.tf	65:287 (78%) 65:287 (83%)	view
163	x 2	qwiklabs/terraform-modul...oyment/terraform-module terraform-modules/colab-...oyment/terraform-module	tf-deploy-notebooks.tf tf-deploy-notebooks.tf	76:291 (66%) 76:291 (66%)	view
138	x 2	colab-enterprise/gen-ai-demo colab-enterprise/gen-ai-demo	Customer-Reviews-Generate-Recommended... Customer-Reviews-Synthetic-Data-Gener...	86:223 (36%) 80:217 (23%)	view

Duplicated Units

The list of top 1 duplicated units.

See data for all 1 unit duplicate

Size	#	Folders	Files	Lines	Code
55	x 2	qwiklabs/terraform-modul...ployment/cloud-function terraform-modules/colab-deployment/cloud-function	main.py main.py	0:0 0:0	view