GoogleCloudPlatform / specialized-training-content

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

51% duplication:

14,442 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
7,388 duplicated lines

8,600 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 8,600 duplicates...

Size	#	Folders	Files	Lines	Code
135	x 2	courses/understanding_spanner/colab-notebooks courses/understanding_spanner/colab-notebooks	Spanner_Python.ipynb Spanner_Queries_Transactions.ipynb	707:841 (15%) 653:787 (16%)	view
133	x 2	courses/agent_assist courses/agent_assist	baseline_summarization_audio.ipynb baseline_summarization_chat.ipynb	723:855 (13%) 293:425 (25%)	view
96	x 2	courses/DSL/dataflow-examples courses/DSL/dataflow-examples	apache-beam-io.ipynb apache-beam-sql.ipynb	319:414 (15%) 110:205 (15%)	view
94	x 2	courses/understanding_spanner/colab-notebooks courses/understanding_spanner/colab-notebooks	Spanner_Python.ipynb Spanner_Queries_Transactions.ipynb	290:383 (10%) 212:305 (11%)	view
69	x 2	courses/understanding_spanner/colab-notebooks courses/understanding_spanner/colab-notebooks	Spanner_Python.ipynb Spanner_Queries_Transactions.ipynb	637:705 (7%) 581:649 (8%)	view
59	x 2	courses/understanding_spanner/colab-notebooks courses/understanding_spanner/colab-notebooks	Spanner_Samples-demo-with-colab.ipynb Spanner_Samples_Python.ipynb	242:300 (6%) 223:281 (11%)	view
58	x 2	courses/understanding_spanner/colab-notebooks courses/understanding_spanner/colab-notebooks	Spanner_Python.ipynb Spanner_Queries_Transactions.ipynb	529:586 (6%) 462:519 (7%)	view
49	x 2	courses/understanding_spanner/colab-notebooks courses/understanding_spanner/colab-notebooks	Spanner_PostgeSQL.ipynb Spanner_Samples_Python.ipynb	288:336 (9%) 230:278 (9%)	view
49	x 2	courses/understanding_spanner/colab-notebooks courses/understanding_spanner/colab-notebooks	Spanner_Interleaved.ipynb Spanner_Python.ipynb	283:331 (8%) 211:259 (5%)	view
49	x 2	courses/understanding_spanner/colab-notebooks courses/understanding_spanner/colab-notebooks	Spanner_PostgeSQL.ipynb Spanner_Samples-demo-with-colab.ipynb	288:336 (9%) 249:297 (5%)	view
48	x 2	courses/DSL/dataflow-examples courses/DSL/dataflow-examples	apache-beam-basics.ipynb apache-beam-io.ipynb	110:157 (7%) 38:85 (7%)	view
45	x 2	courses/agent_assist courses/agent_assist	baseline_summarization_audio.ipynb baseline_summarization_chat.ipynb	192:236 (4%) 164:208 (8%)	view
44	x 2	courses/understanding_spanner/colab-notebooks courses/understanding_spanner/colab-notebooks	Spanner_Python.ipynb Spanner_Queries_Transactions.ipynb	406:449 (4%) 333:376 (5%)	view
43	x 2	courses/DSL/pub-sub-examples courses/DSL/pub-sub-examples	pub-sub-dataflow-fixed-window-count.i... pub-sub-dataflow-sliding-window-count...	39:81 (32%) 39:81 (28%)	view
39	x 2	courses/understanding_spanner/colab-notebooks courses/understanding_spanner/colab-notebooks	Spanner_Interleaved.ipynb Spanner_Queries_Transactions.ipynb	287:325 (6%) 135:173 (4%)	view
39	x 2	courses/DSL/pub-sub-examples courses/DSL/pub-sub-examples	pub-sub-send-and-recieve-sample.ipynb pub-sub-simulated-clicks-feed.ipynb	94:132 (29%) 209:247 (15%)	view
39	x 2	courses/understanding_spanner/colab-notebooks courses/understanding_spanner/colab-notebooks	Spanner_Python.ipynb Spanner_Queries_Transactions.ipynb	215:253 (4%) 135:173 (4%)	view
39	x 2	courses/DSL/pub-sub-examples courses/DSL/pub-sub-examples	pub-sub-dataflow-fixed-window-count.i... pub-sub-dataflow-sliding-window-count...	93:131 (29%) 115:153 (25%)	view
39	x 2	courses/understanding_spanner/colab-notebooks courses/understanding_spanner/colab-notebooks	Spanner_Python.ipynb Spanner_Queries_Transactions.ipynb	451:489 (4%) 379:417 (4%)	view
38	x 2	courses/understanding_spanner/colab-notebooks courses/understanding_spanner/colab-notebooks	Spanner_Samples-demo-with-colab.ipynb Spanner_Samples_Python.ipynb	787:824 (4%) 372:409 (7%)	view
37	x 2	courses/DSL/dataflow-examples courses/DSL/dataflow-examples	apache-beam-basics.ipynb apache-beam-io.ipynb	596:632 (5%) 584:620 (5%)	view
35	x 2	courses/understanding_spanner/colab-notebooks courses/understanding_spanner/colab-notebooks	Spanner_Python.ipynb Spanner_Queries_Transactions.ipynb	255:289 (3%) 178:212 (4%)	view
34	x 2	courses/DSL/dataflow-examples courses/DSL/dataflow-examples	apache-beam-dataflow-runner.ipynb apache-beam-dataflow-runner.ipynb	90:123 (8%) 167:200 (8%)	view
33	x 2	courses/DSL/dataflow-examples courses/DSL/pub-sub-examples	apache-beam-dataflow-runner.ipynb pub-sub-dataflow-sliding-window-count...	386:418 (7%) 121:153 (21%)	view
33	x 2	courses/DSL/pub-sub-examples courses/DSL/pub-sub-examples	pub-sub-dataflow-sliding-window-count... pub-sub-pull-subscriber.ipynb	117:149 (22%) 90:122 (27%)	view
33	x 2	courses/understanding_spanner/colab-notebooks courses/understanding_spanner/colab-notebooks	Spanner_Samples-demo-with-colab.ipynb Spanner_Samples_Python.ipynb	344:376 (3%) 324:356 (6%)	view
33	x 2	courses/DSL/pub-sub-examples courses/DSL/pub-sub-examples	pub-sub-dataflow-sliding-window-count... pub-sub-send-and-recieve-sample.ipynb	121:153 (21%) 100:132 (25%)	view
33	x 2	courses/DSL/pub-sub-examples courses/DSL/pub-sub-examples	pub-sub-dataflow-fixed-window-count.i... pub-sub-dataflow-read-parse-print.ipynb	99:131 (25%) 80:112 (29%)	view
33	x 2	courses/DSL/pub-sub-examples courses/DSL/pub-sub-examples	pub-sub-dataflow-fixed-window-count.i... pub-sub-dataflow-sliding-window-count...	99:131 (25%) 117:149 (22%)	view
33	x 2	courses/DSL/dataflow-examples courses/DSL/dataflow-examples	apache-beam-io.ipynb apache-beam-schemas.ipynb	9:41 (5%) 9:41 (6%)	view
33	x 2	courses/DSL/pub-sub-examples courses/DSL/pub-sub-examples	pub-sub-pull-subscriber.ipynb pub-sub-simulated-clicks-feed.ipynb	90:122 (27%) 215:247 (13%)	view
33	x 2	courses/DSL/pub-sub-examples courses/DSL/pub-sub-examples	pub-sub-dataflow-read-parse-print.ipynb pub-sub-dataflow-sliding-window-count...	80:112 (29%) 121:153 (21%)	view
33	x 2	courses/DSL/pub-sub-examples courses/DSL/pub-sub-examples	pub-sub-dataflow-read-parse-print.ipynb pub-sub-dataflow-sliding-window-count...	80:112 (29%) 117:149 (22%)	view
33	x 2	courses/DSL/pub-sub-examples courses/DSL/pub-sub-examples	pub-sub-dataflow-sliding-window-count... pub-sub-simulated-clicks-feed.ipynb	121:153 (21%) 215:247 (13%)	view
33	x 2	courses/DSL/dataflow-examples courses/DSL/pub-sub-examples	apache-beam-dataflow-runner.ipynb pub-sub-dataflow-fixed-window-count.i...	386:418 (7%) 99:131 (25%)	view
33	x 2	courses/DSL/pub-sub-examples courses/DSL/pub-sub-examples	pub-sub-dataflow-read-parse-print.ipynb pub-sub-send-and-recieve-sample.ipynb	80:112 (29%) 100:132 (25%)	view
33	x 2	courses/DSL/dataflow-examples courses/DSL/pub-sub-examples	apache-beam-dataflow-runner.ipynb pub-sub-send-and-recieve-sample.ipynb	386:418 (7%) 100:132 (25%)	view
33	x 2	courses/DSL/pub-sub-examples courses/DSL/pub-sub-examples	pub-sub-dataflow-read-parse-print.ipynb pub-sub-simulated-clicks-feed.ipynb	80:112 (29%) 215:247 (13%)	view
33	x 2	courses/DSL/pub-sub-examples courses/DSL/pub-sub-examples	pub-sub-dataflow-sliding-window-count... pub-sub-pull-subscriber.ipynb	121:153 (21%) 90:122 (27%)	view
33	x 2	courses/DSL/pub-sub-examples courses/DSL/pub-sub-examples	pub-sub-dataflow-sliding-window-count... pub-sub-dataflow-sliding-window-count...	121:153 (21%) 117:149 (22%)	view
33	x 2	courses/DSL/dataflow-examples courses/DSL/pub-sub-examples	apache-beam-dataflow-runner.ipynb pub-sub-pull-subscriber.ipynb	386:418 (7%) 90:122 (27%)	view
33	x 2	courses/DSL/pub-sub-examples courses/DSL/pub-sub-examples	pub-sub-dataflow-fixed-window-count.i... pub-sub-pull-subscriber.ipynb	99:131 (25%) 90:122 (27%)	view
33	x 2	courses/DSL/pub-sub-examples courses/DSL/pub-sub-examples	pub-sub-dataflow-sliding-window-count... pub-sub-send-and-recieve-sample.ipynb	117:149 (22%) 100:132 (25%)	view
33	x 2	courses/DSL/pub-sub-examples courses/DSL/pub-sub-examples	pub-sub-dataflow-fixed-window-count.i... pub-sub-simulated-clicks-feed.ipynb	99:131 (25%) 215:247 (13%)	view
33	x 2	courses/DSL/dataflow-examples courses/DSL/pub-sub-examples	apache-beam-dataflow-runner.ipynb pub-sub-dataflow-read-parse-print.ipynb	386:418 (7%) 80:112 (29%)	view
33	x 2	courses/DSL/pub-sub-examples courses/DSL/pub-sub-examples	pub-sub-pull-subscriber.ipynb pub-sub-send-and-recieve-sample.ipynb	90:122 (27%) 100:132 (25%)	view
33	x 2	courses/DSL/dataflow-examples courses/DSL/pub-sub-examples	apache-beam-dataflow-runner.ipynb pub-sub-simulated-clicks-feed.ipynb	386:418 (7%) 215:247 (13%)	view
33	x 2	courses/DSL/dataflow-examples courses/DSL/pub-sub-examples	apache-beam-dataflow-runner.ipynb pub-sub-dataflow-sliding-window-count...	386:418 (7%) 117:149 (22%)	view
33	x 2	courses/DSL/pub-sub-examples courses/DSL/pub-sub-examples	pub-sub-dataflow-fixed-window-count.i... pub-sub-send-and-recieve-sample.ipynb	99:131 (25%) 100:132 (25%)	view
33	x 2	courses/DSL/pub-sub-examples courses/DSL/pub-sub-examples	pub-sub-dataflow-read-parse-print.ipynb pub-sub-pull-subscriber.ipynb	80:112 (29%) 90:122 (27%)	view