GoogleCloudPlatform / data-science-on-gcp

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

55% duplication:

5,133 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
2,826 duplicated lines

1,250 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
04_streaming (3%) --> 11_realtime (7%)	59	3 file pairs	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 1,250 duplicates...

Size	#	Folders	Files	Lines	Code
55	x 2	08_bqml 08_bqml	bqml_timetxf.ipynb bqml_timetxf.ipynb	319:373 (6%) 525:579 (6%)	view
55	x 2	08_bqml 08_bqml	bqml_timetxf.ipynb bqml_timetxf.ipynb	319:373 (6%) 736:790 (6%)	view
55	x 2	08_bqml 08_bqml	bqml_timetxf.ipynb bqml_timetxf.ipynb	525:579 (6%) 736:790 (6%)	view
43	x 2	08_bqml 08_bqml	bqml_nonlinear.ipynb bqml_nonlinear.ipynb	467:509 (6%) 559:601 (6%)	view
43	x 2	08_bqml 08_bqml	bqml_logistic.ipynb bqml_nonlinear.ipynb	1439:1481 (2%) 467:509 (6%)	view
43	x 2	08_bqml 08_bqml	bqml_logistic.ipynb bqml_nonlinear.ipynb	1439:1481 (2%) 559:601 (6%)	view
41	x 2	08_bqml 08_bqml	bqml_nonlinear.ipynb bqml_timetxf.ipynb	567:607 (6%) 756:796 (5%)	view
40	x 2	08_bqml 08_bqml	bqml_nonlinear.ipynb bqml_nonlinear.ipynb	142:181 (6%) 559:598 (6%)	view
40	x 2	08_bqml 08_bqml	bqml_nonlinear.ipynb bqml_nonlinear.ipynb	142:181 (6%) 467:506 (6%)	view
40	x 2	08_bqml 08_bqml	bqml_logistic.ipynb bqml_nonlinear.ipynb	1439:1478 (2%) 142:181 (6%)	view
36	x 2	08_bqml 08_bqml	bqml_timetxf.ipynb bqml_timetxf.ipynb	184:219 (4%) 390:425 (4%)	view
36	x 2	08_bqml 08_bqml	bqml_logistic.ipynb bqml_logistic.ipynb	495:530 (2%) 1212:1247 (2%)	view
36	x 2	08_bqml 08_bqml	bqml_logistic.ipynb bqml_timetxf.ipynb	1212:1247 (2%) 390:425 (4%)	view
36	x 2	08_bqml 08_bqml	bqml_logistic.ipynb bqml_timetxf.ipynb	495:530 (2%) 596:631 (4%)	view
36	x 2	08_bqml 08_bqml	bqml_timetxf.ipynb bqml_timetxf.ipynb	184:219 (4%) 596:631 (4%)	view
36	x 2	08_bqml 08_bqml	bqml_logistic.ipynb bqml_timetxf.ipynb	1212:1247 (2%) 184:219 (4%)	view
36	x 2	08_bqml 08_bqml	bqml_timetxf.ipynb bqml_timetxf.ipynb	390:425 (4%) 596:631 (4%)	view
36	x 2	08_bqml 08_bqml	bqml_logistic.ipynb bqml_timetxf.ipynb	495:530 (2%) 184:219 (4%)	view
36	x 2	08_bqml 08_bqml	bqml_logistic.ipynb bqml_timetxf.ipynb	1212:1247 (2%) 596:631 (4%)	view
36	x 2	08_bqml 08_bqml	bqml_logistic.ipynb bqml_timetxf.ipynb	495:530 (2%) 390:425 (4%)	view
35	x 2	08_bqml 08_bqml	bqml_nonlinear.ipynb bqml_timetxf.ipynb	475:509 (5%) 756:790 (4%)	view
35	x 2	08_bqml 08_bqml	bqml_nonlinear.ipynb bqml_timetxf.ipynb	567:601 (5%) 339:373 (4%)	view
35	x 2	08_bqml 08_bqml	bqml_nonlinear.ipynb bqml_timetxf.ipynb	475:509 (5%) 339:373 (4%)	view
35	x 2	08_bqml 08_bqml	bqml_nonlinear.ipynb bqml_timetxf.ipynb	475:509 (5%) 545:579 (4%)	view
35	x 2	04_streaming/realtime 04_streaming/realtime	avg02.py avg03.py	65:111 (50%) 65:111 (50%)	view
35	x 2	08_bqml 08_bqml	bqml_logistic.ipynb bqml_timetxf.ipynb	1447:1481 (2%) 339:373 (4%)	view
35	x 2	08_bqml 08_bqml	bqml_logistic.ipynb bqml_timetxf.ipynb	1447:1481 (2%) 545:579 (4%)	view
35	x 2	08_bqml 08_bqml	bqml_logistic.ipynb bqml_timetxf.ipynb	1447:1481 (2%) 756:790 (4%)	view
35	x 2	08_bqml 08_bqml	bqml_nonlinear.ipynb bqml_timetxf.ipynb	567:601 (5%) 545:579 (4%)	view
34	x 2	08_bqml 08_bqml	bqml_logistic.ipynb bqml_logistic.ipynb	997:1030 (2%) 1289:1322 (2%)	view
34	x 2	08_bqml 08_bqml	bqml_logistic.ipynb bqml_nonlinear.ipynb	1161:1194 (2%) 568:601 (5%)	view
34	x 2	08_bqml 08_bqml	bqml_logistic.ipynb bqml_timetxf.ipynb	1161:1194 (2%) 757:790 (4%)	view
34	x 2	08_bqml 08_bqml	bqml_logistic.ipynb bqml_nonlinear.ipynb	1161:1194 (2%) 476:509 (5%)	view
34	x 2	08_bqml 08_bqml	bqml_logistic.ipynb bqml_timetxf.ipynb	1161:1194 (2%) 340:373 (4%)	view
34	x 2	08_bqml 08_bqml	bqml_logistic.ipynb bqml_timetxf.ipynb	1161:1194 (2%) 546:579 (4%)	view
34	x 2	08_bqml 08_bqml	bqml_logistic.ipynb bqml_logistic.ipynb	1161:1194 (2%) 1448:1481 (2%)	view
33	x 2	08_bqml 08_bqml	bqml_logistic.ipynb bqml_logistic.ipynb	1095:1127 (2%) 1379:1411 (2%)	view
33	x 2	08_bqml 08_bqml	bqml_nonlinear.ipynb bqml_timetxf.ipynb	407:439 (5%) 476:508 (4%)	view
33	x 2	08_bqml 08_bqml	bqml_nonlinear.ipynb bqml_timetxf.ipynb	407:439 (5%) 687:719 (4%)	view
33	x 2	08_bqml 08_bqml	bqml_timetxf.ipynb bqml_timetxf.ipynb	270:302 (4%) 687:719 (4%)	view
33	x 2	08_bqml 08_bqml	bqml_nonlinear.ipynb bqml_nonlinear.ipynb	82:114 (5%) 407:439 (5%)	view
33	x 2	04_streaming/realtime 04_streaming/realtime	avg02.py avg03.py	22:63 (47%) 22:63 (47%)	view
33	x 2	08_bqml 08_bqml	bqml_logistic.ipynb bqml_timetxf.ipynb	1095:1127 (2%) 687:719 (4%)	view
33	x 2	08_bqml 08_bqml	bqml_timetxf.ipynb bqml_timetxf.ipynb	270:302 (4%) 476:508 (4%)	view
33	x 2	08_bqml 08_bqml	bqml_logistic.ipynb bqml_nonlinear.ipynb	1379:1411 (2%) 407:439 (5%)	view
33	x 2	08_bqml 08_bqml	bqml_logistic.ipynb bqml_timetxf.ipynb	1095:1127 (2%) 476:508 (4%)	view
33	x 2	08_bqml 08_bqml	bqml_logistic.ipynb bqml_timetxf.ipynb	1379:1411 (2%) 687:719 (4%)	view
33	x 2	08_bqml 08_bqml	bqml_timetxf.ipynb bqml_timetxf.ipynb	476:508 (4%) 687:719 (4%)	view
33	x 2	08_bqml 08_bqml	bqml_logistic.ipynb bqml_timetxf.ipynb	1095:1127 (2%) 270:302 (4%)	view
33	x 2	08_bqml 08_bqml	bqml_nonlinear.ipynb bqml_timetxf.ipynb	82:114 (5%) 270:302 (4%)	view