GoogleCloudPlatform / data-to-ai

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

19% duplication:

5,078 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
1,012 duplicated lines

1,428 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 1,428 duplicates...

Size	#	Folders	Files	Lines	Code
16	x 2	notebooks notebooks	part_2_large_scale_understanding.ipynb part_3_time_series_forecasting.ipynb	15:30 (1%) 15:30 (<1%)	view
16	x 2	notebooks notebooks	part_2_large_scale_understanding.ipynb part_3_time_series_forecasting.ipynb	829:844 (1%) 1767:1782 (<1%)	view
14	x 2	notebooks notebooks	generate_synthetic_multimodal_data.ipynb multimodal_search_evaluation.ipynb	5:18 (2%) 10:23 (1%)	view
12	x 2	infrastructure/terraform infrastructure/terraform	bigquery-table.tf bigquery-table.tf	211:222 (5%) 235:246 (5%)	view
11	x 2	notebooks notebooks	part_3_time_series_forecasting.ipynb part_3_time_series_forecasting.ipynb	433:443 (<1%) 1215:1225 (<1%)	view
10	x 2	notebooks notebooks	part_2_large_scale_understanding.ipynb part_2_large_scale_understanding.ipynb	561:570 (1%) 627:636 (1%)	view
10	x 2	notebooks notebooks	part_3_time_series_forecasting.ipynb part_3_time_series_forecasting.ipynb	1370:1379 (<1%) 1462:1471 (<1%)	view
9	x 2	infrastructure/terraform infrastructure/terraform	bigquery-procedure.tf bigquery-procedure.tf	81:89 (9%) 102:110 (9%)	view
9	x 2	notebooks notebooks	part_3_time_series_forecasting.ipynb part_3_time_series_forecasting.ipynb	990:998 (<1%) 1166:1174 (<1%)	view
9	x 2	notebooks notebooks	part_3_time_series_forecasting.ipynb part_3_time_series_forecasting.ipynb	1051:1059 (<1%) 1487:1495 (<1%)	view
8	x 2	notebooks notebooks	part_3_time_series_forecasting.ipynb part_3_time_series_forecasting.ipynb	1352:1359 (<1%) 1438:1445 (<1%)	view
8	x 2	notebooks notebooks	part_2_large_scale_understanding.ipynb part_2_large_scale_understanding.ipynb	415:422 (<1%) 493:500 (<1%)	view
8	x 2	notebooks notebooks	part_3_time_series_forecasting.ipynb part_3_time_series_forecasting.ipynb	1360:1367 (<1%) 1453:1460 (<1%)	view
7	x 2	notebooks notebooks	part_3_time_series_forecasting.ipynb part_3_time_series_forecasting.ipynb	797:803 (<1%) 1360:1366 (<1%)	view
7	x 2	notebooks notebooks	part_3_time_series_forecasting.ipynb part_3_time_series_forecasting.ipynb	1381:1387 (<1%) 1473:1479 (<1%)	view
7	x 2	notebooks notebooks	generate_synthetic_multimodal_data.ipynb generate_synthetic_multimodal_data.ipynb	70:76 (1%) 328:334 (1%)	view
7	x 2	notebooks notebooks	part_3_time_series_forecasting.ipynb part_3_time_series_forecasting.ipynb	976:982 (<1%) 1149:1155 (<1%)	view
7	x 2	notebooks notebooks	part_3_time_series_forecasting.ipynb part_3_time_series_forecasting.ipynb	797:803 (<1%) 1453:1459 (<1%)	view
7	x 2	notebooks notebooks	part_3_time_series_forecasting.ipynb part_3_time_series_forecasting.ipynb	945:951 (<1%) 1116:1122 (<1%)	view
7	x 2	notebooks notebooks	part_3_time_series_forecasting.ipynb part_3_time_series_forecasting.ipynb	878:884 (<1%) 1073:1079 (<1%)	view
7	x 2	notebooks notebooks	part_3_time_series_forecasting.ipynb part_3_time_series_forecasting.ipynb	1084:1090 (<1%) 1543:1549 (<1%)	view
6	x 2	notebooks notebooks	multimodal_search_evaluation.ipynb multimodal_search_evaluation.ipynb	214:219 (<1%) 690:695 (<1%)	view
6	x 2	notebooks notebooks	part_2_large_scale_understanding.ipynb part_3_time_series_forecasting.ipynb	809:814 (<1%) 1310:1315 (<1%)	view
6	x 2	notebooks notebooks	part_2_large_scale_understanding.ipynb part_3_time_series_forecasting.ipynb	374:379 (<1%) 1622:1627 (<1%)	view
6	x 2	notebooks notebooks	multimodal_search_evaluation.ipynb multimodal_search_evaluation.ipynb	751:756 (<1%) 863:868 (<1%)	view
6	x 2	notebooks notebooks	multimodal_search_evaluation.ipynb multimodal_search_evaluation.ipynb	329:334 (<1%) 341:346 (<1%)	view
6	x 2	notebooks notebooks	part_2_large_scale_understanding.ipynb part_3_time_series_forecasting.ipynb	163:168 (<1%) 1725:1730 (<1%)	view
6	x 2	notebooks notebooks	part_2_large_scale_understanding.ipynb part_2_large_scale_understanding.ipynb	188:193 (<1%) 659:664 (<1%)	view
6	x 2	notebooks notebooks	part_3_time_series_forecasting.ipynb part_3_time_series_forecasting.ipynb	25:30 (<1%) 1094:1099 (<1%)	view
6	x 2	notebooks notebooks	part_3_time_series_forecasting.ipynb part_3_time_series_forecasting.ipynb	1322:1327 (<1%) 1397:1402 (<1%)	view
6	x 2	notebooks notebooks	part_3_time_series_forecasting.ipynb part_3_time_series_forecasting.ipynb	615:620 (<1%) 1622:1627 (<1%)	view
6	x 2	notebooks notebooks	part_2_large_scale_understanding.ipynb part_2_large_scale_understanding.ipynb	331:336 (<1%) 374:379 (<1%)	view
6	x 2	notebooks notebooks	part_2_large_scale_understanding.ipynb part_3_time_series_forecasting.ipynb	713:718 (<1%) 1140:1145 (<1%)	view
6	x 2	notebooks notebooks	part_3_time_series_forecasting.ipynb part_3_time_series_forecasting.ipynb	1286:1291 (<1%) 1397:1402 (<1%)	view
6	x 2	notebooks notebooks	part_2_large_scale_understanding.ipynb part_3_time_series_forecasting.ipynb	25:30 (<1%) 675:680 (<1%)	view
6	x 2	notebooks notebooks	part_2_large_scale_understanding.ipynb part_3_time_series_forecasting.ipynb	809:814 (<1%) 876:881 (<1%)	view
6	x 2	notebooks notebooks	part_3_time_series_forecasting.ipynb part_3_time_series_forecasting.ipynb	198:203 (<1%) 222:227 (<1%)	view
6	x 2	notebooks notebooks	part_3_time_series_forecasting.ipynb part_3_time_series_forecasting.ipynb	527:532 (<1%) 1553:1558 (<1%)	view
6	x 2	notebooks notebooks	part_2_large_scale_understanding.ipynb part_3_time_series_forecasting.ipynb	519:524 (<1%) 1397:1402 (<1%)	view
6	x 2	notebooks notebooks	part_2_large_scale_understanding.ipynb part_3_time_series_forecasting.ipynb	701:706 (<1%) 1094:1099 (<1%)	view
6	x 2	notebooks notebooks	part_2_large_scale_understanding.ipynb part_3_time_series_forecasting.ipynb	735:740 (<1%) 1553:1558 (<1%)	view
6	x 2	notebooks notebooks	multimodal_search_evaluation.ipynb multimodal_search_evaluation.ipynb	306:311 (<1%) 318:323 (<1%)	view
6	x 2	notebooks notebooks	part_3_time_series_forecasting.ipynb part_3_time_series_forecasting.ipynb	515:520 (<1%) 1274:1279 (<1%)	view
6	x 2	notebooks notebooks	part_3_time_series_forecasting.ipynb part_3_time_series_forecasting.ipynb	675:680 (<1%) 1669:1674 (<1%)	view
6	x 2	notebooks notebooks	part_2_large_scale_understanding.ipynb part_2_large_scale_understanding.ipynb	475:480 (<1%) 713:718 (<1%)	view
6	x 2	notebooks notebooks	part_3_time_series_forecasting.ipynb part_3_time_series_forecasting.ipynb	1622:1627 (<1%) 1669:1674 (<1%)	view
6	x 2	notebooks notebooks	part_2_large_scale_understanding.ipynb part_2_large_scale_understanding.ipynb	25:30 (<1%) 431:436 (<1%)	view
6	x 2	notebooks notebooks	part_3_time_series_forecasting.ipynb part_3_time_series_forecasting.ipynb	175:180 (<1%) 1698:1703 (<1%)	view
6	x 2	notebooks notebooks	part_2_large_scale_understanding.ipynb part_3_time_series_forecasting.ipynb	188:193 (<1%) 25:30 (<1%)	view
6	x 2	notebooks notebooks	multimodal_search_evaluation.ipynb multimodal_search_evaluation.ipynb	263:268 (<1%) 306:311 (<1%)	view