GoogleCloudPlatform / dfcx-scrapi

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

12% duplication:

15,455 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
1,874 duplicated lines

740 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 740 duplicates...

Size	#	Folders	Files	Lines	Code
35	x 2	src/dfcx_scrapi/builders src/dfcx_scrapi/builders	flows.py pages.py	504:543 (10%) 614:653 (8%)	view
23	x 2	src/dfcx_scrapi/tools src/dfcx_scrapi/tools	dataframe_functions.py dataframe_functions.py	815:857 (3%) 876:918 (3%)	view
20	x 2	src/dfcx_scrapi/builders src/dfcx_scrapi/builders	flows.py pages.py	417:441 (6%) 518:542 (4%)	view
20	x 2	src/dfcx_scrapi/tools src/dfcx_scrapi/tools	dataframe_functions.py dataframe_functions.py	405:425 (2%) 537:557 (2%)	view
19	x 2	src/dfcx_scrapi/builders src/dfcx_scrapi/builders	flows.py pages.py	82:110 (5%) 95:123 (4%)	view
19	x 2	src/dfcx_scrapi/builders src/dfcx_scrapi/builders	flows.py pages.py	547:568 (5%) 657:678 (4%)	view
16	x 2	src/dfcx_scrapi/tools src/dfcx_scrapi/tools	dataframe_functions.py dataframe_functions.py	223:238 (2%) 407:422 (2%)	view
16	x 2	src/dfcx_scrapi/tools src/dfcx_scrapi/tools	dataframe_functions.py dataframe_functions.py	223:238 (2%) 539:554 (2%)	view
16	x 2	src/dfcx_scrapi/core src/dfcx_scrapi/core	data_stores.py sites.py	42:59 (14%) 45:62 (10%)	view
15	x 2	src/dfcx_scrapi/core src/dfcx_scrapi/core	engines.py sites.py	42:57 (12%) 45:60 (10%)	view
15	x 2	src/dfcx_scrapi/core src/dfcx_scrapi/core	data_stores.py engines.py	42:57 (13%) 42:57 (12%)	view
15	x 2	src/dfcx_scrapi/builders src/dfcx_scrapi/builders	flows.py pages.py	380:398 (4%) 481:499 (3%)	view
14	x 2	src/dfcx_scrapi/core src/dfcx_scrapi/tools	changelogs.py stats_util.py	37:50 (10%) 31:44 (17%)	view
14	x 2	src/dfcx_scrapi/core src/dfcx_scrapi/tools	generators.py copy_util.py	37:50 (9%) 45:58 (1%)	view
14	x 2	src/dfcx_scrapi/builders src/dfcx_scrapi/builders	flows.py pages.py	455:476 (4%) 556:577 (3%)	view
13	x 2	src/dfcx_scrapi/tools src/dfcx_scrapi/tools	copy_util.py copy_util.py	263:275 (1%) 954:966 (1%)	view
13	x 2	src/dfcx_scrapi/core src/dfcx_scrapi/tools	search.py validation_util.py	36:48 (3%) 36:48 (11%)	view
13	x 2	src/dfcx_scrapi/core src/dfcx_scrapi/tools	experiments.py copy_util.py	41:53 (23%) 45:57 (1%)	view
13	x 2	src/dfcx_scrapi/core src/dfcx_scrapi/core	experiments.py generators.py	41:53 (23%) 37:49 (8%)	view
12	x 2	src/dfcx_scrapi/tools src/dfcx_scrapi/tools	dataframe_functions.py dataframe_functions.py	347:359 (1%) 670:682 (1%)	view
12	x 2	src/dfcx_scrapi/tools src/dfcx_scrapi/tools	dataframe_functions.py dataframe_functions.py	336:347 (1%) 402:413 (1%)	view
12	x 2	src/dfcx_scrapi/tools src/dfcx_scrapi/tools	dataframe_functions.py dataframe_functions.py	339:351 (1%) 505:517 (1%)	view
12	x 2	src/dfcx_scrapi/tools src/dfcx_scrapi/tools	copy_util.py copy_util.py	967:978 (1%) 1052:1063 (1%)	view
12	x 2	src/dfcx_scrapi/builders src/dfcx_scrapi/builders	flows.py pages.py	482:500 (3%) 592:610 (2%)	view
11	x 2	src/dfcx_scrapi/builders src/dfcx_scrapi/builders	flows.py pages.py	132:142 (3%) 147:157 (2%)	view
11	x 2	src/dfcx_scrapi/tools src/dfcx_scrapi/tools	agent_checker_util.py validation_util.py	40:50 (10%) 38:48 (9%)	view
11	x 2	src/dfcx_scrapi/core src/dfcx_scrapi/core	search.py sites.py	38:48 (2%) 48:58 (7%)	view
11	x 2	src/dfcx_scrapi/core src/dfcx_scrapi/tools	engines.py validation_util.py	45:55 (9%) 38:48 (9%)	view
11	x 2	src/dfcx_scrapi/builders src/dfcx_scrapi/builders	pages.py transition_route_groups.py	481:493 (2%) 170:182 (12%)	view
11	x 2	src/dfcx_scrapi/core src/dfcx_scrapi/tools	search.py agent_checker_util.py	38:48 (2%) 40:50 (10%)	view
11	x 2	src/dfcx_scrapi/builders src/dfcx_scrapi/builders	flows.py pages.py	314:330 (3%) 382:398 (2%)	view
11	x 2	src/dfcx_scrapi/tools src/dfcx_scrapi/tools	dataframe_functions.py dataframe_functions.py	253:264 (1%) 574:585 (1%)	view
11	x 2	src/dfcx_scrapi/core src/dfcx_scrapi/core	engines.py search.py	45:55 (9%) 38:48 (2%)	view
11	x 2	src/dfcx_scrapi/core src/dfcx_scrapi/tools	data_stores.py agent_checker_util.py	45:55 (10%) 40:50 (10%)	view
11	x 2	src/dfcx_scrapi/core src/dfcx_scrapi/tools	sites.py validation_util.py	48:58 (7%) 38:48 (9%)	view
11	x 2	src/dfcx_scrapi/core src/dfcx_scrapi/tools	data_stores.py validation_util.py	45:55 (10%) 38:48 (9%)	view
11	x 2	src/dfcx_scrapi/core src/dfcx_scrapi/core	data_stores.py search.py	45:55 (10%) 38:48 (2%)	view
11	x 2	src/dfcx_scrapi/core src/dfcx_scrapi/tools	sites.py agent_checker_util.py	48:58 (7%) 40:50 (10%)	view
11	x 2	src/dfcx_scrapi/builders src/dfcx_scrapi/builders	flows.py transition_route_groups.py	380:392 (3%) 170:182 (12%)	view
11	x 2	src/dfcx_scrapi/builders src/dfcx_scrapi/builders	flows.py pages.py	286:302 (3%) 355:371 (2%)	view
11	x 2	src/dfcx_scrapi/core src/dfcx_scrapi/core	conversation.py conversation.py	478:489 (2%) 509:520 (2%)	view
11	x 2	src/dfcx_scrapi/core src/dfcx_scrapi/tools	engines.py agent_checker_util.py	45:55 (9%) 40:50 (10%)	view
10	x 2	src/dfcx_scrapi/core src/dfcx_scrapi/core	changelogs.py generators.py	44:55 (7%) 44:55 (6%)	view
10	x 2	src/dfcx_scrapi/builders src/dfcx_scrapi/builders	flows.py pages.py	25:40 (3%) 26:41 (2%)	view
10	x 2	src/dfcx_scrapi/tools src/dfcx_scrapi/tools	copy_util.py copy_util.py	799:809 (1%) 885:895 (1%)	view
10	x 2	src/dfcx_scrapi/tools src/dfcx_scrapi/tools	search_util.py search_util.py	637:647 (1%) 664:673 (1%)	view
10	x 2	src/dfcx_scrapi/core src/dfcx_scrapi/core	flows.py transition_route_groups.py	45:54 (3%) 45:54 (3%)	view
10	x 2	src/dfcx_scrapi/tools src/dfcx_scrapi/tools	copy_util.py copy_util.py	777:787 (1%) 863:873 (1%)	view
9	x 2	src/dfcx_scrapi/tools src/dfcx_scrapi/tools	dataframe_functions.py dataframe_functions.py	505:513 (1%) 537:545 (1%)	view
9	x 2	src/dfcx_scrapi/core src/dfcx_scrapi/core	agents.py transition_route_groups.py	43:51 (2%) 46:54 (3%)	view

Duplicated Units

The list of top 1 duplicated units.

See data for all 1 unit duplicate

Size	#	Folders	Files	Lines	Code
22	x 2	src/dfcx_scrapi/builders src/dfcx_scrapi/builders	pages.py flows.py	0:0 0:0	view