GoogleCloudPlatform / document-intake-accelerator

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

40% duplication:

14,420 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
5,790 duplicated lines

2,216 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
cloudrun (195%) --> microservices (7%)	1539	125 file pairs	details...
common (4%) --> microservices (<1%)	94	2 file pairs	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 2,216 duplicates...

Size	#	Folders	Files	Lines	Code
110	x 2	utils/fake_data_generation utils/fake_data_generation	generate_data_arizona.py generate_data_arkansas.py	142:275 (56%) 124:258 (61%)	view
90	x 2	utils/fake_data_generation utils/fake_data_generation	generate_data_arizona.py generate_data_california.py	167:275 (45%) 157:265 (48%)	view
90	x 2	utils/fake_data_generation utils/fake_data_generation	generate_data_arkansas.py generate_data_california.py	149:258 (50%) 157:265 (48%)	view
90	x 2	utils/fake_data_generation utils/fake_data_generation	generate_data_california.py generate_data_illinois.py	157:265 (48%) 151:258 (49%)	view
90	x 2	utils/fake_data_generation utils/fake_data_generation	generate_data_arkansas.py generate_data_illinois.py	149:258 (50%) 151:258 (49%)	view
90	x 2	utils/fake_data_generation utils/fake_data_generation	generate_data_arizona.py generate_data_illinois.py	167:275 (45%) 151:258 (49%)	view
69	x 2	microservices/adp_ui/src/components microservices/adp_ui/src/components	DocumentReview.js DocumentReviewPdfHighlight.js	261:339 (15%) 266:345 (15%)	view
56	x 2	utils/fake_data_generation utils/fake_data_generation	generate_data_arizona.py generate_data_california.py	33:110 (28%) 32:109 (29%)	view
56	x 2	utils/fake_data_generation utils/fake_data_generation	generate_data_arizona.py generate_data_illinois.py	33:110 (28%) 32:109 (30%)	view
56	x 2	utils/fake_data_generation utils/fake_data_generation	generate_data_arkansas.py generate_data_illinois.py	32:109 (31%) 32:109 (30%)	view
56	x 2	utils/fake_data_generation utils/fake_data_generation	generate_data_arkansas.py generate_data_california.py	32:109 (31%) 32:109 (29%)	view
56	x 2	utils/fake_data_generation utils/fake_data_generation	generate_data_california.py generate_data_illinois.py	32:109 (29%) 32:109 (30%)	view
56	x 2	utils/fake_data_generation utils/fake_data_generation	generate_data_arizona.py generate_data_arkansas.py	33:110 (28%) 32:109 (31%)	view
36	x 2	microservices/adp_ui/src/components microservices/adp_ui/src/components	DataTables.js SearchApplicantTable.js	506:547 (6%) 195:235 (15%)	view
29	x 2	microservices/adp_ui/src/components microservices/adp_ui/src/components	DocumentReview.js DocumentReviewPdfHighlight.js	499:529 (6%) 473:505 (6%)	view
28	x 2	microservices/hitl_service/kustomize/base microservices/matching_service/kustomize/base	deployment.yaml deployment.yaml	33:60 (60%) 33:60 (60%)	view
28	x 2	microservices/matching_service/kustomize/base microservices/upload_service/kustomize/base	deployment.yaml deployment.yaml	33:60 (60%) 33:60 (60%)	view
28	x 2	microservices/matching_service/kustomize/base microservices/sample_service/kustomize/base	deployment.yaml deployment.yaml	33:60 (60%) 33:60 (60%)	view
28	x 2	cloudrun/queue/kustomize/base microservices/document_s..._service/kustomize/base	deployment.yaml deployment.yaml	19:46 (60%) 33:60 (60%)	view
28	x 2	microservices/adp_ui/src/components microservices/adp_ui/src/components	Classify.js ReAssign.js	85:122 (25%) 135:171 (12%)	view
28	x 2	microservices/sample_service/kustomize/base microservices/validation_service/kustomize/base	deployment.yaml deployment.yaml	33:60 (60%) 33:60 (60%)	view
28	x 2	microservices/extraction_service/kustomize/base microservices/matching_service/kustomize/base	deployment.yaml deployment.yaml	33:60 (60%) 33:60 (60%)	view
28	x 2	cloudrun/queue/kustomize/base microservices/extraction_service/kustomize/base	deployment.yaml deployment.yaml	19:46 (60%) 33:60 (60%)	view
28	x 2	microservices/extraction_service/kustomize/base microservices/validation_service/kustomize/base	deployment.yaml deployment.yaml	33:60 (60%) 33:60 (60%)	view
28	x 2	microservices/extraction_service/kustomize/base microservices/sample_service/kustomize/base	deployment.yaml deployment.yaml	33:60 (60%) 33:60 (60%)	view
28	x 2	microservices/hitl_service/src microservices/upload_service/src	main.py main.py	34:67 (70%) 31:64 (70%)	view
28	x 2	microservices/adp_ui/src/components microservices/adp_ui/src/components	DocumentReviewPdfHighlight.js ReAssign.js	142:179 (6%) 135:171 (12%)	view
28	x 2	cloudrun/queue/kustomize/base microservices/validation_service/kustomize/base	deployment.yaml deployment.yaml	19:46 (60%) 33:60 (60%)	view
28	x 2	microservices/matching_service/kustomize/base microservices/validation_service/kustomize/base	deployment.yaml deployment.yaml	33:60 (60%) 33:60 (60%)	view
28	x 2	microservices/classifica..._service/kustomize/base microservices/upload_service/kustomize/base	deployment.yaml deployment.yaml	33:60 (60%) 33:60 (60%)	view
28	x 2	microservices/document_s..._service/kustomize/base microservices/matching_service/kustomize/base	deployment.yaml deployment.yaml	33:60 (60%) 33:60 (60%)	view
28	x 2	microservices/classifica..._service/kustomize/base microservices/document_s..._service/kustomize/base	deployment.yaml deployment.yaml	33:60 (60%) 33:60 (60%)	view
28	x 2	microservices/hitl_service/kustomize/base microservices/upload_service/kustomize/base	deployment.yaml deployment.yaml	33:60 (60%) 33:60 (60%)	view
28	x 2	microservices/hitl_service/kustomize/base microservices/sample_service/kustomize/base	deployment.yaml deployment.yaml	33:60 (60%) 33:60 (60%)	view
28	x 2	microservices/adp_ui/src/components microservices/adp_ui/src/components	Classify.js DocumentReviewPdfHighlight.js	85:122 (25%) 142:179 (6%)	view
28	x 2	microservices/document_s..._service/kustomize/base microservices/hitl_service/kustomize/base	deployment.yaml deployment.yaml	33:60 (60%) 33:60 (60%)	view
28	x 2	microservices/classifica..._service/kustomize/base microservices/matching_service/kustomize/base	deployment.yaml deployment.yaml	33:60 (60%) 33:60 (60%)	view
28	x 2	microservices/document_s..._service/kustomize/base microservices/validation_service/kustomize/base	deployment.yaml deployment.yaml	33:60 (60%) 33:60 (60%)	view
28	x 2	microservices/classifica..._service/kustomize/base microservices/hitl_service/kustomize/base	deployment.yaml deployment.yaml	33:60 (60%) 33:60 (60%)	view
28	x 2	microservices/hitl_service/kustomize/base microservices/validation_service/kustomize/base	deployment.yaml deployment.yaml	33:60 (60%) 33:60 (60%)	view
28	x 2	microservices/classifica..._service/kustomize/base microservices/sample_service/kustomize/base	deployment.yaml deployment.yaml	33:60 (60%) 33:60 (60%)	view
28	x 2	microservices/extraction_service/kustomize/base microservices/hitl_service/kustomize/base	deployment.yaml deployment.yaml	33:60 (60%) 33:60 (60%)	view
28	x 2	cloudrun/queue/kustomize/base microservices/sample_service/kustomize/base	deployment.yaml deployment.yaml	19:46 (60%) 33:60 (60%)	view
28	x 2	cloudrun/queue/kustomize/base microservices/matching_service/kustomize/base	deployment.yaml deployment.yaml	19:46 (60%) 33:60 (60%)	view
28	x 2	microservices/sample_service/kustomize/base microservices/upload_service/kustomize/base	deployment.yaml deployment.yaml	33:60 (60%) 33:60 (60%)	view
28	x 2	microservices/classifica..._service/kustomize/base microservices/extraction_service/kustomize/base	deployment.yaml deployment.yaml	33:60 (60%) 33:60 (60%)	view
28	x 2	cloudrun/queue/kustomize/base microservices/upload_service/kustomize/base	deployment.yaml deployment.yaml	19:46 (60%) 33:60 (60%)	view
28	x 2	cloudrun/queue/kustomize/base microservices/classifica..._service/kustomize/base	deployment.yaml deployment.yaml	19:46 (60%) 33:60 (60%)	view
28	x 2	microservices/document_s..._service/kustomize/base microservices/extraction_service/kustomize/base	deployment.yaml deployment.yaml	33:60 (60%) 33:60 (60%)	view
28	x 2	cloudrun/queue/kustomize/base microservices/hitl_service/kustomize/base	deployment.yaml deployment.yaml	19:46 (60%) 33:60 (60%)	view

Duplicated Units

The list of top 1 duplicated units.

See data for all 1 unit duplicate

Size	#	Folders	Files	Lines	Code
27	x 3	microservices/adp_ui/src/components microservices/adp_ui/src/components microservices/adp_ui/src/components	Classify.js DocumentReviewPdfHighlight.js ReAssign.js	87:123 144:180 137:172	view