GoogleCloudPlatform / document-ai-samples

Duplication

Places in code with 6 or more lines that are exactly the same.

Longest Duplicates

The list of 50 longest duplicates.

See data for all 19,157 duplicates...

Size	#	Folders	Files	Lines	Code
159	x 2	document_ai_warehouse/common/src/common/utils document_ai_warehouse/do...house_processing_python	document_warehouse_utils.py document_warehouse_utils.py	66:299 (58%) 41:274 (62%)	view
82	x 2	incubator-tools/ocr_upgradation_tool incubator-tools/ocr_upgr...ol_using_enterprise_ocr	ocr_upgradation_tool.ipynb ocr_upgrade_tool_using_enterprise_ocr...	610:691 (7%) 549:630 (7%)	view
76	x 2	incubator-tools/map_ocr_...rmation_to_cde_entities incubator-tools/ocr_upgradation_tool	map_ocr_style_information_to_cde_enti... ocr_upgradation_tool.ipynb	143:218 (13%) 265:340 (7%)	view
66	x 2	incubator-tools/ocr_upgradation_tool incubator-tools/ocr_upgr...ol_using_enterprise_ocr	ocr_upgradation_tool.ipynb ocr_upgrade_tool_using_enterprise_ocr...	270:335 (6%) 259:324 (6%)	view
66	x 2	incubator-tools/map_ocr_...rmation_to_cde_entities incubator-tools/ocr_upgr...ol_using_enterprise_ocr	map_ocr_style_information_to_cde_enti... ocr_upgrade_tool_using_enterprise_ocr...	148:213 (11%) 259:324 (6%)	view
64	x 2	incubator-tools/advance_table_line_enhancement incubator-tools/advance_table_line_enhancement	Table_extraction_with_Line_Enhancemen... line_enhancement_basic_flow.ipynb	184:247 (14%) 191:254 (15%)	view
52	x 2	incubator-tools/lineitem_improver_crosspage incubator-tools/signature_detection	lineitem_improver_crosspage.ipynb signature_detection.ipynb	48:99 (11%) 48:99 (9%)	view
52	x 2	incubator-tools/lineitem_improver_crosspage incubator-tools/lineitem...rover_using_column_data	lineitem_improver_crosspage.ipynb lineitem_improver_using_column_data.i...	48:99 (11%) 48:99 (11%)	view
52	x 2	incubator-tools/ocr_upgradation_tool incubator-tools/ocr_upgr...ol_using_enterprise_ocr	ocr_upgradation_tool.ipynb ocr_upgrade_tool_using_enterprise_ocr...	336:387 (4%) 207:258 (4%)	view
52	x 2	incubator-tools/lineitem...rover_using_column_data incubator-tools/signature_detection	lineitem_improver_using_column_data.i... signature_detection.ipynb	48:99 (11%) 48:99 (9%)	view
51	x 2	incubator-tools/tag_line...n_to_layout_text_blocks incubator-tools/update_cde_schema	tag_line_information_to_layout_text_b... update_cde_schema.ipynb	50:100 (12%) 50:100 (11%)	view
49	x 2	incubator-tools/bank_sta...nd_missing_items_finder incubator-tools/map_ocr_...rmation_to_cde_entities	bank_statements_line_items_improver_a... map_ocr_style_information_to_cde_enti...	284:332 (4%) 275:323 (8%)	view
40	x 2	incubator-tools/character_box_removal incubator-tools/ocr_upgr...ol_using_enterprise_ocr	character_box_removal.ipynb ocr_upgrade_tool_using_enterprise_ocr...	47:86 (9%) 56:95 (3%)	view
40	x 2	incubator-tools/bank_sta...nd_missing_items_finder incubator-tools/specific_format_line_items_tagging	bank_statements_line_items_improver_a... specific_format_line_items_tagging.ipynb	37:76 (3%) 52:91 (4%)	view
40	x 2	incubator-tools/image_segmentation incubator-tools/ocr_upgr...ol_using_enterprise_ocr	image_segmentation.ipynb ocr_upgrade_tool_using_enterprise_ocr...	47:86 (10%) 56:95 (3%)	view
40	x 2	incubator-tools/image_segmentation incubator-tools/lineitem...rover_using_column_data	image_segmentation.ipynb lineitem_improver_using_column_data.i...	47:86 (10%) 48:87 (9%)	view
40	x 2	incubator-tools/image_segmentation incubator-tools/signature_detection	image_segmentation.ipynb signature_detection.ipynb	47:86 (10%) 48:87 (7%)	view
40	x 2	incubator-tools/character_box_removal incubator-tools/signature_detection	character_box_removal.ipynb signature_detection.ipynb	47:86 (9%) 48:87 (7%)	view
40	x 2	incubator-tools/character_box_removal incubator-tools/lineitem...rover_using_column_data	character_box_removal.ipynb lineitem_improver_using_column_data.i...	47:86 (9%) 48:87 (9%)	view
40	x 2	incubator-tools/image_segmentation incubator-tools/lineitem_improver_crosspage	image_segmentation.ipynb lineitem_improver_crosspage.ipynb	47:86 (10%) 48:87 (9%)	view
40	x 2	incubator-tools/advance_table_line_enhancement incubator-tools/advance_table_line_enhancement	Table_extraction_with_Line_Enhancemen... line_enhancement_basic_flow.ipynb	400:439 (9%) 383:422 (9%)	view
40	x 2	incubator-tools/character_box_removal incubator-tools/lineitem_improver_crosspage	character_box_removal.ipynb lineitem_improver_crosspage.ipynb	47:86 (9%) 48:87 (9%)	view
40	x 2	incubator-tools/lineitem_improver_crosspage incubator-tools/ocr_upgr...ol_using_enterprise_ocr	lineitem_improver_crosspage.ipynb ocr_upgrade_tool_using_enterprise_ocr...	48:87 (9%) 56:95 (3%)	view
40	x 2	incubator-tools/lineitem...rover_using_column_data incubator-tools/ocr_upgr...ol_using_enterprise_ocr	lineitem_improver_using_column_data.i... ocr_upgrade_tool_using_enterprise_ocr...	48:87 (9%) 56:95 (3%)	view
40	x 2	incubator-tools/ocr_upgr...ol_using_enterprise_ocr incubator-tools/signature_detection	ocr_upgrade_tool_using_enterprise_ocr... signature_detection.ipynb	56:95 (3%) 48:87 (7%)	view
40	x 2	incubator-tools/character_box_removal incubator-tools/image_segmentation	character_box_removal.ipynb image_segmentation.ipynb	47:86 (9%) 47:86 (10%)	view
40	x 2	document_ai_warehouse/common/src/common/utils document_ai_warehouse/do...house_processing_python	document_warehouse_utils.py document_warehouse_utils.py	303:361 (14%) 277:337 (15%)	view
39	x 2	incubator-tools/lineitem...rover_using_column_data incubator-tools/signature_detection	lineitem_improver_using_column_data.i... signature_detection.ipynb	404:442 (8%) 485:523 (7%)	view
39	x 2	document_ai_warehouse/do...house_processing_python document_ai_warehouse/do...house_processing_python	dw_processing.ipynb dw_processing.ipynb	1012:1050 (3%) 1120:1158 (3%)	view
39	x 2	incubator-tools/amount_r...n_from_words_to_numbers incubator-tools/extending_entity_bounding_boxes	amount_rectification_from_words_to_nu... extending_entity_bounding_box.ipynb	43:81 (5%) 41:79 (8%)	view
39	x 2	incubator-tools/add_vertices_to_entities incubator-tools/map_ocr_...rmation_to_cde_entities	add_vertices_to_entities.ipynb map_ocr_style_information_to_cde_enti...	47:85 (10%) 48:86 (6%)	view
39	x 2	web-app-demo/Frontend/src/app web-app-demo/Frontend/sr...nts/processor-selection	app.component.ts processor-selection.component.ts	59:100 (47%) 73:114 (19%)	view
39	x 2	incubator-tools/add_vertices_to_entities incubator-tools/convert_...se_to_documentai_format	add_vertices_to_entities.ipynb convert_automl_response_to_documentai...	47:85 (10%) 48:86 (8%)	view
39	x 2	incubator-tools/add_vertices_to_entities incubator-tools/set_field_description_via_api	add_vertices_to_entities.ipynb set_field_description_via_api.ipynb	47:85 (10%) 50:88 (12%)	view
39	x 2	incubator-tools/convert_...se_to_documentai_format incubator-tools/set_field_description_via_api	convert_automl_response_to_documentai... set_field_description_via_api.ipynb	48:86 (8%) 50:88 (12%)	view
39	x 2	incubator-tools/image_segmentation incubator-tools/lineitem...rover_using_column_data	image_segmentation.ipynb lineitem_improver_using_column_data.i...	328:366 (10%) 404:442 (8%)	view
39	x 2	incubator-tools/convert_...se_to_documentai_format incubator-tools/map_ocr_...rmation_to_cde_entities	convert_automl_response_to_documentai... map_ocr_style_information_to_cde_enti...	48:86 (8%) 48:86 (6%)	view
39	x 2	incubator-tools/tag_line...n_to_layout_text_blocks incubator-tools/update_cde_schema	tag_line_information_to_layout_text_b... update_cde_schema.ipynb	375:413 (9%) 403:441 (8%)	view
39	x 2	incubator-tools/image_segmentation incubator-tools/signature_detection	image_segmentation.ipynb signature_detection.ipynb	328:366 (10%) 485:523 (7%)	view
39	x 2	incubator-tools/lineitem_improver_crosspage incubator-tools/ocr_upgr...ol_using_enterprise_ocr	lineitem_improver_crosspage.ipynb ocr_upgrade_tool_using_enterprise_ocr...	400:438 (8%) 1040:1078 (3%)	view
39	x 2	incubator-tools/entity_label_restructuring_tool incubator-tools/export_i..._document_schema_gemini	entity_label_restructuring_tool.ipynb export_import_document_schema_gemini....	622:660 (5%) 655:693 (5%)	view
39	x 2	incubator-tools/map_ocr_...rmation_to_cde_entities incubator-tools/set_field_description_via_api	map_ocr_style_information_to_cde_enti... set_field_description_via_api.ipynb	48:86 (6%) 50:88 (12%)	view
38	x 2	incubator-tools/labeled_dataset_validation incubator-tools/reorder_...based_on_unique_strings	labeled_dataset_validation.ipynb reorder_document_page_based_on_unique...	372:409 (9%) 326:363 (10%)	view
38	x 2	incubator-tools/best-pra...ng_poor_performing_docs incubator-tools/reorder_...based_on_unique_strings	identifying_poor_performing_docs.ipynb reorder_document_page_based_on_unique...	564:601 (6%) 326:363 (10%)	view
38	x 2	incubator-tools/best-pra...ng_poor_performing_docs incubator-tools/labeled_dataset_validation	identifying_poor_performing_docs.ipynb labeled_dataset_validation.ipynb	564:601 (6%) 372:409 (9%)	view
37	x 2	incubator-tools/rename_entity_type incubator-tools/reorder_...based_on_unique_strings	rename_entity_type.ipynb reorder_document_page_based_on_unique...	246:282 (13%) 327:363 (10%)	view
37	x 2	incubator-tools/labeled_dataset_validation incubator-tools/rename_entity_type	labeled_dataset_validation.ipynb rename_entity_type.ipynb	373:409 (9%) 246:282 (13%)	view
37	x 2	incubator-tools/ocr_upgradation_tool incubator-tools/ocr_upgr...ol_using_enterprise_ocr	ocr_upgradation_tool.ipynb ocr_upgrade_tool_using_enterprise_ocr...	386:422 (3%) 323:359 (3%)	view
37	x 2	incubator-tools/cer_wer incubator-tools/language_detection	cer_wer.ipynb language_detection.ipynb	10:46 (12%) 10:46 (6%)	view
37	x 2	incubator-tools/best-pra...ng_poor_performing_docs incubator-tools/rename_entity_type	identifying_poor_performing_docs.ipynb rename_entity_type.ipynb	565:601 (6%) 246:282 (13%)	view

Duplicated Units

The list of top 6 duplicated units.

See data for all 6 unit duplicates...

Size	#	Folders	Files	Lines	Code
39	x 2	web-app-demo/Frontend/sr...nts/processor-selection web-app-demo/Frontend/src/app	processor-selection.component.ts app.component.ts	73:115  59:101	view
21	x 2	web-app-demo/Frontend/sr...nts/processor-selection web-app-demo/Frontend/src/app	processor-selection.component.ts app.component.ts	134:158  107:131	view
17	x 2	document_ai_warehouse/common/src/common/utils document_ai_warehouse/do...house_processing_python	document_ai_utils.py document_ai_utils.py	0:0  0:0	view
12	x 2	document_ai_warehouse/common/src/common/utils document_ai_warehouse/do...house_processing_python	document_warehouse_utils.py document_warehouse_utils.py	0:0  0:0	view
7	x 2	web-app-pix2info-python/src/frontend community/identity-form-...ler-python/src/frontend	scripts.js scripts.js	265:273  340:348	view
11	x 2	community/codelabs/docai-form-parser extract-tables	table_parsing.py main.py	0:0  0:0	view