G

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

53% duplication:

11,609 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
6,236 duplicated lines

1,019 duplicates

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
evaluation (43%) --> ROOT (24%)	964	16 file pairs	details...
ROOT (1%) --> vilbert (<1%)	60	3 file pairs	details...

Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 20 longest duplicates.

See data for all 1,019 duplicates...

Size	#	Folders	Files	Lines	Code
132	x 2	vilbert/datasets vilbert/datasets	gqa_dataset.py visual_genome_dataset.py	86:253 (70%) 73:239 (76%)	view
118	x 2	vilbert vilbert	task_utils.py task_utils.py	187:312 (16%) 638:763 (16%)	view
118	x 2	vilbert/datasets vilbert/datasets	gqa_dataset.py vqa_dataset.py	100:253 (63%) 175:325 (46%)	view
118	x 2	vilbert/datasets vilbert/datasets	visual_genome_dataset.py vqa_dataset.py	87:239 (68%) 175:325 (46%)	view
102	x 2	evaluation evaluation	eval_coco_retrieval.py eval_concap_retrieval.py	58:168 (32%) 57:167 (36%)	view
87	x 2	ROOT ROOT	eval_retrieval.py eval_tasks.py	27:122 (30%) 27:120 (34%)	view
82	x 2	vilbert/datasets vilbert/datasets	guesswhat_dataset.py visual_genome_dataset.py	99:213 (55%) 126:239 (47%)	view
82	x 2	vilbert/datasets vilbert/datasets	gqa_dataset.py guesswhat_dataset.py	139:253 (44%) 99:213 (55%)	view
82	x 2	vilbert/datasets vilbert/datasets	guesswhat_dataset.py vqa_dataset.py	99:213 (55%) 213:325 (32%)	view
74	x 2	vilbert vilbert	task_utils.py task_utils.py	45:123 (10%) 249:327 (10%)	view
68	x 2	vilbert/datasets vilbert/datasets	guesswhat_pointing_dataset.py visual7w_pointing_dataset.py	64:138 (28%) 63:136 (30%)	view
66	x 2	evaluation evaluation	eval_concap_retrieval.py eval_vqa.py	117:183 (23%) 116:182 (22%)	view
66	x 2	vilbert/datasets vilbert/datasets	flickr_grounding_dataset.py visual7w_pointing_dataset.py	183:255 (22%) 63:134 (29%)	view
66	x 2	vilbert/datasets vilbert/datasets	flickr_grounding_dataset.py guesswhat_pointing_dataset.py	183:255 (22%) 64:136 (27%)	view
61	x 2	vilbert/datasets vilbert/datasets	flickr_grounding_dataset.py refer_expression_dataset.py	353:430 (20%) 241:318 (27%)	view
61	x 2	vilbert vilbert	task_utils.py task_utils.py	45:108 (8%) 700:763 (8%)	view
55	x 2	vilbert/datasets vilbert/datasets	guesswhat_pointing_dataset.py refer_expression_dataset.py	80:141 (23%) 93:157 (24%)	view
52	x 2	vilbert/datasets vilbert/datasets	refer_expression_dataset.py visual7w_pointing_dataset.py	93:154 (23%) 79:136 (23%)	view
50	x 2	vilbert/datasets vilbert/datasets	flickr_grounding_dataset.py refer_expression_dataset.py	199:255 (16%) 93:152 (22%)	view
50	x 2	evaluation evaluation	eval_coco_retrieval.py eval_vqa.py	118:168 (15%) 116:166 (16%)	view

Duplicated Units

The list of top 20 duplicated units.

See data for all 29 unit duplicates...

Size	#	Folders	Files	Lines	Code
37	x 3	vilbert/datasets vilbert/datasets vilbert/datasets	guesswhat_dataset.py visual_genome_dataset.py gqa_dataset.py	0:0 0:0 0:0	view
34	x 2	vilbert/datasets vilbert/datasets	concept_cap_dataset.py concept_cap_dataset.py	0:0 0:0	view
30	x 5	vilbert/datasets vilbert/datasets vilbert/datasets vilbert/datasets vilbert/datasets	flickr_grounding_dataset.py visual7w_pointing_dataset.py refer_dense_caption.py guesswhat_pointing_dataset.py refer_expression_dataset.py	0:0 0:0 0:0 0:0 0:0	view
24	x 2	script script	extract_features_from_gt.py extract_features.py	0:0 0:0	view
19	x 4	vilbert/datasets vilbert/datasets vilbert/datasets vilbert/datasets	guesswhat_dataset.py visual_genome_dataset.py gqa_dataset.py vqa_dataset.py	0:0 0:0 0:0 0:0	view
18	x 3	vilbert/datasets vilbert/datasets vilbert/datasets	visual_entailment_dataset.py vismadlibs_dataset.py nlvr2_dataset.py	0:0 0:0 0:0	view
26	x 2	vilbert/datasets vilbert/datasets	visual_genome_dataset.py gqa_dataset.py	0:0 0:0	view
26	x 3	vilbert/datasets vilbert/datasets vilbert/datasets	flickr_grounding_dataset.py visual7w_pointing_dataset.py refer_expression_dataset.py	0:0 0:0 0:0	view
13	x 3	vilbert/datasets vilbert/datasets vilbert/datasets	visual_genome_dataset.py gqa_dataset.py visual_entailment_dataset.py	0:0 0:0 0:0	view
13	x 4	vilbert/datasets vilbert/datasets vilbert/datasets vilbert/datasets	flickr_grounding_dataset.py visual7w_pointing_dataset.py guesswhat_pointing_dataset.py refer_expression_dataset.py	0:0 0:0 0:0 0:0	view
13	x 2	vilbert/datasets vilbert/datasets	vqa_dataset.py visdial_dataset.py	0:0 0:0	view
11	x 2	vilbert vilbert	vilbert.py vilbert.py	0:0 0:0	view
11	x 2	vilbert/datasets vilbert/datasets	guesswhat_dataset.py vqa_mc_dataset.py	0:0 0:0	view
9	x 2	vilbert vilbert	vilbert.py basebert.py	0:0 0:0	view
11	x 2	vilbert vilbert	vilbert.py basebert.py	0:0 0:0	view
9	x 2	vilbert/datasets vilbert/datasets	vismadlibs_dataset.py vqa_dataset.py	0:0 0:0	view
8	x 2	script script	extract_features_from_gt.py extract_features.py	0:0 0:0	view
8	x 2	vilbert vilbert	vilbert.py basebert.py	0:0 0:0	view
7	x 2	vilbert vilbert	vilbert.py vilbert.py	0:0 0:0	view
11	x 2	vilbert vilbert	vilbert.py basebert.py	0:0 0:0	view