Places in code with 6 or more lines that are exactly the same.
Intro
- For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
- Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
- You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.
- To learn more about duplications and techniques for eliminating duplication, Sokrates recommends the following resources:
- Avoid Repetition, MartinFlower.com (IEEE Software article)
- Refactoring duplicated code, sourcemaking.com
- Beck Design Rules, MartinFowler.com
- DRY (Don't Repeat Yourself) Principle, Wikipedia
- The Cut-and-Paste Programming Software Development Anti-Pattern, sourcemaking.com
- Code Smells / Duplicated Code, Jeff Atwood, codinghorror.com:
- "Duplicated code is the bane of software development. Stamp out duplication whenever possible. You should always be on the lookout for more subtle cases of near-duplication, too. Don't Repeat Yourself!"
- Reducing Coupling, MartinFlower.com (IEEE Software article):
- "There are several ways to describe coupling, but it boils down to this: If changing one module in a program requires changing another module, then coupling exists. ... Duplication always implies coupling, because changing one piece of duplicate code implies changing the other."
Duplication Overall
- 14% duplication:
- 74,756 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
- 10,676 duplicated lines
- 159,032 duplicates
Duplication per Extension
Duplication per Component (primary)
Duplication Between Components (50+ lines)
Open 3D force graph...
Show more details on duplication between components...
From Component
--> To Component
Duplicated
Lines
File Pairs
Details
CodeXGLUE/Code-Code/Clone-detection-BigCloneBench (48%)
--> CodeXGLUE/Text-Code/NL-code-search-Adv (50%)
540
3 file pairs
details...
CodeXGLUE/Code-Text/code-to-text (18%)
--> CodeXGLUE/Text-Code/text-to-code (19%)
322
2 file pairs
details...
CodeXGLUE/Code-Code/Clone-detection-BigCloneBench (18%)
--> CodeXGLUE/Text-Code/text-to-code (12%)
209
1 file pair
details...
CodeXGLUE/Text-Code/NL-code-search-Adv (19%)
--> CodeXGLUE/Text-Code/text-to-code (12%)
207
1 file pair
details...
CodeXGLUE/Code-Code/Clone-detection-BigCloneBench (6%)
--> CodeXGLUE/Code-Text/code-to-text (3%)
68
1 file pair
details...
CodeXGLUE/Code-Text/code-to-text (3%)
--> CodeXGLUE/Text-Code/NL-code-search-Adv (6%)
68
1 file pair
details...
| From Component --> To Component |
Duplicated Lines |
File Pairs | Details |
|---|---|---|---|
| CodeXGLUE/Code-Code/Clone-detection-BigCloneBench (48%) --> CodeXGLUE/Text-Code/NL-code-search-Adv (50%) |
540 | 3 file pairs | details... |
| CodeXGLUE/Code-Text/code-to-text (18%) --> CodeXGLUE/Text-Code/text-to-code (19%) |
322 | 2 file pairs | details... |
| CodeXGLUE/Code-Code/Clone-detection-BigCloneBench (18%) --> CodeXGLUE/Text-Code/text-to-code (12%) |
209 | 1 file pair | details... |
| CodeXGLUE/Text-Code/NL-code-search-Adv (19%) --> CodeXGLUE/Text-Code/text-to-code (12%) |
207 | 1 file pair | details... |
| CodeXGLUE/Code-Code/Clone-detection-BigCloneBench (6%) --> CodeXGLUE/Code-Text/code-to-text (3%) |
68 | 1 file pair | details... |
| CodeXGLUE/Code-Text/code-to-text (3%) --> CodeXGLUE/Text-Code/NL-code-search-Adv (6%) |
68 | 1 file pair | details... |
Longest Duplicates
The list of 20 longest duplicates.
| Size | # | Folders | Files | Lines | Code |
|---|---|---|---|---|---|
| 152 | x 2 | CodeXGLUE/Code-Text/code-to-text/codeCodeXGLUE/Code-Text/code-to-text/evaluator |  bleu.pyevaluator.py |
3:199 (100%)3:199 (100%) | view |
| 85 | x 2 | CodeXGLUE/Code-Code/Clon...tion-BigCloneBench/codeCodeXGLUE/Text-Code/NL-code-search-Adv/code | run.pyrun.py |
435:528 (17%)414:507 (18%) | view |
| 84 | x 2 | data/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/java |  SORT_EVEN_PLACED_ELEMENTS_INCREASING_...SPLIT_ARRAY_ADD_FIRST_PART_END.java |
12:105 (100%)12:106 (100%) | view |
| 81 | x 2 | CodeXGLUE/Code-Text/code-to-text/codeCodeXGLUE/Text-Code/text-to-code/code | model.pybeam.py |
104:226 (54%)96:218 (57%) | view |
| 71 | x 2 | CodeXGLUE/Text-Code/text-to-code/codeCodeXGLUE/Text-Code/text-to-code/evaluator | bleu.pybleu.py |
28:134 (100%)28:134 (100%) | view |
| 60 | x 2 | CodeXGLUE/Code-Text/code-to-text/codeCodeXGLUE/Text-Code/text-to-code/code | model.pybeam.py |
9:94 (40%)9:94 (42%) | view |
| 51 | x 2 | codegen_sources/preprocessing/dataset_modescodegen_sources/preprocessing/dataset_modes | obfuscation_functions_mode.pyobfuscation_mode.py |
47:101 (34%)44:97 (42%) | view |
| 51 | x 2 | data/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/java | FIND_THE_MINIMUM_DISTANCE_BETWEEN_TWO...FIND_THE_MINIMUM_DISTANCE_BETWEEN_TWO... |
25:84 (82%)36:96 (72%) | view |
| 45 | x 2 | data/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/java | FIND_WHETHER_AN_ARRAY_IS_SUBSET_OF_AN...FIND_WHETHER_AN_ARRAY_IS_SUBSET_OF_AN... |
30:74 (72%)33:77 (70%) | view |
| 41 | x 2 | CodeXGLUE/Code-Code/Clon...tion-BigCloneBench/codeCodeXGLUE/Text-Code/NL-code-search-Adv/code | run.pyrun.py |
532:587 (8%)511:569 (8%) | view |
| 40 | x 2 | data/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/java | DISTRIBUTING_ITEMS_PERSON_CANNOT_TAKE...DISTRIBUTING_ITEMS_PERSON_CANNOT_TAKE... |
26:74 (76%)22:70 (81%) | view |
| 32 | x 2 | data/transcoder_evaluation_gfg/pythondata/transcoder_evaluation_gfg/python | MOVE_VE_ELEMENTS_END_ORDER_EXTRA_SPAC...MOVE_ZEROES_END_ARRAY.py |
26:57 (68%)20:51 (78%) | view |
| 32 | x 2 | codegen_sources/preprocessing/dataset_modescodegen_sources/preprocessing/dataset_modes | obfuscation_functions_mode.pyobfuscation_mode.py |
153:187 (21%)124:158 (26%) | view |
| 32 | x 2 | codegen_sources/preprocessing/dataset_modescodegen_sources/preprocessing/dataset_modes | monolingual_functions_mode.pymonolingual_mode.py |
44:77 (28%)40:74 (27%) | view |
| 31 | x 2 | CodeXGLUE/Code-Code/Clon...tion-BigCloneBench/codeCodeXGLUE/Text-Code/NL-code-search-Adv/code | run.pyrun.py |
208:246 (6%)182:220 (6%) | view |
| 29 | x 2 | codegen_sources/preprocessing/dataset_modescodegen_sources/preprocessing/dataset_modes | monolingual_functions_mode.pyobfuscation_mode.py |
48:79 (25%)48:79 (23%) | view |
| 29 | x 2 | codegen_sources/preprocessing/dataset_modescodegen_sources/preprocessing/dataset_modes | monolingual_functions_mode.pyobfuscation_functions_mode.py |
48:79 (25%)51:83 (19%) | view |
| 28 | x 2 | data/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/java | PRODUCT_NODES_K_TH_LEVEL_TREE_REPRESE...SUM_NODES_K_TH_LEVEL_TREE_REPRESENTED... |
32:63 (68%)32:63 (68%) | view |
| 28 | x 2 | data/transcoder_evaluation_gfg/pythondata/transcoder_evaluation_gfg/python | FIND_WHETHER_AN_ARRAY_IS_SUBSET_OF_AN...FIND_WHETHER_AN_ARRAY_IS_SUBSET_OF_AN... |
21:48 (73%)27:54 (63%) | view |
| 28 | x 2 | codegen_sources/preprocessing/dataset_modescodegen_sources/preprocessing/dataset_modes | monolingual_mode.pyobfuscation_functions_mode.py |
44:74 (24%)51:81 (19%) | view |
Duplicated Units
The list of top 20 duplicated units.
| Size | # | Folders | Files | Lines | Code |
|---|---|---|---|---|---|
| 78 | x 2 | data/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/java | SORT_EVEN_PLACED_ELEMENTS_INCREASING_...SPLIT_ARRAY_ADD_FIRST_PART_END.java |
28:106 29:107 | view |
| 54 | x 2 | data/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/java | FIND_THE_MINIMUM_DISTANCE_BETWEEN_TWO...FIND_THE_MINIMUM_DISTANCE_BETWEEN_TWO... |
31:85 42:97 | view |
| 54 | x 2 | data/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/java | FIND_WHETHER_AN_ARRAY_IS_SUBSET_OF_AN...FIND_WHETHER_AN_ARRAY_IS_SUBSET_OF_AN... |
30:84 33:87 | view |
| 55 | x 2 | CodeXGLUE/Text-Code/text-to-code/evaluatorCodeXGLUE/Text-Code/text-to-code/code | bleu.pybleu.py |
0:0 0:0 | view |
| 43 | x 2 | data/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/java | DISTRIBUTING_ITEMS_PERSON_CANNOT_TAKE...DISTRIBUTING_ITEMS_PERSON_CANNOT_TAKE... |
32:75 28:71 | view |
| 32 | x 11 | data/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/java... | COUNT_DISTINCT_OCCURRENCES_AS_A_SUBSE...WAYS_TRANSFORMING_ONE_STRING_REMOVING...WILDCARD_CHARACTER_MATCHING.javaCHECK_STRING_CAN_OBTAINED_ROTATING_AN...SPACE_OPTIMIZED_SOLUTION_LCS.javaFIND_ONE_EXTRA_CHARACTER_STRING_1.javaMAXIMUM_LENGTH_PREFIX_ONE_STRING_OCCU...LONGEST_COMMON_SUBSTRING_SPACE_OPTIMI...FIND_NUMBER_TIMES_STRING_OCCURS_GIVEN...CHECK_POSSIBLE_TRANSFORM_ONE_STRING_A...... |
40:72 50:82 24:56 26:58 35:67 31:63 27:59 44:76 39:71 45:77 ... | view |
| 32 | x 4 | data/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/java | SUM_TWO_LARGE_NUMBERS.javaSUM_TWO_LARGE_NUMBERS_1.javaMULTIPLY_LARGE_NUMBERS_REPRESENTED_AS...PROGRAM_CENSOR_WORD_ASTERISKS_SENTENC... |
46:78 44:76 49:81 32:64 | view |
| 32 | x 2 | data/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/java | PROGRAM_COUNT_OCCURRENCE_GIVEN_CHARAC...CHECK_OCCURRENCES_CHARACTER_APPEAR_TO... |
26:58 30:62 | view |
| 32 | x 2 | data/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/java | PRODUCT_NODES_K_TH_LEVEL_TREE_REPRESE...SUM_NODES_K_TH_LEVEL_TREE_REPRESENTED... |
32:64 32:64 | view |
| 28 | x 2 | CodeXGLUE/Code-Text/code-to-text/evaluatorCodeXGLUE/Code-Text/code-to-text/code | evaluator.pybleu.py |
0:0 0:0 | view |
| 33 | x 2 | codegen_sources/modelcodegen_sources/model | translate.pydeobfuscate.py |
0:0 0:0 | view |
| 25 | x 2 | data/transcoder_evaluation_gfg/cppdata/transcoder_evaluation_gfg/cpp |  FIND_WHETHER_AN_ARRAY_IS_SUBSET_OF_AN...FIND_WHETHER_AN_ARRAY_IS_SUBSET_OF_AN... |
35:60 35:60 | view |
| 23 | x 2 | data/transcoder_evaluation_gfg/cppdata/transcoder_evaluation_gfg/cpp | SUM_NODES_K_TH_LEVEL_TREE_REPRESENTED...PRODUCT_NODES_K_TH_LEVEL_TREE_REPRESE... |
35:58 35:58 | view |
| 23 | x 2 | CodeXGLUE/Code-Text/code-to-text/evaluatorCodeXGLUE/Code-Text/code-to-text/code | evaluator.pybleu.py |
0:0 0:0 | view |
| 22 | x 2 | data/transcoder_evaluation_gfg/cppdata/transcoder_evaluation_gfg/cpp | PANGRAM_CHECKING.cppFIND_EXPRESSION_DUPLICATE_PARENTHESIS... |
35:57 40:62 | view |
| 21 | x 63 | data/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/java... | COUNT_CHARACTERS_STRING_DISTANCE_ENGL...LONGEST_PALINDROME_SUBSEQUENCE_SPACE....LONGEST_EVEN_LENGTH_SUBSTRING_SUM_FIR...CHECK_LARGE_NUMBER_DIVISIBLE_9_NOT.javaNUMBER_DIGITS_REMOVED_MAKE_NUMBER_DIV...CHECK_GIVEN_STRING_ROTATION_PALINDROM...COUNT_PALINDROMIC_SUBSEQUENCE_GIVEN_S...CHECK_LARGE_NUMBER_DIVISIBLE_3_NOT.javaLONGEST_PREFIX_ALSO_SUFFIX_1.javaLONGEST_REPEATING_SUBSEQUENCE.java... |
27:48 41:62 39:60 25:46 31:52 23:44 38:59 25:46 42:63 32:53 ... | view |
| 21 | x 16 | data/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/java... | PRINT_A_CLOSEST_STRING_THAT_DOES_NOT_...LEXICOGRAPHICALLY_NEXT_STRING.javaLEXICOGRAPHICALLY_MINIMUM_STRING_ROTA...DECODE_MEDIAN_STRING_ORIGINAL_STRING....LEXICOGRAPHICAL_MAXIMUM_SUBSTRING_STR...BINARY_REPRESENTATION_OF_NEXT_NUMBER....REMOVE_BRACKETS_ALGEBRAIC_STRING_CONT...PRINT_WORDS_STRING_REVERSE_ORDER.javaLEXICOGRAPHICAL_CONCATENATION_SUBSTRI...NTH_EVEN_LENGTH_PALINDROME.java... |
31:52 25:46 29:50 40:61 28:49 36:57 45:66 34:55 36:57 24:45 ... | view |
| 21 | x 2 | data/transcoder_evaluation_gfg/javadata/transcoder_evaluation_gfg/java | WRITE_ONE_LINE_C_FUNCTION_TO_FIND_WHE...WRITE_ONE_LINE_C_FUNCTION_TO_FIND_WHE... |
25:46 20:41 | view |
| 33 | x 2 | CodeXGLUE/Text-Code/text-to-code/codeCodeXGLUE/Code-Text/code-to-text/code | beam.pymodel.py |
0:0 0:0 | view |
| 19 | x 2 | CodeXGLUE/Text-Code/text-to-code/evaluatorCodeXGLUE/Text-Code/text-to-code/code | bleu.pybleu.py |
0:0 0:0 | view |