Places in code with 6 or more lines that are exactly the same.
Intro
- For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
- Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
- You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.
- To learn more about duplications and techniques for eliminating duplication, Sokrates recommends the following resources:
- Avoid Repetition, MartinFlower.com (IEEE Software article)
- Refactoring duplicated code, sourcemaking.com
- Beck Design Rules, MartinFowler.com
- DRY (Don't Repeat Yourself) Principle, Wikipedia
- The Cut-and-Paste Programming Software Development Anti-Pattern, sourcemaking.com
- Code Smells / Duplicated Code, Jeff Atwood, codinghorror.com:
- "Duplicated code is the bane of software development. Stamp out duplication whenever possible. You should always be on the lookout for more subtle cases of near-duplication, too. Don't Repeat Yourself!"
- Reducing Coupling, MartinFlower.com (IEEE Software article):
- "There are several ways to describe coupling, but it boils down to this: If changing one module in a program requires changing another module, then coupling exists. ... Duplication always implies coupling, because changing one piece of duplicate code implies changing the other."
Duplication Overall
- 47% duplication:
- 17,428 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
- 8,243 duplicated lines
- 1,042 duplicates
Duplication per Extension
Duplication per Component (primary)
Duplication Between Components (50+ lines)
Open 3D force graph...
Show more details on duplication between components...
From Component
--> To Component
Duplicated
Lines
File Pairs
Details
sample_apps_reinvent2021/java (46%)
--> sample_apps_reinvent2021/javaV2 (46%)
1244
8 file pairs
details...
sample_apps_reinvent2021/go (36%)
--> sample_apps_reinvent2021/goV2 (33%)
1168
10 file pairs
details...
sample_apps/dotnet (68%)
--> sample_apps_reinvent2021/dotnet (29%)
966
7 file pairs
details...
sample_apps/js (50%)
--> sample_apps_reinvent2021/js (29%)
769
5 file pairs
details...
sample_apps/java (52%)
--> sample_apps_reinvent2021/java (27%)
742
5 file pairs
details...
sample_apps/javaV2 (48%)
--> sample_apps_reinvent2021/javaV2 (24%)
648
5 file pairs
details...
sample_apps/java (44%)
--> sample_apps/javaV2 (46%)
630
4 file pairs
details...
integrations/flink_connector (89%)
--> integrations/flink_connector_with_upserts (74%)
448
8 file pairs
details...
sample_apps/go (29%)
--> sample_apps_reinvent2021/go (11%)
355
5 file pairs
details...
sample_apps/java (24%)
--> sample_apps_reinvent2021/javaV2 (13%)
354
4 file pairs
details...
sample_apps/javaV2 (25%)
--> sample_apps_reinvent2021/java (12%)
346
4 file pairs
details...
integrations/sagemaker (83%)
--> tools/perf-scale-workload (10%)
260
1 file pair
details...
sample_apps/javaV2 (18%)
--> sample_apps/js (16%)
246
1 file pair
details...
sample_apps/java (17%)
--> sample_apps/js (16%)
246
1 file pair
details...
sample_apps_reinvent2021/javaV2 (7%)
--> sample_apps_reinvent2021/js (7%)
210
1 file pair
details...
sample_apps_reinvent2021/java (7%)
--> sample_apps_reinvent2021/js (7%)
210
1 file pair
details...
tools/continuous-ingestor (23%)
--> tools/perf-scale-workload (8%)
204
1 file pair
details...
integrations/jdbc (27%)
--> sample_apps/java (14%)
204
1 file pair
details...
integrations/jdbc (27%)
--> sample_apps/javaV2 (15%)
204
1 file pair
details...
sample_apps/js (12%)
--> sample_apps_reinvent2021/java (7%)
192
1 file pair
details...
sample_apps/js (12%)
--> sample_apps_reinvent2021/javaV2 (7%)
192
1 file pair
details...
integrations/jdbc (25%)
--> sample_apps/js (12%)
188
1 file pair
details...
integrations/jdbc (22%)
--> sample_apps_reinvent2021/javaV2 (6%)
166
1 file pair
details...
integrations/jdbc (22%)
--> sample_apps_reinvent2021/java (6%)
166
1 file pair
details...
tools/continuous-ingestor (19%)
--> tools/kinesis_ingestor (32%)
164
1 file pair
details...
tools/kinesis_ingestor (32%)
--> tools/perf-scale-workload (6%)
164
1 file pair
details...
sample_apps/java (9%)
--> sample_apps_reinvent2021/js (5%)
142
1 file pair
details...
sample_apps/javaV2 (10%)
--> sample_apps_reinvent2021/js (5%)
142
1 file pair
details...
sample_apps/go (11%)
--> sample_apps_reinvent2021/goV2 (4%)
139
4 file pairs
details...
integrations/jdbc (16%)
--> sample_apps_reinvent2021/js (4%)
122
1 file pair
details...
sample_apps_reinvent2021/go (1%)
--> sample_apps_reinvent2021/javaV2 (2%)
62
1 file pair
details...
sample_apps_reinvent2021/goV2 (1%)
--> sample_apps_reinvent2021/javaV2 (2%)
62
1 file pair
details...
sample_apps/python (6%)
--> sample_apps_reinvent2021/python (3%)
52
2 file pairs
details...
sample_apps_reinvent2021/goV2 (1%)
--> sample_apps_reinvent2021/java (1%)
50
1 file pair
details...
sample_apps_reinvent2021/go (1%)
--> sample_apps_reinvent2021/java (1%)
50
1 file pair
details...
| From Component --> To Component |
Duplicated Lines |
File Pairs | Details |
|---|---|---|---|
| sample_apps_reinvent2021/java (46%) --> sample_apps_reinvent2021/javaV2 (46%) |
1244 | 8 file pairs | details... |
| sample_apps_reinvent2021/go (36%) --> sample_apps_reinvent2021/goV2 (33%) |
1168 | 10 file pairs | details... |
| sample_apps/dotnet (68%) --> sample_apps_reinvent2021/dotnet (29%) |
966 | 7 file pairs | details... |
| sample_apps/js (50%) --> sample_apps_reinvent2021/js (29%) |
769 | 5 file pairs | details... |
| sample_apps/java (52%) --> sample_apps_reinvent2021/java (27%) |
742 | 5 file pairs | details... |
| sample_apps/javaV2 (48%) --> sample_apps_reinvent2021/javaV2 (24%) |
648 | 5 file pairs | details... |
| sample_apps/java (44%) --> sample_apps/javaV2 (46%) |
630 | 4 file pairs | details... |
| integrations/flink_connector (89%) --> integrations/flink_connector_with_upserts (74%) |
448 | 8 file pairs | details... |
| sample_apps/go (29%) --> sample_apps_reinvent2021/go (11%) |
355 | 5 file pairs | details... |
| sample_apps/java (24%) --> sample_apps_reinvent2021/javaV2 (13%) |
354 | 4 file pairs | details... |
| sample_apps/javaV2 (25%) --> sample_apps_reinvent2021/java (12%) |
346 | 4 file pairs | details... |
| integrations/sagemaker (83%) --> tools/perf-scale-workload (10%) |
260 | 1 file pair | details... |
| sample_apps/javaV2 (18%) --> sample_apps/js (16%) |
246 | 1 file pair | details... |
| sample_apps/java (17%) --> sample_apps/js (16%) |
246 | 1 file pair | details... |
| sample_apps_reinvent2021/javaV2 (7%) --> sample_apps_reinvent2021/js (7%) |
210 | 1 file pair | details... |
| sample_apps_reinvent2021/java (7%) --> sample_apps_reinvent2021/js (7%) |
210 | 1 file pair | details... |
| tools/continuous-ingestor (23%) --> tools/perf-scale-workload (8%) |
204 | 1 file pair | details... |
| integrations/jdbc (27%) --> sample_apps/java (14%) |
204 | 1 file pair | details... |
| integrations/jdbc (27%) --> sample_apps/javaV2 (15%) |
204 | 1 file pair | details... |
| sample_apps/js (12%) --> sample_apps_reinvent2021/java (7%) |
192 | 1 file pair | details... |
| sample_apps/js (12%) --> sample_apps_reinvent2021/javaV2 (7%) |
192 | 1 file pair | details... |
| integrations/jdbc (25%) --> sample_apps/js (12%) |
188 | 1 file pair | details... |
| integrations/jdbc (22%) --> sample_apps_reinvent2021/javaV2 (6%) |
166 | 1 file pair | details... |
| integrations/jdbc (22%) --> sample_apps_reinvent2021/java (6%) |
166 | 1 file pair | details... |
| tools/continuous-ingestor (19%) --> tools/kinesis_ingestor (32%) |
164 | 1 file pair | details... |
| tools/kinesis_ingestor (32%) --> tools/perf-scale-workload (6%) |
164 | 1 file pair | details... |
| sample_apps/java (9%) --> sample_apps_reinvent2021/js (5%) |
142 | 1 file pair | details... |
| sample_apps/javaV2 (10%) --> sample_apps_reinvent2021/js (5%) |
142 | 1 file pair | details... |
| sample_apps/go (11%) --> sample_apps_reinvent2021/goV2 (4%) |
139 | 4 file pairs | details... |
| integrations/jdbc (16%) --> sample_apps_reinvent2021/js (4%) |
122 | 1 file pair | details... |
| sample_apps_reinvent2021/go (1%) --> sample_apps_reinvent2021/javaV2 (2%) |
62 | 1 file pair | details... |
| sample_apps_reinvent2021/goV2 (1%) --> sample_apps_reinvent2021/javaV2 (2%) |
62 | 1 file pair | details... |
| sample_apps/python (6%) --> sample_apps_reinvent2021/python (3%) |
52 | 2 file pairs | details... |
| sample_apps_reinvent2021/goV2 (1%) --> sample_apps_reinvent2021/java (1%) |
50 | 1 file pair | details... |
| sample_apps_reinvent2021/go (1%) --> sample_apps_reinvent2021/java (1%) |
50 | 1 file pair | details... |
Longest Duplicates
The list of 20 longest duplicates.
| Size | # | Folders | Files | Lines | Code |
|---|---|---|---|---|---|
| 201 | x 2 | sample_apps/java/src/mai...aws/services/timestreamsample_apps/javaV2/src/m...aws/services/timestream |  QueryExample.javaQueryExample.java |
39:265 (63%)31:257 (71%) | view |
| 201 | x 2 | sample_apps_reinvent2021...aws/services/timestreamsample_apps_reinvent2021...aws/services/timestream | QueryExample.javaQueryExample.java |
36:262 (64%)22:248 (73%) | view |
| 88 | x 2 | sample_apps/java/src/mai...aws/services/timestreamsample_apps_reinvent2021...aws/services/timestream | QueryExample.javaQueryExample.java |
299:421 (27%)286:408 (28%) | view |
| 84 | x 2 | tools/continuous-ingestortools/perf-scale-workload |  timestream_sample_continuous_data_ing...model.py |
38:136 (19%)45:147 (32%) | view |
| 82 | x 2 | tools/continuous-ingestortools/kinesis_ingestor | timestream_sample_continuous_data_ing...timestream_kinesis_data_gen.py |
38:133 (19%)20:115 (33%) | view |
| 82 | x 2 | tools/kinesis_ingestortools/perf-scale-workload | timestream_kinesis_data_gen.pymodel.py |
20:115 (33%)45:144 (31%) | view |
| 74 | x 2 | sample_apps/jssample_apps_reinvent2021/js |  crud-and-simple-ingestion-example.jscrud-and-simple-ingestion-example.js |
117:214 (19%)129:226 (36%) | view |
| 72 | x 2 | sample_apps/jssample_apps_reinvent2021/js | crud-and-simple-ingestion-example.jscrud-and-simple-ingestion-example.js |
7:105 (18%)9:107 (35%) | view |
| 65 | x 2 | integrations/sagemakertools/perf-scale-workload | timestreamquery.pytimestreamquery.py |
30:105 (41%)38:119 (40%) | view |
| 63 | x 2 | sample_apps/gosample_apps_reinvent2021/go/utils |  query-common.goquery-common.go |
36:118 (57%)33:115 (60%) | view |
| 55 | x 2 | sample_apps/dotnetsample_apps_reinvent2021/dotnet |  QueryExample.csQueryExample.cs |
288:387 (18%)286:385 (18%) | view |
| 50 | x 2 | sample_apps/dotnetsample_apps_reinvent2021/dotnet | CrudAndSimpleIngestionExample.csCrudAndSimpleIngestionExample.cs |
178:268 (15%)119:209 (14%) | view |
| 50 | x 2 | sample_apps_reinvent2021/go/utilssample_apps_reinvent2021/goV2/utils | timestream-dependency-helper.gotimestream-dependency-helper.go |
26:78 (11%)30:82 (10%) | view |
| 48 | x 2 | sample_apps/jssample_apps_reinvent2021/js | query-example.jsquery-example.js |
289:367 (16%)295:373 (16%) | view |
| 45 | x 2 | sample_apps/dotnetsample_apps_reinvent2021/dotnet | CrudAndSimpleIngestionExample.csCrudAndSimpleIngestionExample.cs |
43:126 (13%)26:109 (13%) | view |
| 45 | x 2 | integrations/flink_conne...aws/services/timestreamintegrations/flink_conne...aws/services/timestream | TimestreamSink.javaTimestreamSink.java |
87:155 (51%)92:160 (50%) | view |
| 44 | x 2 | sample_apps/javaV2/src/m...aws/services/timestreamsample_apps_reinvent2021...aws/services/timestream | QueryExample.javaQueryExample.java |
307:379 (15%)288:360 (16%) | view |
| 44 | x 2 | integrations/flink_conne...aws/services/timestreamintegrations/flink_conne...aws/services/timestream | TimestreamPoint.javaTimestreamPoint.java |
8:96 (100%)8:96 (100%) | view |
| 44 | x 2 | sample_apps_reinvent2021...aws/services/timestreamsample_apps_reinvent2021...aws/services/timestream | TimestreamDependencyHelper.javaTimestreamDependencyHelper.java |
86:132 (12%)85:130 (12%) | view |
| 38 | x 2 | sample_apps_reinvent2021/gosample_apps_reinvent2021/goV2 | scheduled-query-sample.goscheduled-query-sample.go |
95:154 (21%)99:157 (21%) | view |
Duplicated Units
The list of top 20 duplicated units.
| Size | # | Folders | Files | Lines | Code |
|---|---|---|---|---|---|
| 30 | x 2 | sample_apps_reinvent2021/go/utilssample_apps/go | query-common.goquery-common.go |
80:116 83:119 | view |
| 30 | x 2 | sample_apps_reinvent2021...aws/services/timestreamsample_apps/java/src/mai...aws/services/timestream | QueryExample.javaQueryExample.java |
345:375 358:388 | view |
| 26 | x 2 | sample_apps_reinvent2021/dotnetsample_apps/dotnet | QueryExample.csQueryExample.cs |
308:335 310:337 | view |
| 26 | x 2 | sample_apps_reinvent2021/dotnetsample_apps/dotnet | CrudAndSimpleIngestionExample.csCrudAndSimpleIngestionExample.cs |
179:207 238:266 | view |
| 25 | x 2 | sample_apps_reinvent2021/dotnetsample_apps/dotnet | CrudAndSimpleIngestionExample.csCrudAndSimpleIngestionExample.cs |
144:171 203:230 | view |
| 24 | x 2 | sample_apps_reinvent2021/dotnetsample_apps/dotnet | CrudAndSimpleIngestionExample.csCrudAndSimpleIngestionExample.cs |
50:76 67:93 | view |
| 23 | x 2 | sample_apps_reinvent2021/jssample_apps/js | crud-and-simple-ingestion-example.jscrud-and-simple-ingestion-example.js |
50:76 48:74 | view |
| 23 | x 2 | sample_apps_reinvent2021/go/utilssample_apps/go | query-common.goquery-common.go |
54:78 57:81 | view |
| 22 | x 2 | sample_apps_reinvent2021/dotnetsample_apps/dotnet | QueryExample.csQueryExample.cs |
252:274 252:274 | view |
| 21 | x 2 | sample_apps_reinvent2021/jssample_apps/js | crud-and-simple-ingestion-example.jscrud-and-simple-ingestion-example.js |
204:227 192:215 | view |
| 21 | x 2 | sample_apps_reinvent2021/dotnetsample_apps/dotnet | CrudAndSimpleIngestionExample.csCrudAndSimpleIngestionExample.cs |
78:101 95:118 | view |
| 21 | x 2 | sample_apps_reinvent2021/dotnetsample_apps/dotnet | CrudAndSimpleIngestionExample.csCrudAndSimpleIngestionExample.cs |
119:142 178:201 | view |
| 20 | x 2 | sample_apps_reinvent2021/jssample_apps/js | crud-and-simple-ingestion-example.jscrud-and-simple-ingestion-example.js |
86:108 84:106 | view |
| 20 | x 2 | sample_apps_reinvent2021/jssample_apps/js | crud-and-simple-ingestion-example.jscrud-and-simple-ingestion-example.js |
148:170 136:158 | view |
| 20 | x 2 | sample_apps_reinvent2021/jssample_apps/js | crud-and-simple-ingestion-example.jscrud-and-simple-ingestion-example.js |
172:194 160:182 | view |
| 20 | x 2 | sample_apps_reinvent2021/jssample_apps/js | query-example.jsquery-example.js |
320:346 314:340 | view |
| 20 | x 2 | sample_apps_reinvent2021...aws/services/timestreamsample_apps/java/src/mai...aws/services/timestream | QueryExample.javaQueryExample.java |
310:334 323:347 | view |
| 20 | x 2 | sample_apps_reinvent2021...aws/services/timestreamsample_apps/javaV2/src/m...aws/services/timestream | QueryExample.javaQueryExample.java |
312:336 331:355 | view |
| 20 | x 2 | sample_apps_reinvent2021/dotnetsample_apps/dotnet | CrudAndSimpleIngestionExample.csCrudAndSimpleIngestionExample.cs |
26:48 43:65 | view |
| 19 | x 2 | sample_apps_reinvent2021/jssample_apps/js | crud-and-simple-ingestion-example.jscrud-and-simple-ingestion-example.js |
27:48 25:46 | view |