Places in code with 6 or more lines that are exactly the same.
Intro
- For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
- Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
- You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.
- To learn more about duplications and techniques for eliminating duplication, Sokrates recommends the following resources:
- Avoid Repetition, MartinFlower.com (IEEE Software article)
- Refactoring duplicated code, sourcemaking.com
- Beck Design Rules, MartinFowler.com
- DRY (Don't Repeat Yourself) Principle, Wikipedia
- The Cut-and-Paste Programming Software Development Anti-Pattern, sourcemaking.com
- Code Smells / Duplicated Code, Jeff Atwood, codinghorror.com:
- "Duplicated code is the bane of software development. Stamp out duplication whenever possible. You should always be on the lookout for more subtle cases of near-duplication, too. Don't Repeat Yourself!"
- Reducing Coupling, MartinFlower.com (IEEE Software article):
- "There are several ways to describe coupling, but it boils down to this: If changing one module in a program requires changing another module, then coupling exists. ... Duplication always implies coupling, because changing one piece of duplicate code implies changing the other."
Duplication Overall
- 97% duplication:
- 67,337 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
- 65,653 duplicated lines
- 1,477 duplicates
Duplication per Extension
Duplication per Component (primary)
Duplication Between Components (50+ lines)
Open 3D force graph...
Show more details on duplication between components...
From Component
--> To Component
Duplicated
Lines
File Pairs
Details
mlops-template-gitlab/seedcode (33%)
--> multi-branch-mlops-train/pipelines (79%)
503
5 file pairs
details...
asynchronous-inference-endpoint (100%)
--> batch-inference (100%)
488
1 file pair
details...
batch-inference/seedcode (54%)
--> mlops-template-gitlab/seedcode (31%)
476
8 file pairs
details...
asynchronous-inference-endpoint (90%)
--> multi-model-endpoint (93%)
443
1 file pair
details...
batch-inference (90%)
--> multi-model-endpoint (93%)
443
1 file pair
details...
asynchronous-inference-endpoint/seedcode (70%)
--> multi-model-endpoint/seedcode (85%)
336
3 file pairs
details...
asynchronous-inference-endpoint/seedcode (68%)
--> mlops-template-gitlab/seedcode (21%)
326
2 file pairs
details...
mlops-template-gitlab/seedcode (21%)
--> multi-model-endpoint/seedcode (81%)
320
2 file pairs
details...
asynchronous-inference-endpoint/seedcode (53%)
--> batch-inference/seedcode (29%)
254
2 file pairs
details...
batch-inference/seedcode (28%)
--> multi-model-endpoint/seedcode (63%)
248
2 file pairs
details...
batch-inference (43%)
--> encrypted-buckets (27%)
211
1 file pair
details...
asynchronous-inference-endpoint (43%)
--> encrypted-buckets (27%)
211
1 file pair
details...
encrypted-buckets (23%)
--> multi-model-endpoint (38%)
183
1 file pair
details...
| From Component --> To Component |
Duplicated Lines |
File Pairs | Details |
|---|---|---|---|
| mlops-template-gitlab/seedcode (33%) --> multi-branch-mlops-train/pipelines (79%) |
503 | 5 file pairs | details... |
| asynchronous-inference-endpoint (100%) --> batch-inference (100%) |
488 | 1 file pair | details... |
| batch-inference/seedcode (54%) --> mlops-template-gitlab/seedcode (31%) |
476 | 8 file pairs | details... |
| asynchronous-inference-endpoint (90%) --> multi-model-endpoint (93%) |
443 | 1 file pair | details... |
| batch-inference (90%) --> multi-model-endpoint (93%) |
443 | 1 file pair | details... |
| asynchronous-inference-endpoint/seedcode (70%) --> multi-model-endpoint/seedcode (85%) |
336 | 3 file pairs | details... |
| asynchronous-inference-endpoint/seedcode (68%) --> mlops-template-gitlab/seedcode (21%) |
326 | 2 file pairs | details... |
| mlops-template-gitlab/seedcode (21%) --> multi-model-endpoint/seedcode (81%) |
320 | 2 file pairs | details... |
| asynchronous-inference-endpoint/seedcode (53%) --> batch-inference/seedcode (29%) |
254 | 2 file pairs | details... |
| batch-inference/seedcode (28%) --> multi-model-endpoint/seedcode (63%) |
248 | 2 file pairs | details... |
| batch-inference (43%) --> encrypted-buckets (27%) |
211 | 1 file pair | details... |
| asynchronous-inference-endpoint (43%) --> encrypted-buckets (27%) |
211 | 1 file pair | details... |
| encrypted-buckets (23%) --> multi-model-endpoint (38%) |
183 | 1 file pair | details... |
Longest Duplicates
The list of 20 longest duplicates.
| Size | # | Folders | Files | Lines | Code |
|---|---|---|---|---|---|
| 8271 | x 2 | mlops-template-gitlab/la...b-pipeline-trigger/idnamlops-template-gitlab/la...ode-checkin-gitlab/idna |  uts46data.pyuts46data.py |
8:8438 (100%)8:8438 (100%) | view |
| 2048 | x 2 | mlops-template-gitlab/la...b-pipeline-trigger/idnamlops-template-gitlab/la...ode-checkin-gitlab/idna | idnadata.pyidnadata.py |
3:2050 (100%)3:2050 (100%) | view |
| 1210 | x 2 | mlops-template-gitlab/la...arset_normalizer/assetsmlops-template-gitlab/la...arset_normalizer/assets | __init__.py__init__.py |
10:1219 (100%)10:1219 (100%) | view |
| 725 | x 2 | mlops-template-gitlab/la...rigger/urllib3/packagesmlops-template-gitlab/la...gitlab/urllib3/packages | six.pysix.py |
31:1077 (100%)31:1077 (100%) | view |
| 576 | x 2 | mlops-template-gitlab/la...igger/gitlab/v4/objectsmlops-template-gitlab/la...itlab/gitlab/v4/objects | projects.pyprojects.py |
10:1049 (100%)10:1049 (100%) | view |
| 559 | x 2 | mlops-template-gitlab/la...ipeline-trigger/urllib3mlops-template-gitlab/la...-checkin-gitlab/urllib3 | connectionpool.pyconnectionpool.py |
12:1078 (100%)12:1078 (100%) | view |
| 527 | x 2 | mlops-template-gitlab/la...pipeline-trigger/gitlabmlops-template-gitlab/la...e-checkin-gitlab/gitlab | mixins.pymixins.py |
21:976 (100%)21:976 (100%) | view |
| 527 | x 2 | mlops-template-gitlab/la...pipeline-trigger/gitlabmlops-template-gitlab/la...e-checkin-gitlab/gitlab | client.pyclient.py |
31:988 (100%)31:988 (100%) | view |
| 525 | x 2 | mlops-template-gitlab/la...trigger/urllib3/contribmlops-template-gitlab/la...-gitlab/urllib3/contrib | securetransport.pysecuretransport.py |
73:922 (100%)73:922 (100%) | view |
| 501 | x 2 | mlops-template-gitlab/la...peline-trigger/requestsmlops-template-gitlab/la...checkin-gitlab/requests | models.pymodels.py |
22:966 (100%)22:966 (100%) | view |
| 498 | x 2 | mlops-template-gitlab/la...peline-trigger/requestsmlops-template-gitlab/la...checkin-gitlab/requests | utils.pyutils.py |
31:1013 (100%)31:1013 (100%) | view |
| 483 | x 2 | mlops-template-gitlab/la...ipeline-trigger/urllib3mlops-template-gitlab/la...-checkin-gitlab/urllib3 | response.pyresponse.py |
10:821 (100%)10:821 (100%) | view |
| 453 | x 2 | mlops-template-gitlab/la...gger/charset_normalizermlops-template-gitlab/la...tlab/charset_normalizer | constant.pyconstant.py |
8:471 (100%)8:471 (100%) | view |
| 421 | x 2 | mlops-template-gitlab/la...gger/charset_normalizermlops-template-gitlab/la...tlab/charset_normalizer | md.pymd.py |
6:570 (100%)6:570 (100%) | view |
| 420 | x 2 | mlops-template-gitlab/la...gger/charset_normalizermlops-template-gitlab/la...tlab/charset_normalizer | api.pyapi.py |
4:546 (100%)4:546 (100%) | view |
| 383 | x 2 | mlops-template-gitlab/la...eline-trigger/gitlab/v4mlops-template-gitlab/la...heckin-gitlab/gitlab/v4 | cli.pycli.py |
30:497 (100%)30:497 (100%) | view |
| 375 | x 2 | mlops-template-gitlab/la...ontrib/_securetransportmlops-template-gitlab/la...ontrib/_securetransport | bindings.pybindings.py |
36:519 (100%)36:519 (100%) | view |
| 345 | x 2 | mlops-template-gitlab/la...ipeline-trigger/urllib3mlops-template-gitlab/la...-checkin-gitlab/urllib3 | connection.pyconnection.py |
17:569 (100%)17:569 (100%) | view |
| 335 | x 2 | mlops-template-gitlab/la...peline-trigger/requestsmlops-template-gitlab/la...checkin-gitlab/requests | sessions.pysessions.py |
19:781 (100%)19:781 (100%) | view |
| 328 | x 2 | mlops-template-gitlab/la...igger/gitlab/v4/objectsmlops-template-gitlab/la...itlab/gitlab/v4/objects | users.pyusers.py |
6:507 (100%)6:507 (100%) | view |
Duplicated Units
The list of top 20 duplicated units.
| Size | # | Folders | Files | Lines | Code |
|---|---|---|---|---|---|
| 221 | x 2 | mlops-template-gitlab/la.../charset_normalizer/climlops-template-gitlab/la.../charset_normalizer/cli | normalizer.pynormalizer.py |
0:0 0:0 | view |
| 103 | x 2 | mlops-template-gitlab/la...b-pipeline-trigger/idnamlops-template-gitlab/la...ode-checkin-gitlab/idna | uts46data.pyuts46data.py |
0:0 0:0 | view |
| 103 | x 2 | mlops-template-gitlab/la...b-pipeline-trigger/idnamlops-template-gitlab/la...ode-checkin-gitlab/idna | uts46data.pyuts46data.py |
0:0 0:0 | view |
| 103 | x 2 | mlops-template-gitlab/la...b-pipeline-trigger/idnamlops-template-gitlab/la...ode-checkin-gitlab/idna | uts46data.pyuts46data.py |
0:0 0:0 | view |
| 103 | x 2 | mlops-template-gitlab/la...b-pipeline-trigger/idnamlops-template-gitlab/la...ode-checkin-gitlab/idna | uts46data.pyuts46data.py |
0:0 0:0 | view |
| 103 | x 2 | mlops-template-gitlab/la...b-pipeline-trigger/idnamlops-template-gitlab/la...ode-checkin-gitlab/idna | uts46data.pyuts46data.py |
0:0 0:0 | view |
| 103 | x 2 | mlops-template-gitlab/la...b-pipeline-trigger/idnamlops-template-gitlab/la...ode-checkin-gitlab/idna | uts46data.pyuts46data.py |
0:0 0:0 | view |
| 103 | x 2 | mlops-template-gitlab/la...b-pipeline-trigger/idnamlops-template-gitlab/la...ode-checkin-gitlab/idna | uts46data.pyuts46data.py |
0:0 0:0 | view |
| 103 | x 2 | mlops-template-gitlab/la...b-pipeline-trigger/idnamlops-template-gitlab/la...ode-checkin-gitlab/idna | uts46data.pyuts46data.py |
0:0 0:0 | view |
| 103 | x 2 | mlops-template-gitlab/la...b-pipeline-trigger/idnamlops-template-gitlab/la...ode-checkin-gitlab/idna | uts46data.pyuts46data.py |
0:0 0:0 | view |
| 103 | x 2 | mlops-template-gitlab/la...b-pipeline-trigger/idnamlops-template-gitlab/la...ode-checkin-gitlab/idna | uts46data.pyuts46data.py |
0:0 0:0 | view |
| 103 | x 2 | mlops-template-gitlab/la...b-pipeline-trigger/idnamlops-template-gitlab/la...ode-checkin-gitlab/idna | uts46data.pyuts46data.py |
0:0 0:0 | view |
| 103 | x 2 | mlops-template-gitlab/la...b-pipeline-trigger/idnamlops-template-gitlab/la...ode-checkin-gitlab/idna | uts46data.pyuts46data.py |
0:0 0:0 | view |
| 103 | x 2 | mlops-template-gitlab/la...b-pipeline-trigger/idnamlops-template-gitlab/la...ode-checkin-gitlab/idna | uts46data.pyuts46data.py |
0:0 0:0 | view |
| 103 | x 2 | mlops-template-gitlab/la...b-pipeline-trigger/idnamlops-template-gitlab/la...ode-checkin-gitlab/idna | uts46data.pyuts46data.py |
0:0 0:0 | view |
| 103 | x 2 | mlops-template-gitlab/la...b-pipeline-trigger/idnamlops-template-gitlab/la...ode-checkin-gitlab/idna | uts46data.pyuts46data.py |
0:0 0:0 | view |
| 103 | x 2 | mlops-template-gitlab/la...b-pipeline-trigger/idnamlops-template-gitlab/la...ode-checkin-gitlab/idna | uts46data.pyuts46data.py |
0:0 0:0 | view |
| 103 | x 2 | mlops-template-gitlab/la...b-pipeline-trigger/idnamlops-template-gitlab/la...ode-checkin-gitlab/idna | uts46data.pyuts46data.py |
0:0 0:0 | view |
| 103 | x 2 | mlops-template-gitlab/la...b-pipeline-trigger/idnamlops-template-gitlab/la...ode-checkin-gitlab/idna | uts46data.pyuts46data.py |
0:0 0:0 | view |
| 103 | x 2 | mlops-template-gitlab/la...b-pipeline-trigger/idnamlops-template-gitlab/la...ode-checkin-gitlab/idna | uts46data.pyuts46data.py |
0:0 0:0 | view |