azure / Azure-DataFactory

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

16% duplication:

7,988 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
1,322 duplicated lines

2,001 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 2,001 duplicates...

Size	#	Folders	Files	Lines	Code
55	x 2	SamplesV1/TwitterAnalysi...ngActivity/Scripts/Hive SamplesV1/TwitterAnalysi...C#Activity/Scripts/Hive	Twitteragg.hql Twitteragg.hql	1:69 (100%) 1:69 (100%)	view
27	x 2	SamplesV2/ContinuousIntegrationAndDelivery SamplesV2/ContinuousIntegrationAndDelivery	PrePostDeploymentScript.Ver2.ps1 PrePostDeploymentScript.ps1	145:173 (3%) 107:135 (10%)	view
25	x 2	FabricSamples/Image ...eline with AI FabricSamples/Image ...eline with AI	NotebookSample.py NotebookSample.py	44:71 (14%) 84:112 (14%)	view
21	x 2	SamplesV1/AzureAnalysisServicesProcessSample SamplesV1/CrossAppDomainDotNetActivitySample	CrossAppDomainDotNetActivity.cs CrossAppDomainDotNetActivity.cs	9:39 (77%) 11:41 (77%)	view
18	x 2	SamplesV1/TwitterAnalysi...eMLBatchScoringActivity SamplesV1/TwitterAnalysisSample-CustomC#Activity	TwitterAnalysisSample.ps1 TwitterAnalysisSample.ps1	11:30 (72%) 10:29 (75%)	view
16	x 2	SamplesV1/TwitterAnalysi...ingActivity/Scripts/Sql SamplesV1/TwitterAnalysi...mC#Activity/Scripts/Sql	ContosoAggTweetsSentiment.sql ContosoAggTweetsSentiment.sql	1:21 (100%) 1:21 (100%)	view
15	x 2	SamplesV1/TwitterAnalysi...ngActivity/Scripts/Hive SamplesV1/TwitterAnalysi...C#Activity/Scripts/Hive	Twitteraggsentiments.hql Twitteraggsentiments.hql	1:18 (100%) 1:18 (100%)	view
14	x 2	SamplesV2/SQLServerInteg...stedIRProxy/Limitations SamplesV2/SQLServerInteg...stedIRProxy/Limitations	dtsx ParameterMappingSample.dtsx ParameterMappingSample.dtsx	145:158 (1%) 281:294 (1%)	view
14	x 2	SamplesV2/SQLServerInteg...t/UserScenarios/STORAGE SamplesV2/SQLServerInteg...stedIRProxy/Limitations	dtsx PowerShell.dtsx ParameterMappingSample.dtsx	84:97 (10%) 1009:1022 (1%)	view
13	x 2	SamplesV1/ParameterizedP...ctory/DeployDataFactory SamplesV1/ParameterizedP...ctory/DeployDataFactory	RetrainingPipeline.cs ScoringPipeline.cs	230:252 (6%) 154:176 (12%)	view
12	x 2	SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts	CreateStudent.sql CreateStudent.sql	469:491 (2%) 671:693 (2%)	view
12	x 2	SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts	CreateStudent.sql CreateStudent.sql	267:289 (2%) 469:491 (2%)	view
12	x 2	SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts	CreateStudent.sql CreateStudent.sql	267:289 (2%) 671:693 (2%)	view
11	x 2	SamplesV2/SQLServerInteg...t/UserScenarios/STORAGE SamplesV2/SQLServerInteg...stedIRProxy/Limitations	dtsx PowerShell.dtsx ParameterMappingSample.dtsx	119:129 (8%) 1056:1066 (1%)	view
11	x 2	SamplesV1/ADFWalkthrough/Scripts SamplesV1/ADFWalkthrough/Scripts	MarketingCampaignEffectiveness.sql MarketingCampaignEffectiveness.sql	24:34 (18%) 47:57 (18%)	view
11	x 2	SamplesV1/ADFSecurePublish/AdfKeyVaultDeployment SamplesV1/ADFSecurePublish/AdfKeyVaultDeployment	AdfDeploy.cs AdfDeploy.cs	116:134 (6%) 151:169 (6%)	view
10	x 2	SamplesV1/ParameterizedP...ctory/DeployDataFactory SamplesV1/ParameterizedP...ctory/DeployDataFactory	CopyPipeline.cs RetrainingPipeline.cs	136:153 (9%) 189:206 (4%)	view
10	x 2	SamplesV1/ADFWalkthrough/Scripts SamplesV1/ADFWalkthrough/Scripts	transformdata.hql transformdata.hql	3:12 (18%) 29:38 (18%)	view
10	x 2	SamplesV2/SQLServerInteg...stedIRProxy/Limitations SamplesV2/SQLServerInteg...stedIRProxy/Limitations	dtsx ParameterMappingSample.dtsx ParameterMappingSample.dtsx	1056:1065 (<1%) 1106:1115 (<1%)	view
10	x 2	SamplesV1/ADFWalkthrough/Scripts SamplesV1/ADFWalkthrough/Scripts	partitionlogs.hql partitionlogs.hql	49:58 (13%) 65:74 (13%)	view
10	x 2	SamplesV2/SQLServerInteg...t/UserScenarios/STORAGE SamplesV2/SQLServerInteg...stedIRProxy/Limitations	dtsx PowerShell.dtsx ParameterMappingSample.dtsx	119:128 (7%) 1106:1115 (<1%)	view
10	x 2	SamplesV2/SQLServerInteg...stedIRProxy/Limitations SamplesV2/SQLServerInteg...stedIRProxy/Limitations	dtsx ParameterMappingSample.dtsx ParameterMappingSample.dtsx	136:145 (<1%) 268:277 (<1%)	view
10	x 2	FabricSamples/Image ...eline with AI FabricSamples/Image ...eline with AI	NotebookSample.py NotebookSample.py	155:164 (5%) 167:176 (5%)	view
8	x 2	SamplesV2/SQLServerInteg...stedIRProxy/Limitations SamplesV2/SQLServerInteg...stedIRProxy/Limitations	dtsx ParameterMappingSample.dtsx ParameterMappingSample.dtsx	783:790 (<1%) 821:828 (<1%)	view
8	x 2	SamplesV2/ContinuousIntegrationAndDelivery SamplesV2/ContinuousIntegrationAndDelivery	PrePostDeploymentScript.Ver2.ps1 PrePostDeploymentScript.ps1	127:134 (1%) 88:95 (2%)	view
8	x 2	SamplesV2/ContinuousIntegrationAndDelivery SamplesV2/ContinuousIntegrationAndDelivery	PrePostDeploymentScript.Ver2.ps1 PrePostDeploymentScript.ps1	89:96 (1%) 52:59 (2%)	view
8	x 2	SamplesV2/SQLServerInteg...stedIRProxy/Limitations SamplesV2/SQLServerInteg...stedIRProxy/Limitations	dtsx ParameterMappingSample.dtsx ParameterMappingSample.dtsx	127:134 (<1%) 259:266 (<1%)	view
8	x 2	SamplesV1/ParameterizedP...ctory/DeployDataFactory SamplesV1/ParameterizedP...ctory/DeployDataFactory	RetrainingPipeline.cs ScoringPipeline.cs	148:160 (3%) 113:125 (7%)	view
7	x 2	SamplesV2/SQLServerInteg...stedIRProxy/Limitations SamplesV2/SQLServerInteg...stedIRProxy/Limitations	dtsx ParameterMappingSample.dtsx ParameterMappingSample.dtsx	244:250 (<1%) 374:380 (<1%)	view
7	x 2	SamplesV1/CustomizedJava...DF/src/com/adf/jobonhdi SamplesV1/CustomizedJava...DF/src/com/adf/jobonhdi	JobOnHdiLauncher.java JobOnHdiLauncher.java	83:92 (4%) 305:314 (4%)	view
7	x 2	SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts	CreateStudent.sql CreateStudent.sql	75:87 (1%) 277:289 (1%)	view
7	x 2	FabricSamples/Image ...eline with AI FabricSamples/Image ...eline with AI	NotebookSample.py NotebookSample.py	36:42 (3%) 76:82 (3%)	view
7	x 2	SamplesV2/SQLServerInteg...t/UserScenarios/STORAGE SamplesV2/SQLServerInteg...stedIRProxy/Limitations	dtsx PowerShell.dtsx ParameterMappingSample.dtsx	72:78 (5%) 997:1003 (<1%)	view
7	x 2	SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts	CreateStudent.sql CreateStudent.sql	75:87 (1%) 479:491 (1%)	view
7	x 2	SamplesV1/ADFWalkthrough/Scripts SamplesV1/ADFWalkthrough/Scripts	partitionlogs.hql partitionlogs.hql	9:15 (9%) 23:29 (9%)	view
7	x 2	SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts	CreateStudent.sql CreateStudent.sql	75:87 (1%) 681:693 (1%)	view
6	x 2	SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts	CreateStudent.sql CreateStudent.sql	315:325 (1%) 459:469 (1%)	view
6	x 2	SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts	CreateStudent.sql CreateStudent.sql	755:765 (1%) 791:801 (1%)	view
6	x 2	SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts	CreateStudent.sql CreateStudent.sql	399:409 (1%) 803:813 (1%)	view
6	x 2	SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts	CreateStudent.sql CreateStudent.sql	351:361 (1%) 731:741 (1%)	view
6	x 2	SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts	CreateStudent.sql CreateStudent.sql	137:147 (1%) 565:575 (1%)	view
6	x 2	SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts	CreateStudent.sql CreateStudent.sql	257:267 (1%) 339:349 (1%)	view
6	x 2	SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts	CreateStudent.sql CreateStudent.sql	399:409 (1%) 815:825 (1%)	view
6	x 2	SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts	CreateStudent.sql CreateStudent.sql	257:267 (1%) 327:337 (1%)	view
6	x 2	SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts	CreateStudent.sql CreateStudent.sql	315:325 (1%) 447:457 (1%)	view
6	x 2	SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts	CreateStudent.sql CreateStudent.sql	221:231 (1%) 767:777 (1%)	view
6	x 2	SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts	CreateStudent.sql CreateStudent.sql	113:123 (1%) 803:813 (1%)	view
6	x 2	SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts	CreateStudent.sql CreateStudent.sql	221:231 (1%) 755:765 (1%)	view
6	x 2	SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts	CreateStudent.sql CreateStudent.sql	113:123 (1%) 815:825 (1%)	view
6	x 2	SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts SamplesV2/ChangeDataCapt...ses/cdc/code/sqlscripts	CreateStudent.sql CreateStudent.sql	137:147 (1%) 577:587 (1%)	view