Duplication · guardian/transcription-service

Duplication Overall

9% duplication:

10,658 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
1,045 duplicated lines

64 duplicates

dependency graphs: 2D graph | 2D graph (with duplicates)... | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 64 duplicates...

Size	#	Folders	Files	Lines	Code
168	x 2	packages/worker/rapidocr packages/worker/rapidocr	rapidocr-config.local.yaml rapidocr-config.prod.yaml	25:192 (87%) 25:192 (87%)	view
23	x 2	packages/worker/rapidocr packages/worker/rapidocr	rapidocr-config.local.yaml rapidocr-config.prod.yaml	1:23 (11%) 1:23 (11%)	view
20	x 2	packages/output-handler/src packages/webpage-snapshot/src	zod-string-to-json.ts zod-string-to-json.ts	10:47 (100%) 10:47 (100%)	view
18	x 2	packages/client/src/components packages/client/src/components	Prompt.tsx Translate.tsx	28:49 (11%) 55:76 (8%)	view
14	x 2	packages/cdk/lib packages/cdk/lib	repository.ts repository.ts	39:56 (10%) 64:81 (10%)	view
14	x 2	packages/client/src/components packages/client/src/components	Prompt.tsx Translate.tsx	81:97 (9%) 108:124 (6%)	view
12	x 2	packages/cdk packages/cdk	riff-raff.yaml riff-raff.yaml	6:17 (6%) 44:55 (6%)	view
12	x 2	packages/cdk packages/cdk	riff-raff.yaml riff-raff.yaml	74:85 (6%) 88:99 (6%)	view
12	x 2	packages/cdk packages/cdk	riff-raff.yaml riff-raff.yaml	104:115 (6%) 118:129 (6%)	view
12	x 2	packages/cdk packages/cdk	riff-raff.yaml riff-raff.yaml	134:145 (6%) 148:159 (6%)	view
12	x 2	packages/cdk packages/cdk	riff-raff.yaml riff-raff.yaml	164:175 (6%) 178:189 (6%)	view
10	x 2	packages/client/src/components packages/client/src/components	Translate.tsx Translate.tsx	151:161 (4%) 171:181 (4%)	view
10	x 2	packages/client/src/components packages/client/src/components	Prompt.tsx Translate.tsx	57:70 (6%) 80:93 (4%)	view
10	x 2	packages/api/src packages/media-download/src	index.ts index.ts	192:205 (1%) 158:167 (3%)	view
9	x 2	packages/worker/rapidocr packages/worker/rapidocr	rapidocr-config.prod.yaml rapidocr-config.prod.yaml	106:114 (4%) 122:130 (4%)	view
9	x 2	packages/worker/rapidocr packages/worker/rapidocr	rapidocr-config.local.yaml rapidocr-config.local.yaml	106:114 (4%) 122:130 (4%)	view
9	x 2	packages/worker/rapidocr packages/worker/rapidocr	rapidocr-config.local.yaml rapidocr-config.prod.yaml	106:114 (4%) 122:130 (4%)	view
9	x 2	packages/worker/rapidocr packages/worker/rapidocr	rapidocr-config.local.yaml rapidocr-config.prod.yaml	122:130 (4%) 106:114 (4%)	view
9	x 2	packages/client/src/components packages/client/src/components	Prompt.tsx Translate.tsx	100:109 (5%) 129:138 (4%)	view
8	x 2	packages/worker/src packages/worker/src	index.ts index.ts	154:161 (2%) 166:173 (2%)	view
8	x 2	packages/worker/src packages/worker/src	index.ts index.ts	154:161 (2%) 200:207 (2%)	view
8	x 2	packages/worker/src packages/worker/src	index.ts index.ts	154:161 (2%) 211:218 (2%)	view
8	x 2	packages/worker/src packages/worker/src	index.ts index.ts	154:161 (2%) 224:231 (2%)	view
8	x 2	packages/worker/src packages/worker/src	index.ts index.ts	154:161 (2%) 244:251 (2%)	view
8	x 2	packages/worker/src packages/worker/src	index.ts index.ts	166:173 (2%) 200:207 (2%)	view
8	x 2	packages/worker/src packages/worker/src	index.ts index.ts	166:173 (2%) 211:218 (2%)	view
8	x 2	packages/worker/src packages/worker/src	index.ts index.ts	166:173 (2%) 224:231 (2%)	view
8	x 2	packages/worker/src packages/worker/src	index.ts index.ts	166:173 (2%) 244:251 (2%)	view
8	x 2	packages/worker/src packages/worker/src	index.ts index.ts	200:207 (2%) 211:218 (2%)	view
8	x 2	packages/worker/src packages/worker/src	index.ts index.ts	200:207 (2%) 224:231 (2%)	view
8	x 2	packages/worker/src packages/worker/src	index.ts index.ts	200:207 (2%) 244:251 (2%)	view
8	x 2	packages/worker/src packages/worker/src	index.ts index.ts	211:218 (2%) 224:231 (2%)	view
8	x 2	packages/worker/src packages/worker/src	index.ts index.ts	211:218 (2%) 244:251 (2%)	view
8	x 2	packages/worker/src packages/worker/src	index.ts index.ts	224:231 (2%) 244:251 (2%)	view
8	x 2	packages/media-download/src packages/media-download/src	index.ts index.ts	122:129 (2%) 142:149 (2%)	view
8	x 2	packages/backend-common/src packages/output-handler/src	llm.ts index.ts	79:87 (10%) 232:240 (2%)	view
7	x 2	packages/worker/src packages/worker/src	index.ts index.ts	154:160 (2%) 374:380 (2%)	view
7	x 2	packages/worker/src packages/worker/src	index.ts index.ts	166:172 (2%) 374:380 (2%)	view
7	x 2	packages/worker/src packages/worker/src	index.ts index.ts	200:206 (2%) 374:380 (2%)	view
7	x 2	packages/worker/src packages/worker/src	index.ts index.ts	211:217 (2%) 374:380 (2%)	view
7	x 2	packages/worker/src packages/worker/src	index.ts index.ts	224:230 (2%) 374:380 (2%)	view
7	x 2	packages/worker/src packages/worker/src	index.ts index.ts	244:250 (2%) 374:380 (2%)	view
7	x 2	packages/backend-common/src packages/backend-common/src	sqs.ts sqs.ts	262:269 (2%) 289:296 (2%)	view
7	x 2	packages/cdk/lib packages/cdk/lib	transcription-service.ts transcription-service.ts	237:243 (<1%) 816:822 (<1%)	view
7	x 2	packages/cdk/lib packages/cdk/lib	transcription-service.ts transcription-service.ts	685:691 (<1%) 715:721 (<1%)	view
7	x 2	packages/cdk/lib packages/cdk/lib	transcription-service.ts transcription-service.ts	734:741 (<1%) 836:843 (<1%)	view
7	x 2	packages/cdk/lib packages/cdk/lib	transcription-service.ts transcription-service.ts	734:741 (<1%) 867:874 (<1%)	view
7	x 2	packages/cdk/lib packages/cdk/lib	transcription-service.ts transcription-service.ts	836:843 (<1%) 867:874 (<1%)	view
7	x 2	packages/client/src/components packages/client/src/components	UploadForm.tsx UploadForm.tsx	469:475 (1%) 536:543 (1%)	view
7	x 2	packages/api/src packages/api/src	index.ts index.ts	480:487 (1%) 516:523 (1%)	view

Most Frequent Duplicates

The list of 11 most frequently found duplicates.

Size	#	Folders	Files	Lines	Code
6	x 7	packages/worker/src packages/worker/src packages/worker/src packages/worker/src packages/worker/src packages/worker/src packages/worker/src	index.ts index.ts index.ts index.ts index.ts index.ts index.ts	155:160 (1%) 167:172 (1%) 201:206 (1%) 212:217 (1%) 225:230 (1%) 245:250 (1%) 375:380 (1%)	view
6	x 7	packages/worker/src packages/worker/src packages/worker/src packages/worker/src packages/worker/src packages/worker/src packages/worker/src	index.ts index.ts index.ts index.ts index.ts index.ts index.ts	154:159 (1%) 166:171 (1%) 200:205 (1%) 211:216 (1%) 224:229 (1%) 244:249 (1%) 374:379 (1%)	view
6	x 6	packages/worker/src packages/worker/src packages/worker/src packages/worker/src packages/worker/src packages/worker/src	index.ts index.ts index.ts index.ts index.ts index.ts	156:161 (1%) 168:173 (1%) 202:207 (1%) 213:218 (1%) 226:231 (1%) 246:251 (1%)	view
6	x 4	packages/worker/rapidocr packages/worker/rapidocr packages/worker/rapidocr packages/worker/rapidocr	rapidocr-config.local.yaml rapidocr-config.prod.yaml rapidocr-config.prod.yaml rapidocr-config.local.yaml	106:111 (3%) 106:111 (3%) 122:127 (3%) 122:127 (3%)	view
6	x 4	packages/worker/rapidocr packages/worker/rapidocr packages/worker/rapidocr packages/worker/rapidocr	rapidocr-config.local.yaml rapidocr-config.prod.yaml rapidocr-config.prod.yaml rapidocr-config.local.yaml	107:112 (3%) 107:112 (3%) 123:128 (3%) 123:128 (3%)	view
6	x 4	packages/worker/rapidocr packages/worker/rapidocr packages/worker/rapidocr packages/worker/rapidocr	rapidocr-config.local.yaml rapidocr-config.prod.yaml rapidocr-config.prod.yaml rapidocr-config.local.yaml	109:114 (3%) 109:114 (3%) 125:130 (3%) 125:130 (3%)	view
6	x 4	packages/worker/rapidocr packages/worker/rapidocr packages/worker/rapidocr packages/worker/rapidocr	rapidocr-config.local.yaml rapidocr-config.prod.yaml rapidocr-config.prod.yaml rapidocr-config.local.yaml	108:113 (3%) 108:113 (3%) 124:129 (3%) 124:129 (3%)	view
6	x 3	packages/cdk/lib packages/cdk/lib packages/cdk/lib	transcription-service.ts transcription-service.ts transcription-service.ts	735:741 (<1%) 837:843 (<1%) 868:874 (<1%)	view
6	x 3	packages/backend-common/src packages/output-handler/src packages/output-handler/src	llm.ts index.ts index.ts	82:87 (7%) 114:119 (2%) 235:240 (2%)	view
6	x 3	packages/cdk/lib packages/cdk/lib packages/cdk/lib	transcription-service.ts transcription-service.ts transcription-service.ts	734:739 (<1%) 836:841 (<1%) 867:872 (<1%)	view
6	x 3	packages/backend-common/src packages/output-handler/src packages/output-handler/src	llm.ts index.ts index.ts	80:86 (7%) 112:118 (2%) 233:239 (2%)	view

Duplicated Units

The list of top 1 duplicated units.

See data for all 1 unit duplicate

Size	#	Folders	Files	Lines	Code
7	x 2	packages/backend-common/src packages/output-handler/src	llm.ts index.ts	83:92 212:220	view

About This Analysis

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

To learn more about duplications and techniques for eliminating duplication, Sokrates recommends the following resources:

Avoid Repetition, MartinFlower.com (IEEE Software article)
Refactoring duplicated code, sourcemaking.com
Beck Design Rules, MartinFowler.com
DRY (Don't Repeat Yourself) Principle, Wikipedia
The Cut-and-Paste Programming Software Development Anti-Pattern, sourcemaking.com
Code Smells / Duplicated Code, Jeff Atwood, codinghorror.com:

"Duplicated code is the bane of software development. Stamp out duplication whenever possible. You should always be on the lookout for more subtle cases of near-duplication, too. Don't Repeat Yourself!"

Reducing Coupling, MartinFlower.com (IEEE Software article):

"There are several ways to describe coupling, but it boils down to this: If changing one module in a program requires changing another module, then coupling exists. ... Duplication always implies coupling, because changing one piece of duplicate code implies changing the other."