huggingface / open_asr_leaderboard Duplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

23% duplication:

4,773 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
1,142 duplicated lines

171 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
liteASR (92%) --> transformers (90%)	328	1 file pair	details...
moonshine (85%) --> transformers (75%)	274	1 file pair	details...
liteASR (76%) --> moonshine (85%)	272	1 file pair	details...
granite (69%) --> phi (63%)	240	1 file pair	details...
moonshine (73%) --> tensorrtllm (25%)	236	1 file pair	details...
tensorrtllm (25%) --> transformers (64%)	236	1 file pair	details...
liteASR (65%) --> tensorrtllm (24%)	234	1 file pair	details...
phi (59%) --> transformers (62%)	226	1 file pair	details...
granite (64%) --> tensorrtllm (23%)	224	1 file pair	details...
phi (59%) --> tensorrtllm (23%)	224	1 file pair	details...
liteASR (62%) --> phi (59%)	224	1 file pair	details...
moonshine (69%) --> phi (58%)	222	1 file pair	details...
granite (63%) --> moonshine (68%)	220	1 file pair	details...
granite (63%) --> transformers (60%)	220	1 file pair	details...
granite (63%) --> liteASR (61%)	218	1 file pair	details...
phi (52%) --> speechbrain (52%)	200	1 file pair	details...
kyutai (46%) --> transformers (54%)	198	1 file pair	details...
granite (57%) --> speechbrain (52%)	198	1 file pair	details...
kyutai (46%) --> liteASR (55%)	196	1 file pair	details...
kyutai (43%) --> tensorrtllm (19%)	186	1 file pair	details...
kyutai (43%) --> moonshine (58%)	186	1 file pair	details...
speechbrain (48%) --> tensorrtllm (19%)	184	1 file pair	details...
speechbrain (48%) --> transformers (50%)	184	1 file pair	details...
moonshine (57%) --> speechbrain (48%)	184	1 file pair	details...
liteASR (51%) --> speechbrain (47%)	182	1 file pair	details...
kyutai (42%) --> phi (47%)	180	1 file pair	details...
granite (47%) --> kyutai (38%)	166	1 file pair	details...
ctranslate2 (64%) --> speechbrain (38%)	146	1 file pair	details...
ctranslate2 (63%) --> kyutai (33%)	144	1 file pair	details...
ctranslate2 (62%) --> tensorrtllm (15%)	142	1 file pair	details...
ctranslate2 (62%) --> granite (41%)	142	1 file pair	details...
ctranslate2 (62%) --> moonshine (44%)	142	1 file pair	details...
ctranslate2 (62%) --> phi (37%)	142	1 file pair	details...
ctranslate2 (62%) --> transformers (39%)	142	1 file pair	details...
kyutai (31%) --> speechbrain (35%)	136	1 file pair	details...
ctranslate2 (57%) --> liteASR (36%)	130	1 file pair	details...
ctranslate2 (30%) --> nemo_asr (23%)	70	1 file pair	details...
granite (17%) --> nemo_asr (20%)	60	1 file pair	details...
moonshine (18%) --> nemo_asr (20%)	60	1 file pair	details...
nemo_asr (20%) --> phi (15%)	60	1 file pair	details...
kyutai (14%) --> nemo_asr (20%)	60	1 file pair	details...
nemo_asr (20%) --> speechbrain (15%)	60	1 file pair	details...
nemo_asr (20%) --> tensorrtllm (6%)	60	1 file pair	details...
nemo_asr (20%) --> transformers (16%)	60	1 file pair	details...
liteASR (16%) --> nemo_asr (19%)	58	1 file pair	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 171 duplicates...

Size	#	Folders	Files	Lines	Code
129	x 2	moonshine transformers	run_eval.py run_eval.py	67:208 (80%) 95:236 (70%)	view
120	x 2	granite phi	run_eval.py run_eval.py	83:214 (69%) 115:246 (63%)	view
109	x 2	moonshine tensorrtllm	run_eval.py run_eval.py	68:188 (68%) 224:344 (38%)	view
109	x 2	tensorrtllm transformers	run_eval.py run_eval.py	224:344 (38%) 96:216 (59%)	view
94	x 2	phi transformers	run_eval.py run_eval.py	108:217 (49%) 89:198 (51%)	view
92	x 2	moonshine phi	run_eval.py run_eval.py	67:170 (57%) 114:217 (48%)	view
91	x 2	granite moonshine	run_eval.py run_eval.py	83:185 (52%) 68:170 (56%)	view
91	x 2	granite tensorrtllm	run_eval.py run_eval.py	83:185 (52%) 224:326 (31%)	view
91	x 2	phi tensorrtllm	run_eval.py run_eval.py	115:217 (48%) 224:326 (31%)	view
91	x 2	granite transformers	run_eval.py run_eval.py	83:185 (52%) 96:198 (50%)	view
86	x 2	liteASR transformers	run_eval.py run_eval.py	69:178 (48%) 74:183 (47%)	view
79	x 2	liteASR phi	run_eval.py run_eval.py	84:178 (44%) 108:202 (41%)	view
77	x 2	liteASR moonshine	run_eval.py run_eval.py	90:178 (43%) 67:155 (48%)	view
76	x 2	liteASR tensorrtllm	run_eval.py run_eval.py	91:178 (42%) 224:311 (26%)	view
76	x 2	granite liteASR	run_eval.py run_eval.py	83:170 (43%) 91:178 (42%)	view
51	x 2	liteASR transformers	run_eval.py run_eval.py	180:231 (28%) 185:236 (28%)	view
51	x 2	liteASR moonshine	run_eval.py run_eval.py	180:231 (28%) 157:208 (31%)	view
40	x 2	speechbrain tensorrtllm	run_eval.py run_eval.py	207:246 (21%) 299:338 (13%)	view
40	x 2	speechbrain transformers	run_eval.py run_eval.py	207:246 (21%) 171:210 (21%)	view
40	x 2	moonshine speechbrain	run_eval.py run_eval.py	143:182 (25%) 207:246 (21%)	view
37	x 2	kyutai tensorrtllm	run_eval.py run_eval.py	206:245 (17%) 283:322 (12%)	view
37	x 2	kyutai moonshine	run_eval.py run_eval.py	206:245 (17%) 127:166 (23%)	view
37	x 2	granite kyutai	run_eval.py run_eval.py	142:181 (21%) 206:245 (17%)	view
37	x 2	kyutai phi	run_eval.py run_eval.py	206:245 (17%) 174:213 (19%)	view
37	x 2	kyutai transformers	run_eval.py run_eval.py	206:245 (17%) 155:194 (20%)	view
33	x 2	ctranslate2 tensorrtllm	run_eval.py run_eval.py	57:95 (28%) 254:292 (11%)	view
33	x 2	ctranslate2 granite	run_eval.py run_eval.py	57:95 (28%) 113:151 (19%)	view
33	x 2	ctranslate2 moonshine	run_eval.py run_eval.py	57:95 (28%) 98:136 (20%)	view
33	x 2	ctranslate2 phi	run_eval.py run_eval.py	57:95 (28%) 145:183 (17%)	view
33	x 2	ctranslate2 liteASR	run_eval.py run_eval.py	57:95 (28%) 121:159 (18%)	view
33	x 2	ctranslate2 transformers	run_eval.py run_eval.py	57:95 (28%) 126:164 (18%)	view
32	x 2	liteASR tensorrtllm	run_eval.py run_eval.py	180:211 (17%) 313:344 (11%)	view
28	x 2	phi speechbrain	run_eval.py run_eval.py	190:217 (14%) 207:234 (14%)	view
28	x 2	granite speechbrain	run_eval.py run_eval.py	158:185 (16%) 207:234 (14%)	view
27	x 2	liteASR transformers	run_eval.py run_eval.py	21:60 (15%) 27:66 (14%)	view
26	x 2	liteASR speechbrain	run_eval.py run_eval.py	180:205 (14%) 221:246 (13%)	view
26	x 2	kyutai liteASR	run_eval.py run_eval.py	206:234 (12%) 150:178 (14%)	view
26	x 2	kyutai phi	run_eval.py run_eval.py	173:202 (12%) 143:172 (13%)	view
26	x 2	granite speechbrain	run_eval.py run_eval.py	97:127 (15%) 137:167 (13%)	view
26	x 2	kyutai liteASR	run_eval.py run_eval.py	173:202 (12%) 119:148 (14%)	view
26	x 2	kyutai tensorrtllm	run_eval.py run_eval.py	173:202 (12%) 252:281 (9%)	view
26	x 2	speechbrain tensorrtllm	run_eval.py run_eval.py	137:167 (13%) 238:268 (9%)	view
26	x 2	liteASR speechbrain	run_eval.py run_eval.py	105:135 (14%) 137:167 (13%)	view
26	x 2	kyutai moonshine	run_eval.py run_eval.py	173:202 (12%) 96:125 (16%)	view
26	x 2	moonshine speechbrain	run_eval.py run_eval.py	82:112 (16%) 137:167 (13%)	view
26	x 2	granite kyutai	run_eval.py run_eval.py	111:140 (15%) 173:202 (12%)	view
26	x 2	kyutai transformers	run_eval.py run_eval.py	173:202 (12%) 124:153 (14%)	view
26	x 2	speechbrain transformers	run_eval.py run_eval.py	137:167 (13%) 110:140 (14%)	view
26	x 2	phi speechbrain	run_eval.py run_eval.py	129:159 (13%) 137:167 (13%)	view
25	x 2	ctranslate2 kyutai	run_eval.py run_eval.py	57:84 (21%) 175:202 (11%)	view