Duplication · deepseek-ai/DeepSeek-Math

Duplication Overall

16% duplication:

3,893 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
647 duplicated lines

37 duplicates

dependency graphs: 2D graph | 2D graph (with duplicates)... | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 37 longest duplicates.

See data for all 37 duplicates...

Size	#	Folders	Files	Lines	Code
42	x 2	evaluation/infer evaluation/infer	run_cot_eval.py run_pal_eval.py	159:205 (22%) 173:219 (21%)	view
37	x 2	evaluation/infer evaluation/infer	run_cot_eval.py run_pal_eval.py	72:110 (19%) 98:136 (18%)	view
24	x 2	evaluation/infer evaluation/infer	run_pal_eval.py run_tool_integrated_eval.py	43:71 (12%) 206:234 (8%)	view
21	x 2	evaluation/infer evaluation/infer	run_cot_eval.py run_pal_eval.py	4:40 (11%) 4:41 (10%)	view
21	x 2	evaluation/infer evaluation/infer	run_pal_eval.py run_tool_integrated_eval.py	221:244 (10%) 307:330 (7%)	view
20	x 2	evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py	183:203 (10%) 281:301 (7%)	view
20	x 2	evaluation/infer evaluation/infer	run_pal_eval.py run_tool_integrated_eval.py	73:93 (10%) 68:88 (7%)	view
20	x 2	evaluation/infer evaluation/infer	run_pal_eval.py run_tool_integrated_eval.py	197:217 (10%) 281:301 (7%)	view
18	x 2	evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py	24:42 (9%) 49:67 (6%)	view
18	x 2	replicate replicate	predict.py predict_instruct.py	41:58 (28%) 41:58 (27%)	view
17	x 2	evaluation/infer evaluation/infer	run_pal_eval.py run_tool_integrated_eval.py	25:41 (8%) 49:65 (6%)	view
17	x 2	replicate replicate	predict.py predict_instruct.py	22:39 (26%) 22:39 (25%)	view
15	x 2	evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py	219:234 (7%) 315:330 (5%)	view
15	x 2	evaluation/infer evaluation/infer	run_cot_eval.py run_pal_eval.py	219:234 (7%) 229:244 (7%)	view
12	x 2	evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py	47:59 (6%) 68:80 (4%)	view
12	x 2	evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py	170:182 (6%) 267:279 (4%)	view
12	x 2	evaluation/infer evaluation/infer	run_cot_eval.py run_pal_eval.py	47:59 (6%) 73:85 (6%)	view
12	x 2	evaluation/infer evaluation/infer	run_pal_eval.py run_tool_integrated_eval.py	184:196 (6%) 267:279 (4%)	view
11	x 2	evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py	121:133 (5%) 200:214 (4%)	view
11	x 2	evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py	140:154 (5%) 220:234 (4%)	view
11	x 2	evaluation/infer evaluation/infer	run_cot_eval.py run_pal_eval.py	140:154 (5%) 57:71 (5%)	view
10	x 2	evaluation/data_processing evaluation/data_processing	process_utils.py process_utils.py	132:141 (6%) 147:156 (6%)	view
8	x 2	evaluation/infer evaluation/infer	run_cot_eval.py run_pal_eval.py	125:133 (4%) 43:51 (4%)	view
7	x 2	evaluation/eval evaluation/eval	eval_utils.py eval_utils.py	165:171 (2%) 284:290 (2%)	view
7	x 2	evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py	84:90 (3%) 118:124 (2%)	view
7	x 2	evaluation/few_shot_prompts evaluation/few_shot_prompts	cot_mmlu_stem_4_shot.py cot_ocwcourses_4_shot.py	49:57 (77%) 112:120 (58%)	view
7	x 2	evaluation/few_shot_prompts evaluation/few_shot_prompts	cot_math_sat_4_shot.py cot_mmlu_stem_4_shot.py	51:59 (70%) 49:57 (77%)	view
7	x 2	evaluation/infer evaluation/infer	run_pal_eval.py run_tool_integrated_eval.py	110:116 (3%) 118:124 (2%)	view
7	x 2	evaluation/few_shot_prompts evaluation/few_shot_prompts	cot_math_sat_4_shot.py cot_ocwcourses_4_shot.py	51:59 (70%) 112:120 (58%)	view
7	x 2	evaluation/few_shot_prompts evaluation/few_shot_prompts	cot_gaokao_mathcloze_5_shot.py cot_gaokao_mathqa_5_shot.py	49:57 (70%) 49:57 (70%)	view
7	x 2	replicate replicate	predict.py predict_instruct.py	62:68 (11%) 65:72 (10%)	view
6	x 2	evaluation/data_processing evaluation/data_processing	process_utils.py process_utils.py	65:70 (3%) 84:89 (3%)	view
6	x 2	evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py	207:213 (3%) 307:313 (2%)	view
6	x 2	evaluation/infer evaluation/infer	run_cot_eval.py run_pal_eval.py	113:119 (3%) 161:167 (3%)	view
6	x 2	evaluation/infer evaluation/infer	run_cot_eval.py run_pal_eval.py	207:213 (3%) 221:227 (3%)	view
6	x 2	replicate replicate	predict.py predict_instruct.py	70:75 (9%) 74:79 (9%)	view
6	x 2	replicate replicate	predict.py predict_instruct.py	77:82 (9%) 81:86 (9%)	view

Most Frequent Duplicates

The list of 50 most frequently found duplicates.

Size	#	Folders	Files	Lines	Code
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	198:203 (3%) 296:301 (2%) 212:217 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	224:229 (3%) 320:325 (2%) 234:239 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	28:33 (3%) 53:58 (2%) 29:34 (3%)	view
6	x 3	evaluation/few_shot_prompts evaluation/few_shot_prompts evaluation/few_shot_prompts	cot_math_sat_4_shot.py cot_ocwcourses_4_shot.py cot_mmlu_stem_4_shot.py	51:58 (60%) 112:119 (50%) 49:56 (66%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	186:191 (3%) 284:289 (2%) 200:205 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	170:176 (3%) 267:273 (2%) 184:190 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	49:55 (3%) 70:76 (2%) 75:81 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	223:228 (3%) 319:324 (2%) 233:238 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_pal_eval.py run_tool_integrated_eval.py run_cot_eval.py	44:50 (3%) 207:213 (2%) 126:132 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	35:40 (3%) 60:65 (2%) 36:41 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	84:89 (3%) 118:123 (2%) 110:115 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	172:178 (3%) 269:275 (2%) 186:192 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	85:90 (3%) 119:124 (2%) 111:116 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	194:199 (3%) 292:297 (2%) 208:213 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	29:34 (3%) 54:59 (2%) 30:35 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	33:38 (3%) 58:63 (2%) 34:39 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	47:53 (3%) 68:74 (2%) 73:79 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	207:213 (3%) 307:313 (2%) 221:227 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	51:56 (3%) 72:77 (2%) 77:82 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	228:234 (3%) 324:330 (2%) 238:244 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	24:29 (3%) 49:54 (2%) 25:30 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	31:36 (3%) 56:61 (2%) 32:37 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	221:226 (3%) 317:322 (2%) 231:236 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	225:230 (3%) 321:326 (2%) 235:240 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	193:198 (3%) 291:296 (2%) 207:212 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_pal_eval.py run_tool_integrated_eval.py run_cot_eval.py	61:68 (3%) 224:231 (2%) 144:151 (3%)	view
6	x 3	evaluation/few_shot_prompts evaluation/few_shot_prompts evaluation/few_shot_prompts	cot_math_sat_4_shot.py cot_ocwcourses_4_shot.py cot_mmlu_stem_4_shot.py	52:59 (60%) 113:120 (50%) 50:57 (66%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_pal_eval.py run_tool_integrated_eval.py run_cot_eval.py	58:65 (3%) 221:228 (2%) 141:148 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	176:181 (3%) 273:278 (2%) 190:195 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_pal_eval.py run_tool_integrated_eval.py run_cot_eval.py	63:70 (3%) 226:233 (2%) 146:153 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	192:197 (3%) 290:295 (2%) 206:211 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_pal_eval.py run_tool_integrated_eval.py run_cot_eval.py	64:71 (3%) 227:234 (2%) 147:154 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	188:193 (3%) 286:291 (2%) 202:207 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	177:182 (3%) 274:279 (2%) 191:196 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	32:37 (3%) 57:62 (2%) 33:38 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	52:57 (3%) 73:78 (2%) 78:83 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	185:190 (3%) 283:288 (2%) 199:204 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	197:202 (3%) 295:300 (2%) 211:216 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	196:201 (3%) 294:299 (2%) 210:215 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	220:225 (3%) 316:321 (2%) 230:235 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_pal_eval.py run_tool_integrated_eval.py run_cot_eval.py	60:67 (3%) 223:230 (2%) 143:150 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	173:179 (3%) 270:276 (2%) 187:193 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	183:189 (3%) 281:287 (2%) 197:203 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	187:192 (3%) 285:290 (2%) 201:206 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	25:30 (3%) 50:55 (2%) 26:31 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	174:180 (3%) 271:277 (2%) 188:194 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	54:59 (3%) 75:80 (2%) 80:85 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	30:35 (3%) 55:60 (2%) 31:36 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	189:194 (3%) 287:292 (2%) 203:208 (3%)	view
6	x 3	evaluation/infer evaluation/infer evaluation/infer	run_cot_eval.py run_tool_integrated_eval.py run_pal_eval.py	226:231 (3%) 322:327 (2%) 236:241 (3%)	view

Duplicated Units

The list of top 1 duplicated units.

See data for all 1 unit duplicate

Size	#	Folders	Files	Lines	Code
15	x 3	evaluation/infer evaluation/infer evaluation/infer	run_tool_integrated_eval.py run_cot_eval.py run_pal_eval.py	49:65 24:40 25:41	view

About This Analysis

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

To learn more about duplications and techniques for eliminating duplication, Sokrates recommends the following resources:

Avoid Repetition, MartinFlower.com (IEEE Software article)
Refactoring duplicated code, sourcemaking.com
Beck Design Rules, MartinFowler.com
DRY (Don't Repeat Yourself) Principle, Wikipedia
The Cut-and-Paste Programming Software Development Anti-Pattern, sourcemaking.com
Code Smells / Duplicated Code, Jeff Atwood, codinghorror.com:

"Duplicated code is the bane of software development. Stamp out duplication whenever possible. You should always be on the lookout for more subtle cases of near-duplication, too. Don't Repeat Yourself!"

Reducing Coupling, MartinFlower.com (IEEE Software article):

"There are several ways to describe coupling, but it boils down to this: If changing one module in a program requires changing another module, then coupling exists. ... Duplication always implies coupling, because changing one piece of duplicate code implies changing the other."