openai / simple-evals Duplication

openai / simple-evals

Duplication

Places in code with 6 or more lines that are exactly the same.

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

To learn more about duplications and techniques for eliminating duplication, Sokrates recommends the following resources:

Avoid Repetition, MartinFlower.com (IEEE Software article)
Refactoring duplicated code, sourcemaking.com
Beck Design Rules, MartinFowler.com
DRY (Don't Repeat Yourself) Principle, Wikipedia
The Cut-and-Paste Programming Software Development Anti-Pattern, sourcemaking.com
Code Smells / Duplicated Code, Jeff Atwood, codinghorror.com:

"Duplicated code is the bane of software development. Stamp out duplication whenever possible. You should always be on the lookout for more subtle cases of near-duplication, too. Don't Repeat Yourself!"

Reducing Coupling, MartinFlower.com (IEEE Software article):

"There are several ways to describe coupling, but it boils down to this: If changing one module in a program requires changing another module, then coupling exists. ... Duplication always implies coupling, because changing one piece of duplicate code implies changing the other."

Duplication Overall

16% duplication:

5,157 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
843 duplicated lines

1,200 duplicates

dependency graphs: 2D graph | 2D graph (with duplicates)... | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 1,200 duplicates...

Size	#	Folders	Files	Lines	Code
19	x 2	sampler sampler	chat_completion_sampler.py o_chat_completion_sampler.py	37:58 (25%) 28:49 (31%)	view
18	x 2	sampler sampler	o_chat_completion_sampler.py responses_sampler.py	61:79 (30%) 83:100 (21%)	view
18	x 2	ROOT ROOT	run_multilingual_mmlu.py simple_evals.py	27:45 (14%) 194:212 (3%)	view
14	x 2	ROOT ROOT	common.py healthbench_eval.py	192:205 (7%) 248:261 (2%)	view
12	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	2159:2170 (<1%) 2184:2195 (<1%)	view
12	x 2	ROOT ROOT	browsecomp_eval.py simpleqa_eval.py	111:124 (15%) 143:156 (14%)	view
11	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	1362:1372 (<1%) 2419:2429 (<1%)	view
11	x 2	sampler sampler	chat_completion_sampler.py o_chat_completion_sampler.py	85:95 (14%) 69:79 (18%)	view
11	x 2	sampler sampler	chat_completion_sampler.py responses_sampler.py	85:95 (14%) 90:100 (13%)	view
10	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	1209:1218 (<1%) 2420:2429 (<1%)	view
10	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	2159:2168 (<1%) 2211:2220 (<1%)	view
10	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	2184:2193 (<1%) 2211:2220 (<1%)	view
10	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	1209:1218 (<1%) 1363:1372 (<1%)	view
9	x 2	ROOT ROOT	healthbench_eval.py simple_evals.py	670:681 (1%) 520:530 (1%)	view
9	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	1210:1218 (<1%) 2133:2141 (<1%)	view
9	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	453:461 (<1%) 477:485 (<1%)	view
9	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	2133:2141 (<1%) 2421:2429 (<1%)	view
9	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	1364:1372 (<1%) 2133:2141 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	1769:1776 (<1%) 1933:1940 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	822:829 (<1%) 1035:1042 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	1985:1992 (<1%) 2184:2191 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	1035:1042 (<1%) 1566:1573 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	831:838 (<1%) 2184:2191 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	1801:1808 (<1%) 2211:2218 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	477:484 (<1%) 2034:2041 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	1035:1042 (<1%) 1557:1564 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	1365:1372 (<1%) 1759:1766 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	1019:1026 (<1%) 2184:2191 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	831:838 (<1%) 2159:2166 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	1769:1776 (<1%) 1945:1952 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	806:813 (<1%) 900:907 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	1035:1042 (<1%) 1580:1587 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	477:484 (<1%) 2011:2018 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	400:407 (<1%) 1211:1218 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	1769:1776 (<1%) 1957:1964 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	1769:1776 (<1%) 1976:1983 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	1557:1564 (<1%) 1759:1766 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	831:838 (<1%) 2134:2141 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	861:868 (<1%) 2034:2041 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	1019:1026 (<1%) 2159:2166 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	1769:1776 (<1%) 1985:1992 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	1957:1964 (<1%) 2011:2018 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	1985:1992 (<1%) 2159:2166 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	400:407 (<1%) 2501:2508 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	2184:2191 (<1%) 2501:2508 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	861:868 (<1%) 2011:2018 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	822:829 (<1%) 1009:1016 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	1019:1026 (<1%) 2134:2141 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	1557:1564 (<1%) 1769:1776 (<1%)	view
8	x 2	healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb	365:372 (<1%) 2211:2218 (<1%)	view

Most Frequent Duplicates

The list of 19 most frequently found duplicates.

Size	#	Folders	Files	Lines	Code
6	x 46	healthbench_scripts healthbench_scripts healthbench_scripts healthbench_scripts healthbench_scripts healthbench_scripts healthbench_scripts healthbench_scripts healthbench_scripts healthbench_scripts ...	healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb ...	367:372 (<1%) 379:384 (<1%) 391:396 (<1%) 402:407 (<1%) 455:460 (<1%) 479:484 (<1%) 498:503 (<1%) 510:515 (<1%) 790:795 (<1%) 799:804 (<1%) ...	view
6	x 46	healthbench_scripts healthbench_scripts healthbench_scripts healthbench_scripts healthbench_scripts healthbench_scripts healthbench_scripts healthbench_scripts healthbench_scripts healthbench_scripts ...	healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb ...	366:371 (<1%) 378:383 (<1%) 390:395 (<1%) 401:406 (<1%) 454:459 (<1%) 478:483 (<1%) 497:502 (<1%) 509:514 (<1%) 789:794 (<1%) 798:803 (<1%) ...	view
6	x 46	healthbench_scripts healthbench_scripts healthbench_scripts healthbench_scripts healthbench_scripts healthbench_scripts healthbench_scripts healthbench_scripts healthbench_scripts healthbench_scripts ...	healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb ...	365:370 (<1%) 377:382 (<1%) 389:394 (<1%) 400:405 (<1%) 453:458 (<1%) 477:482 (<1%) 496:501 (<1%) 508:513 (<1%) 788:793 (<1%) 797:802 (<1%) ...	view
6	x 17	healthbench_scripts healthbench_scripts healthbench_scripts healthbench_scripts healthbench_scripts healthbench_scripts healthbench_scripts healthbench_scripts healthbench_scripts healthbench_scripts ...	healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb ...	14:19 (<1%) 238:243 (<1%) 531:536 (<1%) 604:609 (<1%) 781:786 (<1%) 815:820 (<1%) 840:845 (<1%) 870:875 (<1%) 1002:1007 (<1%) 1028:1033 (<1%) ...	view
6	x 4	sampler sampler sampler sampler	chat_completion_sampler.py claude_sampler.py o_chat_completion_sampler.py responses_sampler.py	89:94 (8%) 96:101 (6%) 73:78 (10%) 94:99 (7%)	view
6	x 4	sampler sampler sampler sampler	chat_completion_sampler.py claude_sampler.py o_chat_completion_sampler.py responses_sampler.py	37:42 (8%) 43:48 (6%) 28:33 (10%) 36:41 (7%)	view
6	x 4	sampler sampler sampler sampler	chat_completion_sampler.py claude_sampler.py o_chat_completion_sampler.py responses_sampler.py	90:95 (8%) 97:102 (6%) 74:79 (10%) 95:100 (7%)	view
6	x 4	healthbench_scripts healthbench_scripts healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb	1210:1215 (<1%) 1364:1369 (<1%) 2133:2138 (<1%) 2421:2426 (<1%)	view
6	x 3	sampler sampler sampler	chat_completion_sampler.py o_chat_completion_sampler.py responses_sampler.py	87:92 (8%) 71:76 (10%) 92:97 (7%)	view
6	x 3	sampler sampler sampler	chat_completion_sampler.py o_chat_completion_sampler.py responses_sampler.py	86:91 (8%) 70:75 (10%) 91:96 (7%)	view
6	x 3	healthbench_scripts healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb	2163:2168 (<1%) 2188:2193 (<1%) 2215:2220 (<1%)	view
6	x 3	sampler sampler sampler	chat_completion_sampler.py claude_sampler.py o_chat_completion_sampler.py	38:43 (8%) 44:49 (6%) 29:34 (10%)	view
6	x 3	sampler sampler sampler	chat_completion_sampler.py o_chat_completion_sampler.py responses_sampler.py	88:93 (8%) 72:77 (10%) 93:98 (7%)	view
6	x 3	ROOT ROOT ROOT	simple_evals.py run_multilingual_mmlu.py healthbench_eval.py	523:530 (1%) 137:144 (4%) 674:681 (1%)	view
6	x 3	sampler sampler sampler	chat_completion_sampler.py claude_sampler.py o_chat_completion_sampler.py	39:44 (8%) 45:50 (6%) 30:35 (10%)	view
6	x 3	healthbench_scripts healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb	2162:2167 (<1%) 2187:2192 (<1%) 2214:2219 (<1%)	view
6	x 3	sampler sampler sampler	responses_sampler.py o_chat_completion_sampler.py chat_completion_sampler.py	83:88 (7%) 61:67 (10%) 77:83 (8%)	view
6	x 3	sampler sampler sampler	chat_completion_sampler.py o_chat_completion_sampler.py responses_sampler.py	85:90 (8%) 69:74 (10%) 90:95 (7%)	view
6	x 3	healthbench_scripts healthbench_scripts healthbench_scripts	healthbench_analysis.ipynb healthbench_analysis.ipynb healthbench_analysis.ipynb	1209:1214 (<1%) 1363:1368 (<1%) 2420:2425 (<1%)	view