openai / frontier-evals Duplication

openai / frontier-evals

Duplication

Places in code with 6 or more lines that are exactly the same.

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

To learn more about duplications and techniques for eliminating duplication, Sokrates recommends the following resources:

Avoid Repetition, MartinFlower.com (IEEE Software article)
Refactoring duplicated code, sourcemaking.com
Beck Design Rules, MartinFowler.com
DRY (Don't Repeat Yourself) Principle, Wikipedia
The Cut-and-Paste Programming Software Development Anti-Pattern, sourcemaking.com
Code Smells / Duplicated Code, Jeff Atwood, codinghorror.com:

"Duplicated code is the bane of software development. Stamp out duplication whenever possible. You should always be on the lookout for more subtle cases of near-duplication, too. Don't Repeat Yourself!"

Reducing Coupling, MartinFlower.com (IEEE Software article):

"There are several ways to describe coupling, but it boils down to this: If changing one module in a program requires changing another module, then coupling exists. ... Duplication always implies coupling, because changing one piece of duplicate code implies changing the other."

Duplication Overall

5% duplication:

26,346 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
1,469 duplicated lines

111 duplicates

dependency graphs: 2D graph | 2D graph (with duplicates)... | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 111 duplicates...

Size	#	Folders	Files	Lines	Code
31	x 2	project/paperbench/experiments/judge_eval project/paperbench/experiments/judge_eval	judge_eval_perf_cost.py judge_eval_perf_tables.py	58:98 (18%) 8:48 (25%)	view
25	x 2	project/evmbench/ploit/.config project/evmbench/veto/.config	zepter.yaml zepter.yaml	1:42 (100%) 1:42 (100%)	view
22	x 2	project/evmbench/evmbench/nano project/swelancer/swelancer/utils	logging.py custom_logging.py	11:47 (64%) 23:59 (55%)	view
22	x 2	project/paperbench/paperbench/nano project/swelancer/swelancer/utils	logging.py custom_logging.py	11:47 (64%) 23:59 (55%)	view
22	x 2	project/evmbench/evmbench/nano project/paperbench/paperbench/nano	logging.py logging.py	11:47 (64%) 11:47 (64%)	view
19	x 2	project/evmbench/ploit/crates/utils/src project/evmbench/ploit/crates/utils/src	process.rs process.rs	54:81 (22%) 131:158 (22%)	view
17	x 2	project/swelancer/swelancer/solvers/dummy project/swelancer/swelan...solvers/swelancer_agent	solver.py solver.py	143:160 (15%) 327:344 (6%)	view
15	x 2	project/evmbench/evmbench/nano/grade project/evmbench/evmbench/nano/grade	detect.py detect.py	53:67 (15%) 75:89 (15%)	view
14	x 2	project/common/preparedn...aredness_turn_completer project/common/preparedn...esponses_turn_completer	oai_completions_turn_completer.py completer.py	48:70 (13%) 58:80 (11%)	view
14	x 2	project/evmbench/scripts project/evmbench/scripts	backfill_agent_tokens.py stats.py	25:38 (9%) 98:111 (1%)	view
13	x 2	project/evmbench/evmbench project/paperbench/paperbench	utils.py utils.py	17:37 (13%) 84:105 (8%)	view
13	x 2	project/evmbench/scripts project/evmbench/scripts	backfill_agent_tokens.py stats.py	160:174 (8%) 1240:1254 (1%)	view
12	x 2	project/evmbench/evmbench project/evmbench/evmbench	alcatraz.py alcatraz.py	137:156 (4%) 166:186 (4%)	view
12	x 2	project/evmbench/ploit/crates/core/src project/evmbench/ploit/crates/core/src	setup.rs setup.rs	672:683 (2%) 699:710 (2%)	view
12	x 2	project/common/alcatraz/alcatraz/clusters project/common/nanoeval/.../solvers/computer_tasks	_serialization.py _serializable_base_model.py	19:39 (63%) 10:34 (60%)	view
11	x 2	project/paperbench/paperbench project/paperbench/paperbench	reproduce.py reproduce.py	166:176 (4%) 253:263 (4%)	view
11	x 2	project/swelancer/swelancer/solvers/dummy project/swelancer/swelan...solvers/swelancer_agent	solver.py solver.py	118:131 (10%) 208:220 (4%)	view
10	x 2	project/common/nanoeval_alcatraz/nanoeval_alcatraz project/common/nanoeval_alcatraz/nanoeval_alcatraz	alcatraz_computer_interface.py alcatraz_computer_interface.py	173:184 (7%) 211:222 (7%)	view
10	x 2	project/evmbench/scripts project/evmbench/scripts	stats.py stats.py	930:939 (<1%) 1044:1053 (<1%)	view
10	x 2	project/evmbench/evmbench project/paperbench/paperbench	utils.py utils.py	83:97 (10%) 230:245 (6%)	view
10	x 2	project/swelancer/issues/16912_4 project/swelancer/issues/29854_602	user_tool.py user_tool.py	16:25 (18%) 51:60 (12%)	view
10	x 2	project/evmbench/evmbench/nano project/paperbench/paperbench/nano	logging.py logging.py	56:69 (29%) 56:69 (29%)	view
9	x 2	project/paperbench/paperbench/gui/static project/paperbench/paperbench/gui/static	script.js script.js	235:244 (2%) 370:379 (2%)	view
9	x 2	project/evmbench/ploit/crates/grader/src project/evmbench/ploit/crates/grader/src	memory.rs script.rs	80:90 (5%) 144:154 (5%)	view
9	x 2	project/common/nanoeval/nanoeval project/common/nanoeval/nanoeval	json_recorder.py library_config.py	67:75 (8%) 51:59 (5%)	view
9	x 2	project/paperbench/experiments/judge_eval project/paperbench/experiments/judge_eval	judge_eval_perf_cost.py judge_eval_perf_tables.py	100:113 (5%) 49:62 (7%)	view
9	x 2	project/swelancer/issues/32236_652 project/swelancer/runtime_utils	user_tool.py email_handler.py	36:46 (8%) 163:175 (9%)	view
9	x 2	project/evmbench/evmbench project/evmbench/evmbench	alcatraz.py alcatraz.py	30:38 (3%) 56:64 (3%)	view
9	x 2	project/paperbench/paperbench project/paperbench/paperbench	utils.py utils.py	256:264 (5%) 271:279 (5%)	view
9	x 2	project/evmbench/evmbench/nano/grade project/evmbench/evmbench/nano/grade	exploit.py patch.py	45:54 (4%) 155:164 (1%)	view
8	x 2	project/paperbench/paperbench/gui project/paperbench/paperbench/gui	app.py app.py	239:248 (1%) 458:467 (1%)	view
8	x 2	project/paperbench/paperbench/solvers project/paperbench/paperbench/solvers	apply_patch.py apply_patch.py	296:303 (2%) 314:321 (2%)	view
8	x 2	project/paperbench/paperbench/gui project/paperbench/paperbench/gui	app.py app.py	150:159 (1%) 269:278 (1%)	view
8	x 2	project/common/nanoeval/nanoeval project/common/nanoeval/nanoeval	json_recorder.py library_config.py	87:94 (7%) 68:75 (5%)	view
8	x 2	project/paperbench/paperbench/gui project/paperbench/paperbench/gui	app.py app.py	269:278 (1%) 458:467 (1%)	view
8	x 2	project/evmbench/ploit/crates/exec/src project/evmbench/ploit/crates/grader/src	lib.rs lib.rs	1:10 (44%) 1:13 (40%)	view
8	x 2	project/paperbench/paperbench/gui project/paperbench/paperbench/gui	app.py app.py	186:193 (1%) 527:534 (1%)	view
8	x 2	project/paperbench/paperbench/gui project/paperbench/paperbench/gui	app.py app.py	150:159 (1%) 458:467 (1%)	view
8	x 2	project/evmbench/scripts project/evmbench/scripts	stats.py stats.py	922:929 (<1%) 1034:1041 (<1%)	view
8	x 2	project/common/nanoeval/nanoeval project/common/nanoeval/nanoeval	json_recorder.py recorder_protocol.py	67:74 (7%) 42:49 (15%)	view
8	x 2	project/evmbench/evmbench/nano/grade project/evmbench/evmbench/nano/grade	exploit.py patch.py	218:225 (4%) 477:484 (1%)	view
8	x 2	project/common/nanoeval/nanoeval project/common/nanoeval/nanoeval	library_config.py recorder_protocol.py	51:58 (5%) 42:49 (15%)	view
8	x 2	project/paperbench/paperbench project/swelancer/swelancer	utils.py eval.py	230:239 (5%) 73:81 (1%)	view
8	x 2	project/common/alcatraz/alcatraz/clusters project/common/alcatraz/alcatraz/clusters	local.py local.py	1112:1119 (<1%) 1264:1271 (<1%)	view
8	x 2	project/common/nanoeval/nanoeval project/common/nanoeval/nanoeval	asyncio_utils.py asyncio_utils.py	91:99 (7%) 128:136 (7%)	view
8	x 2	project/paperbench/paperbench/gui project/paperbench/paperbench/gui	app.py app.py	150:159 (1%) 239:248 (1%)	view
8	x 2	project/paperbench/paperbench/gui project/paperbench/paperbench/gui	app.py app.py	239:248 (1%) 269:278 (1%)	view
8	x 2	project/swelancer/swelancer/solvers/dummy project/swelancer/swelan...solvers/swelancer_agent	solver.py solver.py	17:30 (7%) 31:44 (3%)	view
8	x 2	project/evmbench/evmbench project/swelancer/swelancer	utils.py eval.py	83:92 (8%) 73:81 (1%)	view
7	x 2	project/evmbench/evmbench/nano/grade project/evmbench/evmbench/nano/grade	patch.py patch.py	466:472 (1%) 532:538 (1%)	view

Most Frequent Duplicates

The list of 34 most frequently found duplicates.

Size	#	Folders	Files	Lines	Code
6	x 6	project/paperbench/paperbench/gui project/paperbench/paperbench/gui project/paperbench/paperbench/gui project/paperbench/paperbench/gui project/paperbench/paperbench/gui project/paperbench/paperbench/gui	app.py app.py app.py app.py app.py app.py	123:129 (1%) 153:159 (1%) 210:216 (1%) 242:248 (1%) 272:278 (1%) 461:467 (1%)	view
6	x 6	project/paperbench/paperbench/gui project/paperbench/paperbench/gui project/paperbench/paperbench/gui project/paperbench/paperbench/gui project/paperbench/paperbench/gui project/paperbench/paperbench/gui	app.py app.py app.py app.py app.py app.py	122:128 (1%) 152:158 (1%) 209:215 (1%) 241:247 (1%) 271:277 (1%) 460:466 (1%)	view
6	x 4	project/common/alcatraz/alcatraz/clusters project/common/alcatraz/alcatraz/clusters project/common/alcatraz/alcatraz/clusters project/common/alcatraz/alcatraz/clusters	local.py local.py local.py local.py	515:520 (<1%) 1156:1163 (<1%) 1168:1175 (<1%) 1202:1209 (<1%)	view
6	x 4	project/paperbench/paperbench/solvers project/paperbench/paperbench project/paperbench/paperbench/infra project/paperbench/paperbench/infra	upload.py computer_utils.py alcatraz.py alcatraz.py	91:96 (5%) 31:36 (5%) 26:40 (2%) 59:72 (2%)	view
6	x 4	project/paperbench/paperbench/solvers project/paperbench/paperbench project/paperbench/paperbench/infra project/paperbench/paperbench/infra	upload.py computer_utils.py alcatraz.py alcatraz.py	90:95 (5%) 30:35 (5%) 25:39 (2%) 58:71 (2%)	view
6	x 4	project/paperbench/paperbench/gui project/paperbench/paperbench/gui project/paperbench/paperbench/gui project/paperbench/paperbench/gui	app.py app.py app.py app.py	150:157 (1%) 239:246 (1%) 269:276 (1%) 458:465 (1%)	view
6	x 3	project/common/nanoeval/nanoeval project/common/nanoeval/nanoeval project/common/nanoeval/nanoeval	recorder_protocol.py library_config.py json_recorder.py	44:49 (11%) 53:58 (3%) 69:74 (5%)	view
6	x 3	project/paperbench/paperbench/nano project/evmbench/evmbench/nano project/swelancer/swelancer/utils	logging.py logging.py custom_logging.py	16:23 (17%) 16:23 (17%) 28:35 (15%)	view
6	x 3	project/common/nanoeval/nanoeval project/common/nanoeval/nanoeval project/common/nanoeval/nanoeval	recorder_protocol.py library_config.py json_recorder.py	52:57 (11%) 68:73 (3%) 87:92 (5%)	view
6	x 3	project/paperbench/paperbench/nano project/evmbench/evmbench/nano project/swelancer/swelancer/utils	logging.py logging.py custom_logging.py	30:37 (17%) 30:37 (17%) 42:49 (15%)	view
6	x 3	project/paperbench/paperbench/nano project/evmbench/evmbench/nano project/swelancer/swelancer/utils	logging.py logging.py custom_logging.py	24:35 (17%) 24:35 (17%) 36:47 (15%)	view
6	x 3	project/paperbench/paperbench project/swelancer/swelancer project/evmbench/evmbench	utils.py eval.py utils.py	231:238 (3%) 74:80 (1%) 84:91 (6%)	view
6	x 3	project/common/preparedn...aredness_turn_completer project/common/preparedn...aredness_turn_completer project/common/preparedn...aredness_turn_completer	type_helpers.py type_helpers.py type_helpers.py	41:46 (3%) 62:67 (3%) 80:85 (3%)	view
6	x 3	project/paperbench/paperbench/nano project/evmbench/evmbench/nano project/swelancer/swelancer/utils	logging.py logging.py custom_logging.py	23:34 (17%) 23:34 (17%) 35:46 (15%)	view
6	x 3	project/paperbench/paperbench/nano project/evmbench/evmbench/nano project/swelancer/swelancer/utils	logging.py logging.py custom_logging.py	22:33 (17%) 22:33 (17%) 34:45 (15%)	view
6	x 3	project/paperbench/paperbench/nano project/evmbench/evmbench/nano project/swelancer/swelancer/utils	logging.py logging.py custom_logging.py	32:38 (17%) 32:38 (17%) 44:50 (15%)	view
6	x 3	project/common/nanoeval/nanoeval project/common/nanoeval/nanoeval project/common/nanoeval/nanoeval	recorder_protocol.py library_config.py json_recorder.py	42:47 (11%) 51:56 (3%) 67:72 (5%)	view
6	x 3	project/paperbench/paperbench/nano project/evmbench/evmbench/nano project/swelancer/swelancer/utils	logging.py logging.py custom_logging.py	20:30 (17%) 20:30 (17%) 32:42 (15%)	view
6	x 3	project/paperbench/paperbench/nano project/evmbench/evmbench/nano project/swelancer/swelancer/utils	logging.py logging.py custom_logging.py	35:42 (17%) 35:42 (17%) 47:54 (15%)	view
6	x 3	project/evmbench/ploit/crates/grader/src project/evmbench/ploit/crates/grader/src project/evmbench/ploit/crates/grader/src	memory.rs script.rs memory.rs	84:90 (3%) 148:154 (3%) 196:202 (3%)	view
6	x 3	project/paperbench/paperbench/nano project/evmbench/evmbench/nano project/swelancer/swelancer/utils	logging.py logging.py custom_logging.py	21:32 (17%) 21:32 (17%) 33:44 (15%)	view
6	x 3	project/paperbench/paperbench/nano project/evmbench/evmbench/nano project/swelancer/swelancer/utils	logging.py logging.py custom_logging.py	11:22 (17%) 11:22 (17%) 23:34 (15%)	view
6	x 3	project/paperbench/paperbench/nano project/evmbench/evmbench/nano project/swelancer/swelancer/utils	logging.py logging.py custom_logging.py	40:47 (17%) 40:47 (17%) 52:59 (15%)	view
6	x 3	project/evmbench/ploit/crates/grader/src project/evmbench/ploit/crates/grader/src project/evmbench/ploit/crates/grader/src	memory.rs script.rs memory.rs	83:88 (3%) 147:152 (3%) 195:200 (3%)	view
6	x 3	project/paperbench/paperbench project/swelancer/swelancer project/evmbench/evmbench	utils.py eval.py utils.py	232:239 (3%) 75:81 (1%) 85:92 (6%)	view
6	x 3	project/paperbench/paperbench/nano project/evmbench/evmbench/nano project/swelancer/swelancer/utils	logging.py logging.py custom_logging.py	37:43 (17%) 37:43 (17%) 49:55 (15%)	view
6	x 3	project/paperbench/paperbench/nano project/evmbench/evmbench/nano project/swelancer/swelancer/utils	logging.py logging.py custom_logging.py	17:24 (17%) 17:24 (17%) 29:36 (15%)	view
6	x 3	project/paperbench/paperbench/nano project/evmbench/evmbench/nano project/swelancer/swelancer/utils	logging.py logging.py custom_logging.py	34:40 (17%) 34:40 (17%) 46:52 (15%)	view
6	x 3	project/paperbench/paperbench/nano project/evmbench/evmbench/nano project/swelancer/swelancer/utils	logging.py logging.py custom_logging.py	38:44 (17%) 38:44 (17%) 50:56 (15%)	view
6	x 3	project/common/nanoeval/nanoeval project/common/nanoeval/nanoeval project/common/nanoeval/nanoeval	recorder_protocol.py library_config.py json_recorder.py	43:48 (11%) 52:57 (3%) 68:73 (5%)	view
6	x 3	project/paperbench/paperbench/nano project/evmbench/evmbench/nano project/swelancer/swelancer/utils	logging.py logging.py custom_logging.py	33:39 (17%) 33:39 (17%) 45:51 (15%)	view
6	x 3	project/paperbench/paperbench/nano project/evmbench/evmbench/nano project/swelancer/swelancer/utils	logging.py logging.py custom_logging.py	39:45 (17%) 39:45 (17%) 51:57 (15%)	view
6	x 3	project/common/nanoeval/nanoeval project/common/nanoeval/nanoeval project/common/nanoeval/nanoeval	recorder_protocol.py library_config.py json_recorder.py	53:58 (11%) 69:74 (3%) 88:93 (5%)	view
6	x 3	project/paperbench/paperbench project/swelancer/swelancer project/evmbench/evmbench	utils.py eval.py utils.py	230:237 (3%) 73:79 (1%) 83:90 (6%)	view