openai / evals Duplication

openai / evals

Duplication

Places in code with 6 or more lines that are exactly the same.

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

To learn more about duplications and techniques for eliminating duplication, Sokrates recommends the following resources:

Avoid Repetition, MartinFlower.com (IEEE Software article)
Refactoring duplicated code, sourcemaking.com
Beck Design Rules, MartinFowler.com
DRY (Don't Repeat Yourself) Principle, Wikipedia
The Cut-and-Paste Programming Software Development Anti-Pattern, sourcemaking.com
Code Smells / Duplicated Code, Jeff Atwood, codinghorror.com:

"Duplicated code is the bane of software development. Stamp out duplication whenever possible. You should always be on the lookout for more subtle cases of near-duplication, too. Don't Repeat Yourself!"

Reducing Coupling, MartinFlower.com (IEEE Software article):

"There are several ways to describe coupling, but it boils down to this: If changing one module in a program requires changing another module, then coupling exists. ... Duplication always implies coupling, because changing one piece of duplicate code implies changing the other."

Duplication Overall

13% duplication:

39,402 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
5,499 duplicated lines

2,299 duplicates

dependency graphs: 2D graph | 2D graph (with duplicates)... | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 2,299 duplicates...

Size	#	Folders	Files	Lines	Code
111	x 2	evals/elsuite/steganography/scripts/dataset evals/elsuite/text_compression/scripts/dataset	custom_datasets.py custom_datasets.py	16:152 (58%) 16:152 (100%)	view
82	x 2	evals/elsuite/multistep_...ks/webarena/browser_env evals/elsuite/multistep_...ks/webarena/browser_env	constants.py constants.py	4:85 (29%) 171:252 (29%)	view
41	x 2	evals/elsuite/hr_ml_agen...marks/vectorization/env evals/elsuite/hr_ml_agen...s/vectorization/scripts	train.py human_baseline.py	7:97 (35%) 10:100 (51%)	view
37	x 2	evals/registry/data/backgammon evals/registry/data/backgammon	generate_samples.ipynb generate_samples.ipynb	1115:1151 (2%) 1253:1289 (2%)	view
36	x 2	evals/elsuite/hr_ml_agen...hmarks/cartpole/scripts evals/elsuite/hr_ml_agen...hmarks/humanoid/scripts	grade.py grade.py	7:71 (97%) 9:73 (87%)	view
28	x 2	evals/elsuite/steganography/scripts/dataset evals/elsuite/text_compression/scripts/dataset	utils.py utils.py	4:41 (100%) 4:41 (100%)	view
27	x 2	evals/elsuite/steganography evals/elsuite/text_compression	reconstruction_metrics.py reconstruction_metrics.py	6:42 (100%) 6:42 (100%)	view
25	x 2	evals/elsuite/hr_ml_agen...arks/cartpole/baselines evals/elsuite/hr_ml_agen...benchmarks/cartpole/env	naive.py train.py	7:47 (100%) 5:45 (100%)	view
25	x 2	evals/registry/solvers evals/registry/solvers	skill_acquisition.yaml twenty_questions.yaml	79:103 (9%) 45:69 (33%)	view
25	x 2	evals/elsuite/hr_ml_agen...ipedal_walker/baselines evals/elsuite/hr_ml_agen...arks/bipedal_walker/env	naive.py train.py	7:47 (100%) 5:45 (100%)	view
25	x 2	evals/elsuite/hr_ml_agen...arks/humanoid/baselines evals/elsuite/hr_ml_agen...benchmarks/humanoid/env	naive.py train.py	8:48 (100%) 6:46 (100%)	view
25	x 2	evals/elsuite/steganography/scripts/dataset evals/elsuite/text_compression/scripts/dataset	complexity_metrics.py complexity_metrics.py	8:41 (100%) 8:41 (100%)	view
25	x 2	evals/elsuite/hr_ml_agen...enchmarks/ant/baselines evals/elsuite/hr_ml_agent_bench/benchmarks/ant/env	naive.py train.py	8:48 (100%) 6:46 (100%)	view
25	x 2	evals/elsuite/hr_ml_agen...hmarks/pusher/baselines evals/elsuite/hr_ml_agen...h/benchmarks/pusher/env	naive.py train.py	8:48 (100%) 6:46 (100%)	view
25	x 2	evals/elsuite/hr_ml_agen...rted_pendulum/baselines evals/elsuite/hr_ml_agen...s/inverted_pendulum/env	naive.py train.py	8:48 (100%) 6:46 (100%)	view
25	x 2	evals/elsuite/hr_ml_agen...nchmarks/pong/baselines evals/elsuite/hr_ml_agen...nch/benchmarks/pong/env	naive.py train.py	8:48 (100%) 6:46 (100%)	view
24	x 2	evals/registry/solvers evals/registry/solvers	defaults.yaml theory_of_mind.yaml	277:300 (8%) 253:276 (6%)	view
24	x 2	evals/registry/solvers evals/registry/solvers	theory_of_mind.yaml theory_of_mind.yaml	182:205 (6%) 338:361 (6%)	view
23	x 2	evals/registry/solvers evals/registry/solvers	theory_of_mind.yaml theory_of_mind.yaml	111:133 (5%) 253:275 (5%)	view
23	x 2	evals/registry/solvers evals/registry/solvers	theory_of_mind.yaml theory_of_mind.yaml	44:66 (5%) 338:360 (5%)	view
23	x 2	evals/registry/solvers evals/registry/solvers	theory_of_mind.yaml theory_of_mind.yaml	44:66 (5%) 182:204 (5%)	view
23	x 2	evals/registry/solvers evals/registry/solvers	defaults.yaml theory_of_mind.yaml	277:299 (7%) 111:133 (5%)	view
22	x 2	evals/registry/data/backgammon evals/registry/data/backgammon	generate_samples.ipynb generate_samples.ipynb	316:337 (1%) 1115:1136 (1%)	view
22	x 2	evals/registry/data/backgammon evals/registry/data/backgammon	generate_samples.ipynb generate_samples.ipynb	316:337 (1%) 1253:1274 (1%)	view
22	x 2	evals/elsuite/hr_ml_agen...hmarks/cartpole/scripts evals/elsuite/hr_ml_agen...benchmarks/pong/scripts	grade.py grade.py	32:71 (59%) 34:73 (53%)	view
22	x 2	evals/elsuite/hr_ml_agen...hmarks/humanoid/scripts evals/elsuite/hr_ml_agen...nchmarks/pusher/scripts	grade.py grade.py	34:73 (53%) 34:73 (53%)	view
22	x 2	evals/registry/solvers evals/registry/solvers	defaults.yaml theory_of_mind.yaml	236:257 (7%) 111:132 (5%)	view
22	x 2	evals/registry/solvers evals/registry/solvers	defaults.yaml theory_of_mind.yaml	236:257 (7%) 253:274 (5%)	view
22	x 2	evals/elsuite/hr_ml_agen...hmarks/cartpole/scripts evals/elsuite/hr_ml_agen...nchmarks/pusher/scripts	grade.py grade.py	32:71 (59%) 34:73 (53%)	view
22	x 2	evals/elsuite/hr_ml_agen...hmarks/humanoid/scripts evals/elsuite/hr_ml_agen...benchmarks/pong/scripts	grade.py grade.py	34:73 (53%) 34:73 (53%)	view
22	x 2	evals/elsuite/hr_ml_agen...benchmarks/pong/scripts evals/elsuite/hr_ml_agen...nchmarks/pusher/scripts	grade.py grade.py	34:73 (53%) 34:73 (53%)	view
22	x 2	evals/registry/solvers evals/registry/solvers	defaults.yaml defaults.yaml	236:257 (7%) 277:298 (7%)	view
22	x 2	evals/registry/solvers evals/registry/solvers	already_said_that.yaml defaults.yaml	58:79 (29%) 238:259 (7%)	view
21	x 2	evals/elsuite/cant_do_that_anymore/scripts evals/elsuite/cant_do_that_anymore/scripts	dataset_creation.py diagonal_dataset_creation.py	212:239 (9%) 247:274 (10%)	view
20	x 2	evals/registry/solvers evals/registry/solvers	already_said_that.yaml theory_of_mind.yaml	58:77 (26%) 255:274 (5%)	view
20	x 2	evals/registry/solvers evals/registry/solvers	already_said_that.yaml theory_of_mind.yaml	58:77 (26%) 113:132 (5%)	view
20	x 2	evals/registry/solvers evals/registry/solvers	already_said_that.yaml defaults.yaml	58:77 (26%) 279:298 (6%)	view
19	x 2	evals/registry/solvers evals/registry/solvers	skill_acquisition.yaml twenty_questions.yaml	24:42 (7%) 24:42 (25%)	view
18	x 2	evals/registry/solvers evals/registry/solvers	theory_of_mind.yaml theory_of_mind.yaml	219:236 (4%) 375:392 (4%)	view
18	x 2	evals/elsuite/hr_ml_agen...benchmarks/humanoid/env evals/elsuite/hr_ml_agen...s/inverted_pendulum/env	train.py train.py	18:46 (72%) 18:46 (72%)	view
18	x 2	evals/elsuite/hr_ml_agen...benchmarks/humanoid/env evals/elsuite/hr_ml_agen...rted_pendulum/baselines	train.py naive.py	18:46 (72%) 20:48 (72%)	view
18	x 2	evals/registry/solvers evals/registry/solvers	theory_of_mind.yaml theory_of_mind.yaml	148:165 (4%) 304:321 (4%)	view
18	x 2	evals/elsuite/hr_ml_agen...arks/humanoid/baselines evals/elsuite/hr_ml_agen...rted_pendulum/baselines	naive.py naive.py	20:48 (72%) 20:48 (72%)	view
18	x 2	evals/elsuite/hr_ml_agen...arks/humanoid/baselines evals/elsuite/hr_ml_agen...s/inverted_pendulum/env	naive.py train.py	20:48 (72%) 18:46 (72%)	view
18	x 2	evals/registry/solvers evals/registry/solvers	defaults.yaml theory_of_mind.yaml	58:75 (6%) 148:165 (4%)	view
18	x 2	evals/registry/solvers evals/registry/solvers	defaults.yaml theory_of_mind.yaml	58:75 (6%) 304:321 (4%)	view
18	x 2	evals/registry/solvers evals/registry/solvers	defaults.yaml theory_of_mind.yaml	127:144 (6%) 219:236 (4%)	view
18	x 2	evals/registry/solvers evals/registry/solvers	defaults.yaml theory_of_mind.yaml	127:144 (6%) 375:392 (4%)	view
17	x 2	evals/elsuite/hr_ml_agen.../benchmarks/ant/scripts evals/elsuite/hr_ml_agen.../bipedal_walker/scripts	grade.py grade.py	9:40 (43%) 7:38 (60%)	view
17	x 2	evals/elsuite/already_said_that/scripts evals/elsuite/track_the_stat/scripts	make_plots.py make_plots.py	309:328 (6%) 277:296 (7%)	view

Most Frequent Duplicates

The list of 50 most frequently found duplicates.

Size	#	Folders	Files	Lines	Code
6	x 38	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers ...	defaults.yaml error_recovery.yaml theory_of_mind.yaml function_deduction.yaml twenty_questions.yaml track_the_stat.yaml bluff.yaml already_said_that.yaml self_prompting.yaml skill_acquisition.yaml ...	224:229 (2%) 15:20 (18%) 32:37 (1%) 154:159 (3%) 48:53 (8%) 62:67 (8%) 68:73 (7%) 59:64 (8%) 18:23 (6%) 82:87 (2%) ...	view
6	x 28	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers ...	defaults.yaml error_recovery.yaml theory_of_mind.yaml function_deduction.yaml twenty_questions.yaml track_the_stat.yaml bluff.yaml already_said_that.yaml self_prompting.yaml skill_acquisition.yaml ...	225:230 (2%) 16:21 (18%) 100:105 (1%) 140:145 (3%) 49:54 (8%) 63:68 (8%) 69:74 (7%) 60:65 (8%) 28:33 (6%) 83:88 (2%) ...	view
6	x 28	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers ...	defaults.yaml error_recovery.yaml theory_of_mind.yaml function_deduction.yaml twenty_questions.yaml track_the_stat.yaml bluff.yaml already_said_that.yaml skill_acquisition.yaml skill_acquisition.yaml ...	226:231 (2%) 17:22 (18%) 101:106 (1%) 141:146 (3%) 50:55 (8%) 64:69 (8%) 27:32 (7%) 61:66 (8%) 84:89 (2%) 96:101 (2%) ...	view
6	x 26	evals/elsuite/bugged_tools evals/elsuite/bugged_tools evals/elsuite/bugged_tools evals/elsuite/bugged_tools evals/elsuite/bugged_tools evals/elsuite/bugged_tools evals/elsuite/bugged_tools evals/elsuite/bugged_tools evals/elsuite/bugged_tools evals/elsuite/bugged_tools ...	tools.py tools.py tools.py tools.py tools.py tools.py tools.py tools.py tools.py tools.py ...	58:64 (1%) 73:79 (1%) 88:94 (1%) 122:128 (1%) 146:152 (1%) 165:171 (1%) 188:194 (1%) 203:209 (1%) 232:238 (1%) 251:257 (1%) ...	view
6	x 19	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers ...	defaults.yaml error_recovery.yaml theory_of_mind.yaml function_deduction.yaml twenty_questions.yaml track_the_stat.yaml already_said_that.yaml cant_do_that_anymore.yaml skill_acquisition.yaml skill_acquisition.yaml ...	227:232 (2%) 18:23 (18%) 117:122 (1%) 142:147 (3%) 51:56 (8%) 65:70 (8%) 62:67 (8%) 11:16 (37%) 85:90 (2%) 97:102 (2%) ...	view
6	x 18	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers ...	defaults.yaml theory_of_mind.yaml hr-ml-agent-bench.yaml skill_acquisition.yaml twenty_questions.yaml skill_acquisition.yaml skill_acquisition.yaml twenty_questions.yaml defaults.yaml defaults.yaml ...	26:31 (2%) 12:17 (1%) 23:28 (16%) 3:8 (2%) 3:8 (8%) 24:29 (2%) 58:63 (2%) 24:29 (8%) 58:63 (2%) 95:100 (2%) ...	view
6	x 17	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers ...	theory_of_mind.yaml function_deduction.yaml defaults.yaml already_said_that.yaml defaults.yaml defaults.yaml defaults.yaml defaults.yaml defaults.yaml theory_of_mind.yaml ...	19:24 (1%) 72:77 (3%) 33:38 (2%) 21:26 (8%) 65:70 (2%) 102:107 (2%) 134:139 (2%) 171:176 (2%) 203:208 (2%) 86:91 (1%) ...	view
6	x 17	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers ...	theory_of_mind.yaml function_deduction.yaml defaults.yaml already_said_that.yaml defaults.yaml defaults.yaml defaults.yaml defaults.yaml defaults.yaml theory_of_mind.yaml ...	20:25 (1%) 73:78 (3%) 34:39 (2%) 22:27 (8%) 66:71 (2%) 103:108 (2%) 135:140 (2%) 172:177 (2%) 204:209 (2%) 87:92 (1%) ...	view
6	x 17	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers ...	defaults.yaml error_recovery.yaml theory_of_mind.yaml function_deduction.yaml twenty_questions.yaml track_the_stat.yaml already_said_that.yaml skill_acquisition.yaml skill_acquisition.yaml skill_acquisition.yaml ...	228:233 (2%) 19:24 (18%) 118:123 (1%) 158:163 (3%) 52:57 (8%) 66:71 (8%) 63:68 (8%) 86:91 (2%) 98:103 (2%) 187:192 (2%) ...	view
6	x 16	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers ...	twenty_questions.yaml track_the_stat.yaml defaults.yaml theory_of_mind.yaml already_said_that.yaml skill_acquisition.yaml skill_acquisition.yaml skill_acquisition.yaml twenty_questions.yaml defaults.yaml ...	6:11 (8%) 38:43 (8%) 17:22 (2%) 15:20 (1%) 17:22 (8%) 6:11 (2%) 15:20 (2%) 141:146 (2%) 15:20 (8%) 29:34 (2%) ...	view
6	x 16	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers ...	twenty_questions.yaml track_the_stat.yaml defaults.yaml theory_of_mind.yaml already_said_that.yaml skill_acquisition.yaml skill_acquisition.yaml skill_acquisition.yaml twenty_questions.yaml defaults.yaml ...	7:12 (8%) 39:44 (8%) 18:23 (2%) 16:21 (1%) 18:23 (8%) 7:12 (2%) 16:21 (2%) 142:147 (2%) 16:21 (8%) 30:35 (2%) ...	view
6	x 15	evals/elsuite/hr_ml_agen...arks/bipedal_walker/env evals/elsuite/hr_ml_agen...benchmarks/humanoid/env evals/elsuite/hr_ml_agen...benchmarks/cartpole/env evals/elsuite/hr_ml_agen...enchmarks/ant/baselines evals/elsuite/hr_ml_agen...nch/benchmarks/pong/env evals/elsuite/hr_ml_agent_bench/benchmarks/ant/env evals/elsuite/hr_ml_agen...hmarks/pusher/baselines evals/elsuite/hr_ml_agen...ipedal_walker/baselines evals/elsuite/hr_ml_agen...arks/cartpole/baselines evals/elsuite/hr_ml_agen...h/benchmarks/pusher/env ...	train.py train.py train.py naive.py train.py train.py naive.py naive.py naive.py train.py ...	30:39 (24%) 31:40 (24%) 30:39 (24%) 33:42 (24%) 31:40 (24%) 31:40 (24%) 33:42 (24%) 32:41 (24%) 32:41 (24%) 31:40 (24%) ...	view
6	x 15	evals/elsuite/hr_ml_agen...arks/bipedal_walker/env evals/elsuite/hr_ml_agen...benchmarks/humanoid/env evals/elsuite/hr_ml_agen...benchmarks/cartpole/env evals/elsuite/hr_ml_agen...enchmarks/ant/baselines evals/elsuite/hr_ml_agen...nch/benchmarks/pong/env evals/elsuite/hr_ml_agent_bench/benchmarks/ant/env evals/elsuite/hr_ml_agen...hmarks/pusher/baselines evals/elsuite/hr_ml_agen...ipedal_walker/baselines evals/elsuite/hr_ml_agen...arks/cartpole/baselines evals/elsuite/hr_ml_agen...h/benchmarks/pusher/env ...	train.py train.py train.py naive.py train.py train.py naive.py naive.py naive.py train.py ...	35:43 (24%) 36:44 (24%) 35:43 (24%) 38:46 (24%) 36:44 (24%) 36:44 (24%) 38:46 (24%) 37:45 (24%) 37:45 (24%) 36:44 (24%) ...	view
6	x 15	evals/elsuite/hr_ml_agen...arks/bipedal_walker/env evals/elsuite/hr_ml_agen...benchmarks/humanoid/env evals/elsuite/hr_ml_agen...benchmarks/cartpole/env evals/elsuite/hr_ml_agen...enchmarks/ant/baselines evals/elsuite/hr_ml_agen...nch/benchmarks/pong/env evals/elsuite/hr_ml_agent_bench/benchmarks/ant/env evals/elsuite/hr_ml_agen...hmarks/pusher/baselines evals/elsuite/hr_ml_agen...ipedal_walker/baselines evals/elsuite/hr_ml_agen...arks/cartpole/baselines evals/elsuite/hr_ml_agen...h/benchmarks/pusher/env ...	train.py train.py train.py naive.py train.py train.py naive.py naive.py naive.py train.py ...	29:37 (24%) 30:38 (24%) 29:37 (24%) 32:40 (24%) 30:38 (24%) 30:38 (24%) 32:40 (24%) 31:39 (24%) 31:39 (24%) 30:38 (24%) ...	view
6	x 15	evals/elsuite/hr_ml_agen...arks/bipedal_walker/env evals/elsuite/hr_ml_agen...benchmarks/humanoid/env evals/elsuite/hr_ml_agen...benchmarks/cartpole/env evals/elsuite/hr_ml_agen...enchmarks/ant/baselines evals/elsuite/hr_ml_agen...nch/benchmarks/pong/env evals/elsuite/hr_ml_agent_bench/benchmarks/ant/env evals/elsuite/hr_ml_agen...hmarks/pusher/baselines evals/elsuite/hr_ml_agen...ipedal_walker/baselines evals/elsuite/hr_ml_agen...arks/cartpole/baselines evals/elsuite/hr_ml_agen...h/benchmarks/pusher/env ...	train.py train.py train.py naive.py train.py train.py naive.py naive.py naive.py train.py ...	32:40 (24%) 33:41 (24%) 32:40 (24%) 35:43 (24%) 33:41 (24%) 33:41 (24%) 35:43 (24%) 34:42 (24%) 34:42 (24%) 33:41 (24%) ...	view
6	x 15	evals/elsuite/hr_ml_agen...arks/bipedal_walker/env evals/elsuite/hr_ml_agen...benchmarks/humanoid/env evals/elsuite/hr_ml_agen...benchmarks/cartpole/env evals/elsuite/hr_ml_agen...enchmarks/ant/baselines evals/elsuite/hr_ml_agen...nch/benchmarks/pong/env evals/elsuite/hr_ml_agent_bench/benchmarks/ant/env evals/elsuite/hr_ml_agen...hmarks/pusher/baselines evals/elsuite/hr_ml_agen...ipedal_walker/baselines evals/elsuite/hr_ml_agen...arks/cartpole/baselines evals/elsuite/hr_ml_agen...h/benchmarks/pusher/env ...	train.py train.py train.py naive.py train.py train.py naive.py naive.py naive.py train.py ...	33:42 (24%) 34:43 (24%) 33:42 (24%) 36:45 (24%) 34:43 (24%) 34:43 (24%) 36:45 (24%) 35:44 (24%) 35:44 (24%) 34:43 (24%) ...	view
6	x 15	evals/elsuite/hr_ml_agen...arks/bipedal_walker/env evals/elsuite/hr_ml_agen...benchmarks/humanoid/env evals/elsuite/hr_ml_agen...benchmarks/cartpole/env evals/elsuite/hr_ml_agen...enchmarks/ant/baselines evals/elsuite/hr_ml_agen...nch/benchmarks/pong/env evals/elsuite/hr_ml_agent_bench/benchmarks/ant/env evals/elsuite/hr_ml_agen...hmarks/pusher/baselines evals/elsuite/hr_ml_agen...ipedal_walker/baselines evals/elsuite/hr_ml_agen...arks/cartpole/baselines evals/elsuite/hr_ml_agen...h/benchmarks/pusher/env ...	train.py train.py train.py naive.py train.py train.py naive.py naive.py naive.py train.py ...	28:35 (24%) 29:36 (24%) 28:35 (24%) 31:38 (24%) 29:36 (24%) 29:36 (24%) 31:38 (24%) 30:37 (24%) 30:37 (24%) 29:36 (24%) ...	view
6	x 14	evals/elsuite/hr_ml_agen...arks/bipedal_walker/env evals/elsuite/hr_ml_agen...benchmarks/humanoid/env evals/elsuite/hr_ml_agen...benchmarks/cartpole/env evals/elsuite/hr_ml_agen...enchmarks/ant/baselines evals/elsuite/hr_ml_agen...nch/benchmarks/pong/env evals/elsuite/hr_ml_agent_bench/benchmarks/ant/env evals/elsuite/hr_ml_agen...hmarks/pusher/baselines evals/elsuite/hr_ml_agen...ipedal_walker/baselines evals/elsuite/hr_ml_agen...arks/cartpole/baselines evals/elsuite/hr_ml_agen...h/benchmarks/pusher/env ...	train.py train.py train.py naive.py train.py train.py naive.py naive.py naive.py train.py ...	5:13 (24%) 6:14 (24%) 5:13 (24%) 8:16 (24%) 6:14 (24%) 6:14 (24%) 8:16 (24%) 7:15 (24%) 7:15 (24%) 6:14 (24%) ...	view
6	x 14	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers ...	twenty_questions.yaml track_the_stat.yaml already_said_that.yaml skill_acquisition.yaml defaults.yaml skill_acquisition.yaml skill_acquisition.yaml skill_acquisition.yaml twenty_questions.yaml defaults.yaml ...	27:32 (8%) 50:55 (8%) 38:43 (8%) 27:32 (2%) 155:160 (2%) 36:41 (2%) 124:129 (2%) 155:160 (2%) 36:41 (8%) 167:172 (2%) ...	view
6	x 14	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers ...	twenty_questions.yaml track_the_stat.yaml already_said_that.yaml skill_acquisition.yaml defaults.yaml skill_acquisition.yaml skill_acquisition.yaml skill_acquisition.yaml twenty_questions.yaml defaults.yaml ...	28:33 (8%) 51:56 (8%) 39:44 (8%) 28:33 (2%) 156:161 (2%) 37:42 (2%) 125:130 (2%) 156:161 (2%) 37:42 (8%) 168:173 (2%) ...	view
6	x 14	evals/elsuite/hr_ml_agen...arks/bipedal_walker/env evals/elsuite/hr_ml_agen...benchmarks/humanoid/env evals/elsuite/hr_ml_agen...benchmarks/cartpole/env evals/elsuite/hr_ml_agen...enchmarks/ant/baselines evals/elsuite/hr_ml_agen...hmarks/pusher/baselines evals/elsuite/hr_ml_agen...ipedal_walker/baselines evals/elsuite/hr_ml_agen...arks/cartpole/baselines evals/elsuite/hr_ml_agen...nch/benchmarks/pong/env evals/elsuite/hr_ml_agent_bench/benchmarks/ant/env evals/elsuite/hr_ml_agen...h/benchmarks/pusher/env ...	train.py train.py train.py naive.py naive.py naive.py naive.py train.py train.py train.py ...	37:45 (24%) 38:46 (24%) 37:45 (24%) 40:48 (24%) 40:48 (24%) 39:47 (24%) 39:47 (24%) 38:46 (24%) 38:46 (24%) 38:46 (24%) ...	view
6	x 12	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers ...	skill_acquisition.yaml make-me-pay.yaml defaults.yaml theory_of_mind.yaml skill_acquisition.yaml defaults.yaml defaults.yaml defaults.yaml theory_of_mind.yaml theory_of_mind.yaml ...	61:66 (2%) 64:69 (5%) 86:91 (2%) 82:87 (1%) 70:75 (2%) 98:103 (2%) 106:111 (2%) 130:135 (2%) 222:227 (1%) 283:288 (1%) ...	view
6	x 11	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers ...	theory_of_mind.yaml function_deduction.yaml skill_acquisition.yaml already_said_that.yaml twenty_questions.yaml defaults.yaml defaults.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml ...	57:62 (1%) 165:170 (3%) 93:98 (2%) 69:74 (8%) 59:64 (8%) 249:254 (2%) 290:295 (2%) 124:129 (1%) 195:200 (1%) 266:271 (1%) ...	view
6	x 11	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers ...	theory_of_mind.yaml function_deduction.yaml skill_acquisition.yaml already_said_that.yaml twenty_questions.yaml defaults.yaml defaults.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml ...	46:51 (1%) 153:158 (3%) 81:86 (2%) 58:63 (8%) 47:52 (8%) 238:243 (2%) 279:284 (2%) 113:118 (1%) 184:189 (1%) 255:260 (1%) ...	view
6	x 11	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers ...	theory_of_mind.yaml bluff.yaml self_prompting.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml ...	33:38 (1%) 81:86 (7%) 19:24 (6%) 48:53 (1%) 59:64 (1%) 170:175 (1%) 186:191 (1%) 197:202 (1%) 326:331 (1%) 342:347 (1%) ...	view
6	x 11	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers ...	theory_of_mind.yaml bluff.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml ...	34:39 (1%) 41:46 (7%) 49:54 (1%) 60:65 (1%) 171:176 (1%) 187:192 (1%) 198:203 (1%) 327:332 (1%) 343:348 (1%) 354:359 (1%) ...	view
6	x 10	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers	theory_of_mind.yaml function_deduction.yaml twenty_questions.yaml defaults.yaml skill_acquisition.yaml defaults.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml	45:50 (1%) 152:157 (3%) 46:51 (8%) 237:242 (2%) 80:85 (2%) 278:283 (2%) 112:117 (1%) 183:188 (1%) 254:259 (1%) 339:344 (1%)	view
6	x 10	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers	theory_of_mind.yaml function_deduction.yaml bluff.yaml defaults.yaml defaults.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml bluff.yaml	102:107 (1%) 169:174 (3%) 28:33 (7%) 267:272 (2%) 294:299 (2%) 128:133 (1%) 243:248 (1%) 270:275 (1%) 399:404 (1%) 71:76 (7%)	view
6	x 9	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers	theory_of_mind.yaml bluff.yaml defaults.yaml defaults.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml	70:75 (1%) 52:57 (7%) 117:122 (2%) 138:143 (2%) 90:95 (1%) 209:214 (1%) 230:235 (1%) 365:370 (1%) 386:391 (1%)	view
6	x 9	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers	defaults.yaml theory_of_mind.yaml skill_acquisition.yaml twenty_questions.yaml defaults.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml	236:241 (2%) 44:49 (1%) 79:84 (2%) 45:50 (8%) 277:282 (2%) 111:116 (1%) 182:187 (1%) 253:258 (1%) 338:343 (1%)	view
6	x 9	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers	defaults.yaml theory_of_mind.yaml skill_acquisition.yaml skill_acquisition.yaml defaults.yaml defaults.yaml defaults.yaml theory_of_mind.yaml theory_of_mind.yaml	87:92 (2%) 83:88 (1%) 62:67 (2%) 71:76 (2%) 99:104 (2%) 107:112 (2%) 131:136 (2%) 223:228 (1%) 379:384 (1%)	view
6	x 9	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers	skill_acquisition.yaml already_said_that.yaml defaults.yaml theory_of_mind.yaml twenty_questions.yaml defaults.yaml defaults.yaml theory_of_mind.yaml theory_of_mind.yaml	14:19 (2%) 24:29 (8%) 36:41 (2%) 22:27 (1%) 14:19 (8%) 68:73 (2%) 326:331 (2%) 158:163 (1%) 314:319 (1%)	view
6	x 8	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers	defaults.yaml theory_of_mind.yaml defaults.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml	48:53 (2%) 3:8 (1%) 69:74 (2%) 23:28 (1%) 138:143 (1%) 159:164 (1%) 294:299 (1%) 315:320 (1%)	view
6	x 8	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers	defaults.yaml theory_of_mind.yaml already_said_that.yaml defaults.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml	248:253 (2%) 56:61 (1%) 68:73 (8%) 289:294 (2%) 123:128 (1%) 194:199 (1%) 265:270 (1%) 350:355 (1%)	view
6	x 8	evals/elsuite/hr_ml_agen...s/vectorization/scripts evals/elsuite/hr_ml_agen...verted_pendulum/scripts evals/elsuite/hr_ml_agen...hmarks/cartpole/scripts evals/elsuite/hr_ml_agen...hmarks/humanoid/scripts evals/elsuite/hr_ml_agen...nchmarks/pusher/scripts evals/elsuite/hr_ml_agen.../bipedal_walker/scripts evals/elsuite/hr_ml_agen...benchmarks/pong/scripts evals/elsuite/hr_ml_agen.../benchmarks/ant/scripts	grade.py grade.py grade.py grade.py grade.py grade.py grade.py grade.py	13:21 (10%) 14:22 (24%) 14:22 (16%) 16:24 (14%) 16:24 (14%) 14:22 (21%) 14:22 (14%) 16:24 (15%)	view
6	x 8	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers	defaults.yaml theory_of_mind.yaml already_said_that.yaml defaults.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml	246:251 (2%) 54:59 (1%) 66:71 (8%) 287:292 (2%) 121:126 (1%) 192:197 (1%) 263:268 (1%) 348:353 (1%)	view
6	x 8	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers	defaults.yaml theory_of_mind.yaml skill_acquisition.yaml already_said_that.yaml twenty_questions.yaml defaults.yaml theory_of_mind.yaml theory_of_mind.yaml	28:33 (2%) 14:19 (1%) 5:10 (2%) 16:21 (8%) 5:10 (8%) 60:65 (2%) 150:155 (1%) 306:311 (1%)	view
6	x 8	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers	theory_of_mind.yaml bluff.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml bluff.yaml	35:40 (1%) 42:47 (7%) 61:66 (1%) 172:177 (1%) 199:204 (1%) 328:333 (1%) 355:360 (1%) 83:88 (7%)	view
6	x 8	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers	defaults.yaml theory_of_mind.yaml already_said_that.yaml defaults.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml theory_of_mind.yaml	247:252 (2%) 55:60 (1%) 67:72 (8%) 288:293 (2%) 122:127 (1%) 193:198 (1%) 264:269 (1%) 349:354 (1%)	view
6	x 7	evals/elsuite/hr_ml_agen...hmarks/cartpole/scripts evals/elsuite/hr_ml_agen...hmarks/humanoid/scripts evals/elsuite/hr_ml_agen...nchmarks/pusher/scripts evals/elsuite/hr_ml_agen.../bipedal_walker/scripts evals/elsuite/hr_ml_agen...verted_pendulum/scripts evals/elsuite/hr_ml_agen...benchmarks/pong/scripts evals/elsuite/hr_ml_agen.../benchmarks/ant/scripts	grade.py grade.py grade.py grade.py grade.py grade.py grade.py	19:25 (16%) 21:27 (14%) 21:27 (14%) 19:25 (21%) 19:25 (24%) 19:25 (14%) 21:27 (15%)	view
6	x 7	evals/elsuite/hr_ml_agen...hmarks/cartpole/scripts evals/elsuite/hr_ml_agen...hmarks/humanoid/scripts evals/elsuite/hr_ml_agen...nchmarks/pusher/scripts evals/elsuite/hr_ml_agen.../bipedal_walker/scripts evals/elsuite/hr_ml_agen...verted_pendulum/scripts evals/elsuite/hr_ml_agen...benchmarks/pong/scripts evals/elsuite/hr_ml_agen.../benchmarks/ant/scripts	grade.py grade.py grade.py grade.py grade.py grade.py grade.py	16:23 (16%) 18:25 (14%) 18:25 (14%) 16:23 (21%) 16:23 (24%) 16:23 (14%) 18:25 (15%)	view
6	x 7	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers	skill_acquisition.yaml together.yaml function_deduction.yaml track_the_stat.yaml skill_acquisition.yaml together.yaml together.yaml	252:257 (2%) 15:20 (7%) 27:32 (3%) 15:20 (8%) 261:266 (2%) 59:64 (7%) 67:72 (7%)	view
6	x 7	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers	skill_acquisition.yaml make-me-pay.yaml defaults.yaml theory_of_mind.yaml defaults.yaml theory_of_mind.yaml theory_of_mind.yaml	69:74 (2%) 71:76 (5%) 105:110 (2%) 89:94 (1%) 137:142 (2%) 229:234 (1%) 385:390 (1%)	view
6	x 7	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers	skill_acquisition.yaml together.yaml function_deduction.yaml track_the_stat.yaml skill_acquisition.yaml together.yaml together.yaml	251:256 (2%) 14:19 (7%) 26:31 (3%) 14:19 (8%) 260:265 (2%) 58:63 (7%) 66:71 (7%)	view
6	x 7	evals/elsuite/hr_ml_agen...hmarks/cartpole/scripts evals/elsuite/hr_ml_agen...hmarks/humanoid/scripts evals/elsuite/hr_ml_agen...nchmarks/pusher/scripts evals/elsuite/hr_ml_agen.../bipedal_walker/scripts evals/elsuite/hr_ml_agen...verted_pendulum/scripts evals/elsuite/hr_ml_agen...benchmarks/pong/scripts evals/elsuite/hr_ml_agen.../benchmarks/ant/scripts	grade.py grade.py grade.py grade.py grade.py grade.py grade.py	13:21 (16%) 15:23 (14%) 15:23 (14%) 13:21 (21%) 13:21 (24%) 13:21 (14%) 15:23 (15%)	view
6	x 7	evals/elsuite/hr_ml_agen...hmarks/cartpole/scripts evals/elsuite/hr_ml_agen...hmarks/humanoid/scripts evals/elsuite/hr_ml_agen...nchmarks/pusher/scripts evals/elsuite/hr_ml_agen.../bipedal_walker/scripts evals/elsuite/hr_ml_agen...verted_pendulum/scripts evals/elsuite/hr_ml_agen...benchmarks/pong/scripts evals/elsuite/hr_ml_agen.../benchmarks/ant/scripts	grade.py grade.py grade.py grade.py grade.py grade.py grade.py	18:24 (16%) 20:26 (14%) 20:26 (14%) 18:24 (21%) 18:24 (24%) 18:24 (14%) 20:26 (15%)	view
6	x 7	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers	skill_acquisition.yaml together.yaml function_deduction.yaml track_the_stat.yaml skill_acquisition.yaml together.yaml together.yaml	272:277 (2%) 24:29 (7%) 46:51 (3%) 26:31 (8%) 281:286 (2%) 78:83 (7%) 86:91 (7%)	view
6	x 7	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers	skill_acquisition.yaml already_said_that.yaml twenty_questions.yaml defaults.yaml skill_acquisition.yaml defaults.yaml defaults.yaml	35:40 (2%) 45:50 (8%) 35:40 (8%) 174:179 (2%) 123:128 (2%) 206:211 (2%) 353:358 (2%)	view
6	x 7	evals/elsuite/hr_ml_agen...hmarks/cartpole/scripts evals/elsuite/hr_ml_agen...hmarks/humanoid/scripts evals/elsuite/hr_ml_agen...nchmarks/pusher/scripts evals/elsuite/hr_ml_agen.../bipedal_walker/scripts evals/elsuite/hr_ml_agen...verted_pendulum/scripts evals/elsuite/hr_ml_agen...benchmarks/pong/scripts evals/elsuite/hr_ml_agen.../benchmarks/ant/scripts	grade.py grade.py grade.py grade.py grade.py grade.py grade.py	58:68 (16%) 60:70 (14%) 60:70 (14%) 43:53 (21%) 43:53 (24%) 60:70 (14%) 56:66 (15%)	view
6	x 7	evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers evals/registry/solvers	skill_acquisition.yaml together.yaml function_deduction.yaml track_the_stat.yaml skill_acquisition.yaml together.yaml together.yaml	273:278 (2%) 25:30 (7%) 47:52 (3%) 27:32 (8%) 282:287 (2%) 79:84 (7%) 87:92 (7%)	view

Duplicated Units

The list of top 5 duplicated units.

See data for all 5 unit duplicates...

Size	#	Folders	Files	Lines	Code
35	x 2	evals/elsuite/steganography/scripts/dataset evals/elsuite/text_compression/scripts/dataset	utils.py utils.py	0:0 0:0	view
27	x 2	evals/elsuite/steganography/scripts/dataset evals/elsuite/text_compression/scripts/dataset	custom_datasets.py custom_datasets.py	0:0 0:0	view
15	x 2	evals/elsuite/steganography evals/elsuite/text_compression	reconstruction_metrics.py reconstruction_metrics.py	0:0 0:0	view
17	x 3	evals/elsuite/hr_ml_agen...hmarks/cartpole/scripts evals/elsuite/hr_ml_agen...hmarks/humanoid/scripts evals/elsuite/hr_ml_agen...verted_pendulum/scripts	grade.py grade.py grade.py	0:0 0:0 0:0	view
13	x 2	evals/elsuite/steganography/scripts/dataset evals/elsuite/text_compression/scripts/dataset	csv2jsonl.py csv2jsonl.py	0:0 0:0	view