huggingface / alpaca_eval Duplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

18% duplication:

5,948 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
1,103 duplicated lines

666 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 666 duplicates...

Size	#	Folders	Files	Lines	Code
28	x 2	src/alpaca_eval src/alpaca_eval	plotting.py plotting.py	185:220 (6%) 219:254 (6%)	view
21	x 2	src/alpaca_eval/evaluato..._eval_cot_gpt4_turbo_fn src/alpaca_eval/evaluato...paca_eval_gpt4_turbo_fn	configs.yaml configs.yaml	19:39 (51%) 16:36 (58%)	view
15	x 2	src/alpaca_eval/evaluato...igs/alpaca_eval_gpt4_fn src/alpaca_eval/evaluato...paca_eval_gpt4_turbo_fn	configs.yaml configs.yaml	19:33 (42%) 19:33 (41%)	view
15	x 2	src/alpaca_eval/evaluato..._eval_cot_gpt4_turbo_fn src/alpaca_eval/evaluato...igs/alpaca_eval_gpt4_fn	configs.yaml configs.yaml	22:36 (36%) 19:33 (42%)	view
13	x 2	src/alpaca_eval/models_configs/Yi-34B-Chat src/alpaca_eval/models_configs/pairrm-Yi-34B-Chat	configs.yaml configs.yaml	2:14 (81%) 2:14 (76%)	view
13	x 2	src/alpaca_eval/decoders src/alpaca_eval/decoders	huggingface_api.py replicate.py	64:79 (20%) 55:70 (29%)	view
12	x 2	src/alpaca_eval/evaluato...aca_eval_clf_gpt4_turbo src/alpaca_eval/evaluato..._alpaca_eval_gpt4_turbo	configs.yaml configs.yaml	2:13 (75%) 2:13 (75%)	view
12	x 2	src/alpaca_eval/evaluato...eval_clf_cot_gpt4_turbo src/alpaca_eval/evaluato...aca_eval_cot_gpt4_turbo	configs.yaml configs.yaml	2:13 (63%) 2:13 (70%)	view
12	x 2	src/alpaca_eval/evaluators_configs/gpt4_turbo_clf src/alpaca_eval/evaluato...figs/gpt4_turbo_logprob	configs.yaml configs.yaml	2:13 (75%) 2:13 (75%)	view
12	x 2	src/alpaca_eval/evaluators_configs/alpaca_farm src/alpaca_eval/evaluators_configs/alpaca_farm	configs.yaml configs.yaml	102:113 (7%) 117:128 (7%)	view
12	x 2	src/alpaca_eval/evaluato...figs/gpt4_turbo_cot_clf src/alpaca_eval/evaluato.../gpt4_turbo_cot_logprob	configs.yaml configs.yaml	2:13 (70%) 2:13 (70%)	view
11	x 2	src/alpaca_eval/models_configs/openchat-v2-13b src/alpaca_eval/models_configs/openchat-v2-w-13b	configs.yaml configs.yaml	2:15 (78%) 2:15 (78%)	view
11	x 2	src/alpaca_eval src/alpaca_eval	plotting.py plotting.py	199:212 (2%) 267:280 (2%)	view
11	x 2	src/alpaca_eval/models_configs/pairrm-tulu-2-13b src/alpaca_eval/models_configs/tulu-2-dpo-13b	configs.yaml configs.yaml	2:12 (68%) 2:12 (73%)	view
11	x 2	src/alpaca_eval src/alpaca_eval	plotting.py plotting.py	233:246 (2%) 267:280 (2%)	view
11	x 2	src/alpaca_eval/models_configs/pairrm-tulu-2-70b src/alpaca_eval/models_configs/tulu-2-dpo-70b	configs.yaml configs.yaml	2:12 (68%) 2:12 (73%)	view
10	x 2	src/alpaca_eval/evaluators_configs/alpaca_farm src/alpaca_eval/evaluators_configs/alpaca_farm	configs.yaml configs.yaml	18:27 (6%) 31:40 (6%)	view
10	x 2	src/alpaca_eval/models_c...s/pairrm-zephyr-7b-beta src/alpaca_eval/models_configs/zephyr-7b-beta	configs.yaml configs.yaml	2:11 (71%) 2:11 (76%)	view
10	x 2	src/alpaca_eval/models_configs/alpaca-7b_concise src/alpaca_eval/models_configs/alpaca-7b_verbose	configs.yaml configs.yaml	3:12 (71%) 3:12 (71%)	view
9	x 2	src/alpaca_eval/evaluato...figs/gpt4_turbo_cot_clf src/alpaca_eval/evaluato...aca_eval_cot_gpt4_turbo	configs.yaml configs.yaml	3:11 (52%) 3:11 (52%)	view
9	x 2	src/alpaca_eval/evaluato..._eval_cot_gpt4_turbo_fn src/alpaca_eval/evaluato...paca_eval_gpt4_turbo_fn	configs.yaml configs.yaml	7:15 (21%) 7:15 (25%)	view
9	x 2	src/alpaca_eval src/alpaca_eval	processors.py processors.py	231:243 (5%) 293:305 (5%)	view
9	x 2	src/alpaca_eval/evaluato...aca_eval_clf_gpt4_turbo src/alpaca_eval/evaluato...figs/gpt4_turbo_logprob	configs.yaml configs.yaml	3:11 (56%) 3:11 (56%)	view
9	x 2	src/alpaca_eval/models_configs/pairrm-tulu-2-13b src/alpaca_eval/models_configs/pairrm-tulu-2-70b	configs.yaml configs.yaml	6:14 (56%) 6:14 (56%)	view
9	x 2	src/alpaca_eval/evaluato...eval_clf_cot_gpt4_turbo src/alpaca_eval/evaluato...figs/gpt4_turbo_cot_clf	configs.yaml configs.yaml	3:11 (47%) 3:11 (52%)	view
9	x 2	src/alpaca_eval/evaluato...figs/gpt4_turbo_logprob src/alpaca_eval/evaluato..._alpaca_eval_gpt4_turbo	configs.yaml configs.yaml	3:11 (56%) 3:11 (56%)	view
9	x 2	src/alpaca_eval/evaluators_configs/alpaca_farm src/alpaca_eval/evaluators_configs/alpaca_farm	configs.yaml configs.yaml	146:154 (5%) 159:167 (5%)	view
9	x 2	src/alpaca_eval/evaluato...eval_clf_cot_gpt4_turbo src/alpaca_eval/evaluato.../gpt4_turbo_cot_logprob	configs.yaml configs.yaml	3:11 (47%) 3:11 (52%)	view
9	x 2	src/alpaca_eval/evaluato...aca_eval_clf_gpt4_turbo src/alpaca_eval/evaluators_configs/gpt4_turbo_clf	configs.yaml configs.yaml	3:11 (56%) 3:11 (56%)	view
9	x 2	src/alpaca_eval/evaluators_configs/gpt4_turbo_clf src/alpaca_eval/evaluato..._alpaca_eval_gpt4_turbo	configs.yaml configs.yaml	3:11 (56%) 3:11 (56%)	view
9	x 2	src/alpaca_eval/evaluato.../gpt4_turbo_cot_logprob src/alpaca_eval/evaluato...aca_eval_cot_gpt4_turbo	configs.yaml configs.yaml	3:11 (52%) 3:11 (52%)	view
8	x 2	src/alpaca_eval/evaluators_configs/gpt4_turbo_clf src/alpaca_eval/evaluato...figs/gpt4_turbo_cot_clf	configs.yaml configs.yaml	7:14 (50%) 7:14 (47%)	view
8	x 2	src/alpaca_eval/decoders src/alpaca_eval/decoders	anthropic.py google.py	65:72 (9%) 67:74 (8%)	view
8	x 2	src/alpaca_eval src/alpaca_eval	plotting.py plotting.py	200:208 (1%) 304:312 (1%)	view
8	x 2	src/alpaca_eval/models_c...tral-8x7B-Instruct-v0.1 src/alpaca_eval/models_c...B-Instruct-v0.1_concise	configs.yaml configs.yaml	3:10 (66%) 3:10 (66%)	view
8	x 2	src/alpaca_eval/decoders src/alpaca_eval/decoders	anthropic.py bedrock_anthropic.py	65:72 (9%) 69:76 (10%)	view
8	x 2	src/alpaca_eval/evaluato...aca_eval_cot_gpt4_turbo src/alpaca_eval/evaluato..._alpaca_eval_gpt4_turbo	configs.yaml configs.yaml	7:14 (47%) 7:14 (50%)	view
8	x 2	src/alpaca_eval/models_c...B-Instruct-v0.1_concise src/alpaca_eval/models_c...B-Instruct-v0.1_verbose	configs.yaml configs.yaml	3:10 (66%) 3:10 (66%)	view
8	x 2	src/alpaca_eval src/alpaca_eval	analyze.py analyze.py	319:326 (2%) 359:366 (2%)	view
8	x 2	src/alpaca_eval/models_configs/tulu-2-dpo-13b src/alpaca_eval/models_configs/tulu-2-dpo-70b	configs.yaml configs.yaml	6:13 (53%) 6:13 (53%)	view
8	x 2	src/alpaca_eval/models_configs/tulu-2-dpo-13b src/alpaca_eval/models_configs/tulu-2-dpo-7b	configs.yaml configs.yaml	6:13 (53%) 6:13 (53%)	view
8	x 2	src/alpaca_eval src/alpaca_eval	plotting.py plotting.py	268:276 (1%) 304:312 (1%)	view
8	x 2	src/alpaca_eval/evaluato.../gpt4_turbo_cot_logprob src/alpaca_eval/evaluato...figs/gpt4_turbo_logprob	configs.yaml configs.yaml	7:14 (47%) 7:14 (50%)	view
8	x 2	src/alpaca_eval/evaluato...eval_clf_cot_gpt4_turbo src/alpaca_eval/evaluato...aca_eval_clf_gpt4_turbo	configs.yaml configs.yaml	7:14 (42%) 7:14 (50%)	view
8	x 2	src/alpaca_eval/decoders src/alpaca_eval/decoders	bedrock_anthropic.py google.py	69:76 (10%) 67:74 (8%)	view
8	x 2	src/alpaca_eval/models_c...tral-8x7B-Instruct-v0.1 src/alpaca_eval/models_c...B-Instruct-v0.1_verbose	configs.yaml configs.yaml	3:10 (66%) 3:10 (66%)	view
8	x 2	src/alpaca_eval/models_configs/tulu-2-dpo-70b src/alpaca_eval/models_configs/tulu-2-dpo-7b	configs.yaml configs.yaml	6:13 (53%) 6:13 (53%)	view
8	x 2	src/alpaca_eval src/alpaca_eval	plotting.py plotting.py	234:242 (1%) 304:312 (1%)	view
7	x 2	src/alpaca_eval/evaluators_configs/alpaca_farm src/alpaca_eval/evaluators_configs/alpaca_farm	configs.yaml configs.yaml	18:24 (4%) 60:66 (4%)	view
7	x 2	src/alpaca_eval/evaluato...figs/gpt4_turbo_cot_clf src/alpaca_eval/evaluato...figs/gpt4_turbo_logprob	configs.yaml configs.yaml	7:13 (41%) 7:13 (43%)	view