huggingface / trl Duplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

35% duplication:

19,714 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
7,040 duplicated lines

791 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 791 duplicates...

Size	#	Folders	Files	Lines	Code
132	x 2	trl/trainer trl/trainer	cpo_trainer.py orpo_trainer.py	374:572 (18%) 349:547 (18%)	view
116	x 2	trl/trainer trl/trainer	cpo_trainer.py orpo_trainer.py	920:1109 (16%) 899:1086 (16%)	view
109	x 2	trl/trainer trl/trainer	bco_trainer.py kto_trainer.py	1364:1536 (10%) 1557:1729 (9%)	view
108	x 2	trl/trainer trl/trainer	bco_trainer.py kto_trainer.py	1229:1360 (10%) 1421:1553 (8%)	view
68	x 2	trl/trainer trl/trainer	bco_trainer.py kto_trainer.py	401:498 (6%) 386:483 (5%)	view
61	x 2	trl/trainer trl/trainer	bco_trainer.py kto_trainer.py	208:281 (5%) 200:273 (5%)	view
55	x 2	trl/trainer trl/trainer	cpo_trainer.py orpo_trainer.py	145:226 (7%) 149:230 (7%)	view
53	x 2	trl/trainer trl/trainer	ppo_trainer.py rloo_trainer.py	730:813 (8%) 623:709 (10%)	view
48	x 2	trl/trainer trl/trainer	nash_md_trainer.py xpo_trainer.py	465:544 (14%) 511:588 (12%)	view
47	x 2	trl/trainer trl/trainer	alignprop_trainer.py ddpo_trainer.py	382:458 (17%) 584:662 (11%)	view
46	x 2	trl/trainer trl/trainer	cpo_trainer.py orpo_trainer.py	574:642 (6%) 559:627 (6%)	view
44	x 2	trl/trainer trl/trainer	cpo_config.py kto_config.py	86:130 (40%) 93:137 (30%)	view
43	x 2	trl/trainer trl/trainer	cpo_trainer.py kto_trainer.py	158:220 (6%) 402:464 (3%)	view
43	x 2	trl/trainer trl/trainer	kto_trainer.py orpo_trainer.py	402:464 (3%) 162:224 (6%)	view
43	x 2	trl/trainer trl/trainer	bco_trainer.py orpo_trainer.py	417:479 (4%) 162:224 (6%)	view
43	x 2	trl/trainer trl/trainer	bco_trainer.py cpo_trainer.py	417:479 (4%) 158:220 (6%)	view
42	x 2	trl/trainer trl/trainer	cpo_trainer.py orpo_trainer.py	733:787 (5%) 697:751 (5%)	view
42	x 2	trl/trainer trl/trainer	cpo_config.py orpo_config.py	23:126 (38%) 23:111 (44%)	view
40	x 2	trl/trainer trl/trainer	dpo_trainer.py kto_trainer.py	1854:1923 (3%) 1664:1729 (3%)	view
40	x 2	trl/trainer trl/trainer	kto_config.py orpo_config.py	93:133 (27%) 71:111 (42%)	view
40	x 2	trl/trainer trl/trainer	bco_trainer.py dpo_trainer.py	1471:1536 (3%) 1854:1923 (3%)	view
38	x 2	trl/trainer trl/trainer	alignprop_trainer.py online_dpo_trainer.py	397:458 (13%) 741:802 (7%)	view
38	x 2	trl/trainer trl/trainer	bco_trainer.py cpo_trainer.py	1475:1536 (3%) 1046:1109 (5%)	view
38	x 2	trl/trainer trl/trainer	bco_trainer.py orpo_trainer.py	1475:1536 (3%) 1025:1086 (5%)	view
38	x 2	trl/trainer trl/trainer	dpo_trainer.py grpo_trainer.py	1858:1923 (3%) 1516:1580 (4%)	view
38	x 2	trl/trainer trl/trainer	alignprop_trainer.py grpo_trainer.py	397:458 (13%) 1516:1580 (4%)	view
38	x 2	trl/trainer trl/trainer	ddpo_trainer.py ppo_trainer.py	599:662 (9%) 752:813 (5%)	view
38	x 2	trl/trainer trl/trainer	bco_trainer.py ddpo_trainer.py	1475:1536 (3%) 599:662 (9%)	view
38	x 2	trl/trainer trl/trainer	dpo_trainer.py online_dpo_trainer.py	1858:1923 (3%) 741:802 (7%)	view
38	x 2	trl/trainer trl/trainer	grpo_trainer.py kto_trainer.py	1516:1580 (4%) 1668:1729 (3%)	view
38	x 2	trl/trainer trl/trainer	online_dpo_trainer.py ppo_trainer.py	741:802 (7%) 752:813 (5%)	view
38	x 2	trl/trainer trl/trainer	orpo_trainer.py rloo_trainer.py	1025:1086 (5%) 645:709 (7%)	view
38	x 2	trl/trainer trl/trainer	orpo_trainer.py ppo_trainer.py	1025:1086 (5%) 752:813 (5%)	view
38	x 2	trl/trainer trl/trainer	grpo_trainer.py ppo_trainer.py	1516:1580 (4%) 752:813 (5%)	view
38	x 2	trl/trainer trl/trainer	alignprop_trainer.py rloo_trainer.py	397:458 (13%) 645:709 (7%)	view
38	x 2	trl/trainer trl/trainer	kto_trainer.py ppo_trainer.py	1668:1729 (3%) 752:813 (5%)	view
38	x 2	trl/trainer trl/trainer	dpo_trainer.py ppo_trainer.py	1858:1923 (3%) 752:813 (5%)	view
38	x 2	trl/trainer trl/trainer	online_dpo_trainer.py orpo_trainer.py	741:802 (7%) 1025:1086 (5%)	view
38	x 2	trl/trainer trl/trainer	grpo_trainer.py rloo_trainer.py	1516:1580 (4%) 645:709 (7%)	view
38	x 2	trl/trainer trl/trainer	bco_trainer.py rloo_trainer.py	1475:1536 (3%) 645:709 (7%)	view
38	x 2	trl/trainer trl/trainer	ddpo_trainer.py orpo_trainer.py	599:662 (9%) 1025:1086 (5%)	view
38	x 2	trl/trainer trl/trainer	alignprop_trainer.py kto_trainer.py	397:458 (13%) 1668:1729 (3%)	view
38	x 2	trl/trainer trl/trainer	alignprop_trainer.py cpo_trainer.py	397:458 (13%) 1046:1109 (5%)	view
38	x 2	trl/trainer trl/trainer	ddpo_trainer.py grpo_trainer.py	599:662 (9%) 1516:1580 (4%)	view
38	x 2	trl/trainer trl/trainer	online_dpo_trainer.py rloo_trainer.py	741:802 (7%) 645:709 (7%)	view
38	x 2	trl/trainer trl/trainer	cpo_trainer.py ddpo_trainer.py	1046:1109 (5%) 599:662 (9%)	view
38	x 2	trl/trainer trl/trainer	ddpo_trainer.py rloo_trainer.py	599:662 (9%) 645:709 (7%)	view
38	x 2	trl/trainer trl/trainer	bco_trainer.py grpo_trainer.py	1475:1536 (3%) 1516:1580 (4%)	view
38	x 2	trl/trainer trl/trainer	ddpo_trainer.py dpo_trainer.py	599:662 (9%) 1858:1923 (3%)	view
38	x 2	trl/trainer trl/trainer	kto_trainer.py orpo_trainer.py	1668:1729 (3%) 1025:1086 (5%)	view