Duplication · openai/guided-diffusion

Duplication Overall

23% duplication:

3,891 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
895 duplicated lines

74 duplicates

dependency graphs: 2D graph | 2D graph (with duplicates)... | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 74 duplicates...

Size	#	Folders	Files	Lines	Code
83	x 2	guided_diffusion guided_diffusion	unet.py unet.py	481:564 (12%) 739:822 (12%)	view
20	x 2	scripts scripts	image_train.py super_res_train.py	37:57 (32%) 40:60 (27%)	view
18	x 2	scripts scripts	classifier_sample.py image_sample.py	21:42 (17%) 18:39 (21%)	view
17	x 2	scripts scripts	image_nll.py image_sample.py	14:34 (25%) 16:36 (20%)	view
16	x 2	guided_diffusion guided_diffusion	script_util.py script_util.py	81:96 (4%) 287:302 (4%)	view
16	x 2	scripts scripts	image_train.py super_res_train.py	60:75 (25%) 75:90 (21%)	view
15	x 2	scripts scripts	classifier_sample.py image_nll.py	21:39 (14%) 16:34 (22%)	view
14	x 2	guided_diffusion guided_diffusion	gaussian_diffusion.py gaussian_diffusion.py	498:524 (2%) 671:695 (2%)	view
13	x 2	scripts scripts	super_res_sample.py super_res_train.py	16:32 (14%) 13:30 (17%)	view
12	x 2	guided_diffusion guided_diffusion	unet.py unet.py	427:438 (1%) 690:701 (1%)	view
12	x 2	guided_diffusion guided_diffusion	gaussian_diffusion.py gaussian_diffusion.py	626:637 (2%) 660:671 (2%)	view
12	x 2	guided_diffusion guided_diffusion	script_util.py script_util.py	116:127 (3%) 320:331 (3%)	view
11	x 2	guided_diffusion guided_diffusion	unet.py unet.py	464:475 (1%) 725:736 (1%)	view
11	x 2	guided_diffusion guided_diffusion	gaussian_diffusion.py gaussian_diffusion.py	442:452 (1%) 488:498 (1%)	view
11	x 2	guided_diffusion guided_diffusion	script_util.py script_util.py	104:114 (2%) 309:319 (2%)	view
11	x 2	guided_diffusion guided_diffusion	script_util.py script_util.py	116:126 (2%) 214:224 (2%)	view
11	x 2	guided_diffusion guided_diffusion	script_util.py script_util.py	214:224 (2%) 320:330 (2%)	view
10	x 2	guided_diffusion guided_diffusion	gaussian_diffusion.py gaussian_diffusion.py	442:451 (1%) 626:635 (1%)	view
10	x 2	guided_diffusion guided_diffusion	gaussian_diffusion.py gaussian_diffusion.py	442:451 (1%) 660:669 (1%)	view
10	x 2	guided_diffusion guided_diffusion	gaussian_diffusion.py gaussian_diffusion.py	488:497 (1%) 626:635 (1%)	view
10	x 2	guided_diffusion guided_diffusion	gaussian_diffusion.py gaussian_diffusion.py	488:497 (1%) 660:669 (1%)	view
10	x 2	guided_diffusion guided_diffusion	script_util.py script_util.py	149:158 (2%) 238:247 (2%)	view
9	x 2	guided_diffusion guided_diffusion	gaussian_diffusion.py gaussian_diffusion.py	404:429 (1%) 547:560 (1%)	view
9	x 2	guided_diffusion guided_diffusion	gaussian_diffusion.py gaussian_diffusion.py	474:482 (1%) 645:653 (1%)	view
9	x 2	guided_diffusion guided_diffusion	script_util.py script_util.py	168:176 (2%) 368:376 (2%)	view
9	x 2	scripts scripts	image_sample.py image_train.py	20:32 (10%) 15:28 (14%)	view
9	x 2	scripts scripts	image_nll.py image_train.py	18:30 (13%) 15:28 (14%)	view
9	x 2	scripts scripts	classifier_sample.py image_sample.py	109:119 (8%) 89:99 (10%)	view
9	x 2	scripts scripts	classifier_sample.py image_train.py	23:35 (8%) 15:28 (14%)	view
8	x 2	guided_diffusion guided_diffusion	unet.py unet.py	440:447 (1%) 702:709 (1%)	view
8	x 2	guided_diffusion guided_diffusion	unet.py unet.py	455:462 (1%) 717:724 (1%)	view
8	x 2	guided_diffusion guided_diffusion	unet.py unet.py	518:525 (1%) 595:602 (1%)	view
8	x 2	guided_diffusion guided_diffusion	unet.py unet.py	540:547 (1%) 555:562 (1%)	view
8	x 2	guided_diffusion guided_diffusion	unet.py unet.py	540:547 (1%) 813:820 (1%)	view
8	x 2	guided_diffusion guided_diffusion	unet.py unet.py	555:562 (1%) 798:805 (1%)	view
8	x 2	guided_diffusion guided_diffusion	unet.py unet.py	595:602 (1%) 776:783 (1%)	view
8	x 2	guided_diffusion guided_diffusion	unet.py unet.py	798:805 (1%) 813:820 (1%)	view
8	x 2	guided_diffusion guided_diffusion	gaussian_diffusion.py gaussian_diffusion.py	396:403 (1%) 538:545 (1%)	view
8	x 2	guided_diffusion guided_diffusion	gaussian_diffusion.py gaussian_diffusion.py	422:429 (1%) 601:608 (1%)	view
8	x 2	guided_diffusion guided_diffusion	gaussian_diffusion.py gaussian_diffusion.py	553:560 (1%) 601:608 (1%)	view
8	x 2	guided_diffusion guided_diffusion	script_util.py script_util.py	188:195 (2%) 206:213 (2%)	view
8	x 2	guided_diffusion guided_diffusion	script_util.py script_util.py	188:195 (2%) 229:236 (2%)	view
8	x 2	guided_diffusion guided_diffusion	script_util.py script_util.py	206:213 (2%) 229:236 (2%)	view
8	x 2	scripts scripts	classifier_sample.py image_sample.py	72:79 (7%) 47:54 (9%)	view
8	x 2	scripts scripts	image_sample.py super_res_sample.py	32:39 (9%) 32:39 (8%)	view
8	x 2	scripts scripts	classifier_sample.py super_res_sample.py	35:42 (7%) 32:39 (8%)	view
7	x 2	guided_diffusion guided_diffusion	unet.py unet.py	333:346 (1%) 366:379 (1%)	view
7	x 2	guided_diffusion guided_diffusion	gaussian_diffusion.py gaussian_diffusion.py	526:532 (1%) 697:703 (1%)	view
7	x 2	guided_diffusion guided_diffusion	script_util.py script_util.py	86:92 (1%) 197:203 (1%)	view
7	x 2	guided_diffusion guided_diffusion	script_util.py script_util.py	197:203 (1%) 292:298 (1%)	view

Most Frequent Duplicates

The list of 45 most frequently found duplicates.

Size	#	Folders	Files	Lines	Code
6	x 5	scripts scripts scripts scripts scripts	classifier_train.py image_sample.py image_nll.py image_train.py classifier_sample.py	24:34 (3%) 20:29 (7%) 18:27 (9%) 15:25 (9%) 23:32 (5%)	view
6	x 4	guided_diffusion guided_diffusion guided_diffusion guided_diffusion	gaussian_diffusion.py gaussian_diffusion.py gaussian_diffusion.py gaussian_diffusion.py	445:450 (1%) 491:496 (1%) 629:634 (1%) 663:668 (1%)	view
6	x 4	guided_diffusion guided_diffusion guided_diffusion guided_diffusion	unet.py unet.py unet.py unet.py	540:545 (<1%) 555:560 (<1%) 798:803 (<1%) 813:818 (<1%)	view
6	x 4	guided_diffusion guided_diffusion guided_diffusion guided_diffusion	gaussian_diffusion.py gaussian_diffusion.py gaussian_diffusion.py gaussian_diffusion.py	444:449 (1%) 490:495 (1%) 628:633 (1%) 662:667 (1%)	view
6	x 4	guided_diffusion guided_diffusion guided_diffusion guided_diffusion	unet.py unet.py unet.py unet.py	541:546 (<1%) 556:561 (<1%) 799:804 (<1%) 814:819 (<1%)	view
6	x 4	scripts scripts scripts scripts	image_nll.py image_train.py classifier_sample.py image_sample.py	22:29 (9%) 20:27 (9%) 27:34 (5%) 24:31 (7%)	view
6	x 4	guided_diffusion guided_diffusion guided_diffusion guided_diffusion	unet.py unet.py unet.py unet.py	503:508 (<1%) 548:553 (<1%) 761:766 (<1%) 806:811 (<1%)	view
6	x 4	guided_diffusion guided_diffusion guided_diffusion guided_diffusion	gaussian_diffusion.py gaussian_diffusion.py gaussian_diffusion.py gaussian_diffusion.py	446:451 (1%) 492:497 (1%) 630:635 (1%) 664:669 (1%)	view
6	x 4	guided_diffusion guided_diffusion guided_diffusion guided_diffusion	gaussian_diffusion.py gaussian_diffusion.py gaussian_diffusion.py gaussian_diffusion.py	442:447 (1%) 488:493 (1%) 626:631 (1%) 660:665 (1%)	view
6	x 4	guided_diffusion guided_diffusion guided_diffusion guided_diffusion	unet.py unet.py unet.py unet.py	542:547 (<1%) 557:562 (<1%) 800:805 (<1%) 815:820 (<1%)	view
6	x 4	scripts scripts scripts scripts	image_nll.py image_train.py classifier_sample.py image_sample.py	21:28 (9%) 19:26 (9%) 26:33 (5%) 23:30 (7%)	view
6	x 4	guided_diffusion guided_diffusion guided_diffusion guided_diffusion	gaussian_diffusion.py gaussian_diffusion.py gaussian_diffusion.py gaussian_diffusion.py	443:448 (1%) 489:494 (1%) 627:632 (1%) 661:666 (1%)	view
6	x 4	scripts scripts scripts scripts	image_nll.py image_train.py classifier_sample.py image_sample.py	24:30 (9%) 22:28 (9%) 29:35 (5%) 26:32 (7%)	view
6	x 3	scripts scripts scripts	image_nll.py image_train.py image_sample.py	88:95 (9%) 75:82 (9%) 100:107 (7%)	view
6	x 3	guided_diffusion guided_diffusion guided_diffusion	script_util.py script_util.py script_util.py	188:193 (1%) 206:211 (1%) 229:234 (1%)	view
6	x 3	guided_diffusion guided_diffusion guided_diffusion	unet.py unet.py unet.py	519:524 (<1%) 596:601 (<1%) 777:782 (<1%)	view
6	x 3	guided_diffusion guided_diffusion guided_diffusion	script_util.py script_util.py script_util.py	119:124 (1%) 217:222 (1%) 323:328 (1%)	view
6	x 3	scripts scripts scripts	image_nll.py image_train.py image_sample.py	89:96 (9%) 76:83 (9%) 101:108 (7%)	view
6	x 3	guided_diffusion guided_diffusion guided_diffusion	script_util.py script_util.py script_util.py	121:126 (1%) 219:224 (1%) 325:330 (1%)	view
6	x 3	guided_diffusion guided_diffusion guided_diffusion	script_util.py script_util.py script_util.py	86:91 (1%) 197:202 (1%) 292:297 (1%)	view
6	x 3	scripts scripts scripts	classifier_sample.py super_res_sample.py image_sample.py	113:118 (5%) 103:108 (6%) 93:98 (7%)	view
6	x 3	scripts scripts scripts	classifier_sample.py super_res_sample.py image_sample.py	37:42 (5%) 34:39 (6%) 34:39 (7%)	view
6	x 3	guided_diffusion guided_diffusion guided_diffusion	script_util.py script_util.py script_util.py	189:194 (1%) 207:212 (1%) 230:235 (1%)	view
6	x 3	guided_diffusion guided_diffusion guided_diffusion	gaussian_diffusion.py gaussian_diffusion.py gaussian_diffusion.py	423:428 (1%) 554:559 (1%) 602:607 (1%)	view
6	x 3	scripts scripts scripts	classifier_sample.py image_sample.py image_nll.py	30:36 (5%) 27:33 (7%) 25:31 (9%)	view
6	x 3	scripts scripts scripts	classifier_sample.py image_sample.py image_nll.py	32:37 (5%) 29:34 (7%) 27:32 (9%)	view
6	x 3	guided_diffusion guided_diffusion guided_diffusion	unet.py unet.py unet.py	520:525 (<1%) 597:602 (<1%) 778:783 (<1%)	view
6	x 3	scripts scripts scripts	classifier_sample.py image_sample.py image_nll.py	21:29 (5%) 18:26 (7%) 16:24 (9%)	view
6	x 3	guided_diffusion guided_diffusion guided_diffusion	gaussian_diffusion.py gaussian_diffusion.py gaussian_diffusion.py	424:429 (1%) 555:560 (1%) 603:608 (1%)	view
6	x 3	guided_diffusion guided_diffusion guided_diffusion	script_util.py script_util.py script_util.py	118:123 (1%) 216:221 (1%) 322:327 (1%)	view
6	x 3	guided_diffusion guided_diffusion guided_diffusion	script_util.py script_util.py script_util.py	120:125 (1%) 218:223 (1%) 324:329 (1%)	view
6	x 3	scripts scripts scripts	classifier_sample.py super_res_sample.py image_sample.py	36:41 (5%) 33:38 (6%) 33:38 (7%)	view
6	x 3	guided_diffusion guided_diffusion guided_diffusion	unet.py unet.py unet.py	518:523 (<1%) 595:600 (<1%) 776:781 (<1%)	view
6	x 3	guided_diffusion guided_diffusion guided_diffusion	gaussian_diffusion.py gaussian_diffusion.py gaussian_diffusion.py	396:401 (1%) 538:543 (1%) 588:593 (1%)	view
6	x 3	guided_diffusion guided_diffusion guided_diffusion	gaussian_diffusion.py gaussian_diffusion.py gaussian_diffusion.py	422:427 (1%) 553:558 (1%) 601:606 (1%)	view
6	x 3	scripts scripts scripts	classifier_sample.py image_sample.py image_nll.py	33:38 (5%) 30:35 (7%) 28:33 (9%)	view
6	x 3	guided_diffusion guided_diffusion guided_diffusion	script_util.py script_util.py script_util.py	116:121 (1%) 214:219 (1%) 320:325 (1%)	view
6	x 3	guided_diffusion guided_diffusion guided_diffusion	script_util.py script_util.py script_util.py	190:195 (1%) 208:213 (1%) 231:236 (1%)	view
6	x 3	scripts scripts scripts	classifier_sample.py image_sample.py image_nll.py	22:30 (5%) 19:27 (7%) 17:25 (9%)	view
6	x 3	scripts scripts scripts	classifier_sample.py image_sample.py image_nll.py	34:39 (5%) 31:36 (7%) 29:34 (9%)	view
6	x 3	guided_diffusion guided_diffusion guided_diffusion	script_util.py script_util.py script_util.py	87:92 (1%) 198:203 (1%) 293:298 (1%)	view
6	x 3	guided_diffusion guided_diffusion guided_diffusion	script_util.py script_util.py script_util.py	117:122 (1%) 215:220 (1%) 321:326 (1%)	view
6	x 3	scripts scripts scripts	image_train.py super_res_sample.py super_res_train.py	13:22 (9%) 18:26 (6%) 15:24 (8%)	view
6	x 3	scripts scripts scripts	classifier_sample.py super_res_sample.py image_sample.py	35:40 (5%) 32:37 (6%) 32:37 (7%)	view
6	x 3	scripts scripts scripts	image_train.py super_res_sample.py super_res_train.py	14:23 (9%) 19:27 (6%) 16:25 (8%)	view

About This Analysis

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

To learn more about duplications and techniques for eliminating duplication, Sokrates recommends the following resources:

Avoid Repetition, MartinFlower.com (IEEE Software article)
Refactoring duplicated code, sourcemaking.com
Beck Design Rules, MartinFowler.com
DRY (Don't Repeat Yourself) Principle, Wikipedia
The Cut-and-Paste Programming Software Development Anti-Pattern, sourcemaking.com
Code Smells / Duplicated Code, Jeff Atwood, codinghorror.com:

"Duplicated code is the bane of software development. Stamp out duplication whenever possible. You should always be on the lookout for more subtle cases of near-duplication, too. Don't Repeat Yourself!"

Reducing Coupling, MartinFlower.com (IEEE Software article):

"There are several ways to describe coupling, but it boils down to this: If changing one module in a program requires changing another module, then coupling exists. ... Duplication always implies coupling, because changing one piece of duplicate code implies changing the other."