huggingface / datablations Duplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

46% duplication:

5,652 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
2,633 duplicated lines

158 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 158 duplicates...

Size	#	Folders	Files	Lines	Code
60	x 2	plotstables plotstables	filtering.ipynb filtering.ipynb	165:224 (7%) 485:544 (7%)	view
45	x 2	plotstables plotstables	repetition.ipynb repetition.ipynb	780:824 (3%) 938:982 (3%)	view
31	x 2	plotstables plotstables	filtering.ipynb repetition.ipynb	615:645 (3%) 936:966 (2%)	view
30	x 2	plotstables plotstables	filtering.ipynb filtering.ipynb	225:254 (3%) 617:646 (3%)	view
29	x 2	plotstables plotstables	filtering.ipynb repetition.ipynb	617:645 (3%) 780:808 (2%)	view
29	x 2	plotstables plotstables	filtering.ipynb filtering.ipynb	56:84 (3%) 579:607 (3%)	view
29	x 2	plotstables plotstables	filtering.ipynb repetition.ipynb	225:253 (3%) 938:966 (2%)	view
29	x 2	plotstables plotstables	filtering.ipynb repetition.ipynb	225:253 (3%) 780:808 (2%)	view
28	x 2	filtering_notebooks filtering_notebooks	blindspots.ipynb blindspots.ipynb	214:241 (1%) 1281:1308 (1%)	view
27	x 2	plotstables plotstables	repetition.ipynb repetition.ipynb	863:889 (1%) 1028:1054 (1%)	view
25	x 2	plotstables plotstables	filtering.ipynb filtering.ipynb	110:134 (3%) 436:460 (3%)	view
24	x 2	filtering_notebooks filtering_notebooks	blindspots.ipynb blindspots.ipynb	91:114 (<1%) 214:237 (<1%)	view
24	x 2	filtering_notebooks filtering_notebooks	blindspots.ipynb blindspots.ipynb	91:114 (<1%) 1281:1304 (<1%)	view
22	x 2	plotstables plotstables	filtering.ipynb filtering.ipynb	282:303 (2%) 674:695 (2%)	view
21	x 2	plotstables plotstables	filtering.ipynb filtering.ipynb	305:325 (2%) 697:717 (2%)	view
20	x 2	plotstables plotstables	filtering.ipynb repetition.ipynb	435:454 (2%) 617:636 (1%)	view
19	x 2	plotstables plotstables	filtering.ipynb repetition.ipynb	110:128 (2%) 618:636 (1%)	view
18	x 2	plotstables plotstables	filtering.ipynb repetition.ipynb	1:18 (2%) 1:18 (1%)	view
15	x 2	plotstables plotstables	repetition.ipynb repetition.ipynb	894:908 (1%) 1059:1073 (1%)	view
12	x 2	plotstables plotstables	repetition.ipynb repetition.ipynb	828:839 (<1%) 992:1003 (<1%)	view
10	x 2	filtering_notebooks filtering_notebooks	blindspots.ipynb blindspots.ipynb	242:251 (<1%) 1310:1319 (<1%)	view
10	x 2	plotstables plotstables	filtering.ipynb filtering.ipynb	357:366 (1%) 737:746 (1%)	view
10	x 2	plotstables plotstables	repetition.ipynb repetition.ipynb	846:855 (<1%) 1011:1020 (<1%)	view
9	x 2	plotstables plotstables	filtering.ipynb filtering.ipynb	256:264 (1%) 648:656 (1%)	view
9	x 2	utils utils	hub_sync.py hub_sync.py	146:154 (6%) 165:173 (6%)	view
8	x 2	filtering_notebooks filtering_notebooks	blindspots.ipynb blindspots.ipynb	300:307 (<1%) 1978:1985 (<1%)	view
8	x 2	filtering_notebooks filtering_notebooks	blindspots.ipynb blindspots.ipynb	468:475 (<1%) 1348:1355 (<1%)	view
8	x 2	filtering_notebooks filtering_notebooks	blindspots.ipynb blindspots.ipynb	548:555 (<1%) 1888:1895 (<1%)	view
8	x 2	filtering_notebooks filtering_notebooks	blindspots.ipynb blindspots.ipynb	396:403 (<1%) 2041:2048 (<1%)	view
8	x 2	filtering_notebooks filtering_notebooks	blindspots.ipynb blindspots.ipynb	412:419 (<1%) 1915:1922 (<1%)	view
8	x 2	filtering_notebooks filtering_notebooks	blindspots.ipynb blindspots.ipynb	516:523 (<1%) 1357:1364 (<1%)	view
8	x 2	filtering_notebooks filtering_notebooks	blindspots.ipynb blindspots.ipynb	964:971 (<1%) 2122:2129 (<1%)	view
8	x 2	filtering_notebooks filtering_notebooks	blindspots.ipynb blindspots.ipynb	428:435 (<1%) 1771:1778 (<1%)	view
8	x 2	filtering_notebooks filtering_notebooks	blindspots.ipynb blindspots.ipynb	308:315 (<1%) 1681:1688 (<1%)	view
8	x 2	filtering_notebooks filtering_notebooks	blindspots.ipynb blindspots.ipynb	1028:1035 (<1%) 2167:2174 (<1%)	view
8	x 2	filtering_notebooks filtering_notebooks	blindspots.ipynb blindspots.ipynb	692:699 (<1%) 1519:1526 (<1%)	view
8	x 2	filtering_notebooks filtering_notebooks	blindspots.ipynb blindspots.ipynb	508:515 (<1%) 1654:1661 (<1%)	view
8	x 2	filtering_notebooks filtering_notebooks	blindspots.ipynb blindspots.ipynb	500:507 (<1%) 1753:1760 (<1%)	view
8	x 2	filtering_notebooks filtering_notebooks	blindspots.ipynb blindspots.ipynb	580:587 (<1%) 1366:1373 (<1%)	view
8	x 2	filtering_notebooks filtering_notebooks	blindspots.ipynb blindspots.ipynb	540:547 (<1%) 1591:1598 (<1%)	view
8	x 2	filtering_notebooks filtering_notebooks	blindspots.ipynb blindspots.ipynb	636:643 (<1%) 2158:2165 (<1%)	view
8	x 2	filtering_notebooks filtering_notebooks	blindspots.ipynb blindspots.ipynb	668:675 (<1%) 1384:1391 (<1%)	view
8	x 2	filtering_notebooks filtering_notebooks	blindspots.ipynb blindspots.ipynb	356:363 (<1%) 1573:1580 (<1%)	view
8	x 2	filtering_notebooks filtering_notebooks	blindspots.ipynb blindspots.ipynb	860:867 (<1%) 1438:1445 (<1%)	view
8	x 2	filtering_notebooks filtering_notebooks	blindspots.ipynb blindspots.ipynb	644:651 (<1%) 1375:1382 (<1%)	view
8	x 2	filtering_notebooks filtering_notebooks	blindspots.ipynb blindspots.ipynb	532:539 (<1%) 2005:2012 (<1%)	view
8	x 2	filtering_notebooks filtering_notebooks	blindspots.ipynb blindspots.ipynb	260:267 (<1%) 1627:1634 (<1%)	view
8	x 2	filtering_notebooks filtering_notebooks	blindspots.ipynb blindspots.ipynb	364:371 (<1%) 1942:1949 (<1%)	view
8	x 2	filtering_notebooks filtering_notebooks	blindspots.ipynb blindspots.ipynb	748:755 (<1%) 1897:1904 (<1%)	view
8	x 2	filtering_notebooks filtering_notebooks	blindspots.ipynb blindspots.ipynb	556:563 (<1%) 2032:2039 (<1%)	view