netflix / vmaf - Duplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

27% duplication:

60,466 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
16,469 duplicated lines

14,106 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 14,106 duplicates...

Size	#	Folders	Files	Lines	Code
91	x 2	libvmaf/src/feature/x86 libvmaf/src/feature/x86	vif_avx512.c vif_avx512.c	257:367 (9%) 611:721 (9%)	view
64	x 2	libvmaf/src/feature/common libvmaf/src/feature/common	convolution_avx.c convolution_avx.c	1610:1688 (3%) 1769:1846 (3%)	view
63	x 2	libvmaf/src/feature libvmaf/src/feature	integer_adm.c integer_adm.c	2077:2160 (3%) 2174:2257 (3%)	view
61	x 2	libvmaf/src/feature/common libvmaf/src/feature/common	convolution_avx.c convolution_avx.c	2069:2142 (3%) 2226:2299 (3%)	view
59	x 2	libvmaf/src/feature libvmaf/src/feature	adm_tools.c adm_tools.c	866:940 (8%) 956:1030 (8%)	view
55	x 2	libvmaf/src/feature/common libvmaf/src/feature/common	convolution_avx.c convolution_avx.c	859:928 (3%) 1001:1069 (3%)	view
53	x 2	libvmaf/src/feature/cuda libvmaf/src/feature	integer_vif_cuda.c integer_vif.c	365:437 (13%) 674:746 (9%)	view
52	x 2	libvmaf/src/feature/common libvmaf/src/feature/common	convolution_avx.c convolution_avx.c	1276:1340 (3%) 1415:1479 (3%)	view
46	x 2	libvmaf/src/feature/common libvmaf/src/feature/common	convolution_avx.c convolution_avx.c	179:239 (2%) 304:363 (2%)	view
43	x 2	libvmaf/src/feature/common libvmaf/src/feature/common	convolution_avx.c convolution_avx.c	432:491 (2%) 1143:1202 (2%)	view
43	x 2	libvmaf/src/feature/common libvmaf/src/feature/common	convolution_avx.c convolution_avx.c	556:611 (2%) 678:733 (2%)	view
39	x 2	matlab/SpEED/SpEED matlab/strred/strred	est_params.m est_params.m	1:47 (100%) 1:47 (100%)	view
39	x 2	libvmaf/src/feature/cuda libvmaf/src/feature	integer_adm_cuda.c integer_adm.c	698:753 (4%) 2687:2742 (2%)	view
37	x 2	libvmaf/src/feature libvmaf/src/feature	adm_tools.c adm_tools.c	525:572 (5%) 637:683 (5%)	view
36	x 2	libvmaf/src/feature libvmaf/src/feature	adm_tools.c adm_tools.c	587:632 (5%) 664:709 (5%)	view
33	x 2	libvmaf/src/feature libvmaf/src/feature	integer_adm.c integer_adm.c	1809:1849 (1%) 1906:1946 (1%)	view
32	x 2	libvmaf/src/feature/common libvmaf/src/feature/common	convolution_avx.c convolution_avx.c	1148:1192 (1%) 1931:1975 (1%)	view
32	x 2	matlab/strred/matlabPyrTools matlab/strred/matlabPyrTools	buildSCFpyr.m buildSFpyr.m	21:58 (64%) 33:70 (38%)	view
32	x 2	libvmaf/src/feature/common libvmaf/src/feature/common	convolution_avx.c convolution_avx.c	437:481 (1%) 1931:1975 (1%)	view
31	x 2	resource/dataset resource/dataset	NFLX_dataset_public.py NFLX_dataset_public_raw.py	6:37 (7%) 7:38 (1%)	view
31	x 2	libvmaf/src/feature libvmaf/src/feature	float_adm.c integer_adm.c	43:78 (19%) 44:79 (1%)	view
31	x 2	matlab/STMAD_2011_MatlabCode matlab/STMAD_2011_MatlabCode	STMAD_index.m calcSTMADScore.m	45:86 (30%) 14:56 (42%)	view
30	x 2	libvmaf/src/feature libvmaf/src/feature	integer_vif.c integer_vif.c	412:446 (5%) 504:537 (5%)	view
29	x 2	libvmaf/src/feature/common libvmaf/src/feature/common	convolution_avx.c convolution_avx.c	1783:1816 (1%) 1864:1897 (1%)	view
29	x 2	libvmaf/src/feature/common libvmaf/src/feature/common	convolution_avx.c convolution_avx.c	1625:1658 (1%) 1864:1897 (1%)	view
28	x 2	libvmaf/src/feature libvmaf/src/feature	float_ansnr.c float_psnr.c	43:76 (37%) 43:76 (39%)	view
28	x 2	libvmaf/src/feature/common libvmaf/src/feature/common	convolution_avx.c convolution_avx.c	2236:2268 (1%) 2318:2350 (1%)	view
28	x 2	libvmaf/src/feature/common libvmaf/src/feature/common	convolution_avx.c convolution_avx.c	2079:2111 (1%) 2318:2350 (1%)	view
28	x 2	resource/dataset resource/dataset	NFLX_dataset_public_raw.py NFLX_dataset_public_raw_last4outliers.py	40:67 (1%) 38:65 (1%)	view
27	x 2	resource/dataset resource/dataset	NFLX_dataset_public_raw.py NFLX_dataset_public_raw_last4outliers.py	447:473 (1%) 515:541 (<1%)	view
27	x 2	resource/dataset resource/dataset	NFLX_dataset_public_raw.py NFLX_dataset_public_raw_last4outliers.py	418:444 (1%) 481:507 (<1%)	view
27	x 2	resource/dataset resource/dataset	NFLX_dataset_public_raw.py NFLX_dataset_public_raw_last4outliers.py	1607:1633 (1%) 1875:1901 (<1%)	view
27	x 2	resource/dataset resource/dataset	NFLX_dataset_public_raw.py NFLX_dataset_public_raw_last4outliers.py	940:966 (1%) 1093:1119 (<1%)	view
27	x 2	resource/dataset resource/dataset	NFLX_dataset_public_raw.py NFLX_dataset_public_raw_last4outliers.py	1636:1662 (1%) 1909:1935 (<1%)	view
27	x 2	resource/dataset resource/dataset	NFLX_dataset_public_raw.py NFLX_dataset_public_raw_last4outliers.py	2129:2155 (1%) 2487:2513 (<1%)	view
27	x 2	resource/dataset resource/dataset	NFLX_dataset_public_raw.py NFLX_dataset_public_raw_last4outliers.py	2042:2068 (1%) 2385:2411 (<1%)	view
27	x 2	resource/dataset resource/dataset	NFLX_dataset_public_raw.py NFLX_dataset_public_raw_last4outliers.py	128:154 (1%) 141:167 (<1%)	view
27	x 2	resource/dataset resource/dataset	NFLX_dataset_public_raw.py NFLX_dataset_public_raw_last4outliers.py	882:908 (1%) 1025:1051 (<1%)	view
27	x 2	resource/dataset resource/dataset	NFLX_dataset_public_raw.py NFLX_dataset_public_raw_last4outliers.py	1926:1952 (1%) 2249:2275 (<1%)	view
27	x 2	resource/dataset resource/dataset	NFLX_dataset_public_raw.py NFLX_dataset_public_raw_last4outliers.py	1868:1894 (1%) 2181:2207 (<1%)	view
27	x 2	resource/dataset resource/dataset	NFLX_dataset_public_raw.py NFLX_dataset_public_raw_last4outliers.py	824:850 (1%) 957:983 (<1%)	view
27	x 2	resource/dataset resource/dataset	NFLX_dataset_public_raw.py NFLX_dataset_public_raw_last4outliers.py	505:531 (1%) 583:609 (<1%)	view
27	x 2	resource/dataset resource/dataset	NFLX_dataset_public_raw.py NFLX_dataset_public_raw_last4outliers.py	998:1024 (1%) 1161:1187 (<1%)	view
27	x 2	resource/dataset resource/dataset	NFLX_dataset_public_raw.py NFLX_dataset_public_raw_last4outliers.py	70:96 (1%) 73:99 (<1%)	view
27	x 2	resource/dataset resource/dataset	NFLX_dataset_public_raw.py NFLX_dataset_public_raw_last4outliers.py	1839:1865 (1%) 2147:2173 (<1%)	view
27	x 2	resource/dataset resource/dataset	NFLX_dataset_public_raw.py NFLX_dataset_public_raw_last4outliers.py	1694:1720 (1%) 1977:2003 (<1%)	view
27	x 2	resource/dataset resource/dataset	NFLX_dataset_public_raw.py NFLX_dataset_public_raw_last4outliers.py	2100:2126 (1%) 2453:2479 (<1%)	view
27	x 2	resource/dataset resource/dataset	NFLX_dataset_public_raw.py NFLX_dataset_public_raw_last4outliers.py	2187:2213 (1%) 2555:2581 (<1%)	view
27	x 2	resource/dataset resource/dataset	NFLX_dataset_public_raw.py NFLX_dataset_public_raw_last4outliers.py	1723:1749 (1%) 2011:2037 (<1%)	view
27	x 2	resource/dataset resource/dataset	NFLX_dataset_public_raw.py NFLX_dataset_public_raw_last4outliers.py	2274:2300 (1%) 2657:2683 (<1%)	view

Duplicated Units

The list of top 2 duplicated units.

See data for all 2 unit duplicates...

Size	#	Folders	Files	Lines	Code
10	x 2	libvmaf/src/feature libvmaf/src/feature	float_motion.c integer_motion.c	103:116 325:338	view
6	x 2	libvmaf/src/feature/cuda libvmaf/src/feature	integer_adm_cuda.c adm_tools.h	88:99 332:343	view