facebookresearch / NeuralCompression
Duplication

Places in code with 6 or more lines that are exactly the same.

Intro
  • For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
  • Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
  • You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.
Learn more...
Duplication Overall
  • 14% duplication:
    • 5,136 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
    • 755 duplicated lines
  • 49 duplicates
system14% (755 lines)
Duplication per Extension
py15% (725 lines)
yaml20% (30 lines)
Duplication per Component (primary)
projects/deep_video_compression24% (175 lines)
neuralcompression/models12% (170 lines)
neuralcompression/layers22% (136 lines)
projects/variational_image_compression47% (120 lines)
neuralcompression/entropy_coders6% (50 lines)
projects/scale_hyperprior_lightning18% (44 lines)
neuralcompression/functional6% (32 lines)
neuralcompression/metrics30% (28 lines)
ROOT0% (0 lines)
neuralcompression/ext0% (0 lines)
neuralcompression0% (0 lines)
neuralcompression/data0% (0 lines)
neuralcompression/distributions0% (0 lines)

Duplication Between Components (50+ lines)

G projects/deep_video_compression projects/deep_video_compression projects/scale_hyperprior_lightning projects/scale_hyperprior_lightning projects/deep_video_compression--projects/scale_hyperprior_lightning 64

Download: SVG DOT (open online Graphviz editor)

Open 3D force graph...

Show more details on duplication between components...
Longest Duplicates
The list of 20 longest duplicates.
See data for all 49 duplicates...
Size#FoldersFilesLinesCode
30 x 2 projects/deep_video_compression
projects/deep_video_compression
_utils.py
_utils.py
135:174 (13%)
206:245 (13%)
view
18 x 2 neuralcompression/layers
neuralcompression/layers
_synthesis_transformation_2d.py
_synthesis_transformation_2d.py
41:58 (38%)
50:67 (38%)
view
16 x 2 neuralcompression/layers
neuralcompression/layers
_analysis_transformation_2d.py
_analysis_transformation_2d.py
41:56 (37%)
49:64 (37%)
view
14 x 2 projects/variational_image_compression/lightning
projects/variational_image_compression/lightning
_mean_scale_hyperprior_autoencoder.py
_scale_hyperprior_autoencoder.py
68:83 (31%)
68:83 (31%)
view
12 x 2 projects/variational_image_compression/lightning
projects/variational_image_compression/lightning
_factorized_prior_autoencoder.py
_scale_hyperprior_autoencoder.py
52:64 (26%)
54:66 (26%)
view
12 x 2 projects/variational_image_compression/lightning
projects/variational_image_compression/lightning
_factorized_prior_autoencoder.py
_mean_scale_hyperprior_autoencoder.py
52:64 (26%)
54:66 (26%)
view
12 x 2 projects/variational_image_compression/lightning
projects/variational_image_compression/lightning
_mean_scale_hyperprior_autoencoder.py
_scale_hyperprior_autoencoder.py
54:66 (26%)
54:66 (26%)
view
12 x 2 neuralcompression/models
neuralcompression/models
deep_video_compression.py
deep_video_compression.py
336:348 (2%)
422:434 (2%)
view
12 x 2 neuralcompression/layers
neuralcompression/layers
gdn.py
gdn.py
34:75 (30%)
81:122 (30%)
view
12 x 2 projects/variational_image_compression/lightning
projects/variational_image_compression/lightning
_factorized_prior_autoencoder.py
_mean_scale_hyperprior_autoencoder.py
66:77 (26%)
68:79 (26%)
view
12 x 2 projects/variational_image_compression/lightning
projects/variational_image_compression/lightning
_factorized_prior_autoencoder.py
_scale_hyperprior_autoencoder.py
66:77 (26%)
68:79 (26%)
view
11 x 2 neuralcompression/models
neuralcompression/models
_mean_scale_hyperprior_autoencoder.py
_scale_hyperprior_autoencoder.py
101:114 (10%)
49:62 (18%)
view
11 x 2 projects/deep_video_compression
projects/deep_video_compression
_utils.py
_utils.py
111:121 (4%)
179:189 (4%)
view
11 x 2 neuralcompression/entropy_coders
neuralcompression/entropy_coders
jax_arithemetic_coder.py
jax_arithemetic_coder.py
163:173 (2%)
286:296 (2%)
view
10 x 2 projects/variational_image_compression/lightning
projects/variational_image_compression/lightning
_mean_scale_hyperprior_autoencoder.py
_scale_hyperprior_autoencoder.py
37:46 (22%)
37:46 (22%)
view
10 x 2 projects/deep_video_compression
projects/scale_hyperprior_lightning
data_module.py
vimeo.py
80:90 (16%)
66:76 (20%)
view
10 x 2 projects/deep_video_compression
projects/deep_video_compression
_utils.py
_utils.py
122:133 (4%)
191:202 (4%)
view
10 x 2 neuralcompression/functional
neuralcompression/metrics
_lpips.py
distortion.py
75:85 (25%)
135:145 (11%)
view
10 x 2 projects/variational_image_compression/lightning
projects/variational_image_compression/lightning
_factorized_prior_autoencoder.py
_scale_hyperprior_autoencoder.py
35:44 (21%)
37:46 (22%)
view
10 x 2 projects/variational_image_compression/lightning
projects/variational_image_compression/lightning
_factorized_prior_autoencoder.py
_mean_scale_hyperprior_autoencoder.py
35:44 (21%)
37:46 (22%)
view
Duplicated Units
The list of top 7 duplicated units.
See data for all 7 unit duplicates...
Size#FoldersFilesLinesCode
21 x 2 projects/deep_video_compression
projects/deep_video_compression
_utils.py
_utils.py
0:0 
0:0 
view
8 x 3 projects/variational_image_compression/lightning
projects/variational_image_compression/lightning
projects/variational_image_compression/lightning
_factorized_prior_autoencoder.py
_mean_scale_hyperprior_autoencoder.py
_scale_hyperprior_autoencoder.py
0:0 
0:0 
0:0 
view
7 x 2 projects/deep_video_compression
projects/scale_hyperprior_lightning
data_module.py
vimeo.py
0:0 
0:0 
view
7 x 2 projects/deep_video_compression
projects/scale_hyperprior_lightning
data_module.py
vimeo.py
0:0 
0:0 
view
7 x 2 neuralcompression/models
neuralcompression/models
_mean_scale_hyperprior_autoencoder.py
_scale_hyperprior_autoencoder.py
0:0 
0:0 
view
7 x 2 neuralcompression/functional
neuralcompression/functional
_multiscale_structural_similarity.py
_multiscale_structural_similarity.py
0:0 
0:0 
view
6 x 2 neuralcompression/layers
neuralcompression/layers
gdn.py
gdn.py
0:0 
0:0 
view