tensorflow / model-optimization
Duplication

Places in code with 6 or more lines that are exactly the same.

Intro
  • For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
  • Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
  • You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.
Learn more...
Duplication Overall
  • 24% duplication:
    • 8,759 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
    • 2,172 duplicated lines
  • 195 duplicates
system24% (2,172 lines)
Duplication per Extension
py25% (2,172 lines)
Duplication per Component (primary)
tensorflow_model_optimization/python/core/quantization42% (1,542 lines)
tensorflow_model_optimization/python/core/internal22% (437 lines)
tensorflow_model_optimization/python/core/common22% (133 lines)
tensorflow_model_optimization/python/core/clustering4% (36 lines)
tensorflow_model_optimization/python/core/sparsity1% (24 lines)
ROOT0% (0 lines)
ci/kokoro/gcp_ubuntu0% (0 lines)
tensorflow_model_optimization/g3doc/tools0% (0 lines)
tensorflow_model_optimization/g3doc0% (0 lines)
tensorflow_model_optimization/python/core/api0% (0 lines)
tensorflow_model_optimization/python/core0% (0 lines)
tensorflow_model_optimization/python/core/keras0% (0 lines)
tensorflow_model_optimization/python0% (0 lines)
tensorflow_model_optimization0% (0 lines)

Duplication Between Components (50+ lines)

G tensorflow_model_optimization/python/core/quantization tensorflow_model_optimization/python/core/quantization tensorflow_model_optimization/python/core/sparsity tensorflow_model_optimization/python/core/sparsity tensorflow_model_optimization/python/core/quantization--tensorflow_model_optimization/python/core/sparsity 61 tensorflow_model_optimization/python/core/clustering tensorflow_model_optimization/python/core/clustering tensorflow_model_optimization/python/core/clustering--tensorflow_model_optimization/python/core/quantization 61

Download: SVG DOT (open online Graphviz editor)

Open 3D force graph...

Show more details on duplication between components...
Longest Duplicates
The list of 20 longest duplicates.
See data for all 195 duplicates...
Size#FoldersFilesLinesCode
60 x 2 tensorflow_model_optimiz...tion/keras/default_8bit
tensorflow_model_optimiz...erimental/default_n_bit
default_8bit_transforms.py
default_n_bit_transforms.py
 464:539 (14%)
411:486 (13%)
 view
57 x 2 tensorflow_model_optimiz...tion/keras/default_8bit
tensorflow_model_optimiz...erimental/default_n_bit
default_8bit_transforms.py
default_n_bit_transforms.py
 347:426 (13%)
288:367 (12%)
 view
44 x 2 tensorflow_model_optimiz...tion/keras/default_8bit
tensorflow_model_optimiz...erimental/default_n_bit
default_8bit_transforms.py
default_n_bit_transforms.py
 32:104 (10%)
31:103 (9%)
 view
41 x 2 tensorflow_model_optimiz...core/quantization/keras
tensorflow_model_optimiz...core/quantization/keras
quant_ops.py
quant_ops.py
 121:189 (23%)
218:286 (23%)
 view
32 x 2 tensorflow_model_optimiz...tion/keras/default_8bit
tensorflow_model_optimiz...erimental/default_n_bit
default_8bit_quantize_registry.py
default_n_bit_quantize_registry.py
 72:180 (10%)
81:189 (9%)
 view
26 x 2 tensorflow_model_optimiz...tion/keras/default_8bit
tensorflow_model_optimiz...erimental/default_n_bit
default_8bit_quantize_registry.py
default_n_bit_quantize_registry.py
 312:342 (8%)
350:380 (7%)
 view
24 x 2 tensorflow_model_optimiz...tion/keras/default_8bit
tensorflow_model_optimiz...erimental/default_n_bit
default_8bit_quantize_registry.py
default_n_bit_quantize_registry.py
 210:256 (8%)
238:284 (6%)
 view
22 x 2 tensorflow_model_optimiz...core/quantization/keras
tensorflow_model_optimiz...hon/core/sparsity/keras
quantize_annotate.py
pruning_wrapper.py
 122:150 (34%)
336:364 (12%)
 view
20 x 2 tensorflow_model_optimiz...ncoding/stages/research
tensorflow_model_optimiz...ncoding/stages/research
quantization.py
quantization.py
 223:256 (9%)
348:381 (9%)
 view
20 x 2 tensorflow_model_optimiz...ncoding/stages/research
tensorflow_model_optimiz...ncoding/stages/research
quantization.py
quantization.py
 105:134 (9%)
378:407 (9%)
 view
19 x 2 tensorflow_model_optimiz...antization/keras/layers
tensorflow_model_optimiz...antization/keras/layers
conv_batchnorm_test_utils.py
conv_batchnorm_test_utils.py
 63:84 (15%)
125:145 (15%)
 view
18 x 2 tensorflow_model_optimiz...tion/keras/default_8bit
tensorflow_model_optimiz...erimental/default_n_bit
default_8bit_quantize_registry.py
default_n_bit_quantize_registry.py
 430:451 (6%)
471:492 (5%)
 view
18 x 2 tensorflow_model_optimiz...tion/keras/default_8bit
tensorflow_model_optimiz...erimental/default_n_bit
default_8bit_quantize_registry.py
default_n_bit_quantize_registry.py
 406:427 (6%)
447:468 (5%)
 view
18 x 2 tensorflow_model_optimiz...n/core/clustering/keras
tensorflow_model_optimiz...core/quantization/keras
cluster_wrapper.py
quantize_wrapper.py
 369:391 (6%)
208:230 (13%)
 view
16 x 2 tensorflow_model_optimiz...tion/keras/default_8bit
tensorflow_model_optimiz...erimental/default_n_bit
default_8bit_quantize_registry.py
default_n_bit_quantize_registry.py
 262:287 (5%)
292:317 (4%)
 view
15 x 2 tensorflow_model_optimiz...tion/keras/default_8bit
tensorflow_model_optimiz...erimental/default_n_bit
default_8bit_quantize_registry.py
default_n_bit_quantize_registry.py
 470:490 (5%)
515:535 (4%)
 view
14 x 2 tensorflow_model_optimiz...tion/keras/default_8bit
tensorflow_model_optimiz...erimental/default_n_bit
default_8bit_transforms.py
default_n_bit_transforms.py
 148:165 (3%)
154:171 (3%)
 view
14 x 2 tensorflow_model_optimiz.../compression/algorithms
tensorflow_model_optimiz.../compression/algorithms
different_training_and_inference.py
periodical_update_and_scheduling.py
 44:62 (26%)
91:109 (15%)
 view
13 x 2 tensorflow_model_optimiz...tion/keras/default_8bit
tensorflow_model_optimiz...erimental/default_n_bit
default_8bit_transforms.py
default_n_bit_transforms.py
 592:609 (3%)
548:565 (2%)
 view
13 x 2 tensorflow_model_optimiz...tion/keras/default_8bit
tensorflow_model_optimiz...erimental/default_n_bit
default_8bit_quantize_configs.py
default_n_bit_quantize_configs.py
 44:63 (48%)
53:72 (38%)
 view
Duplicated Units
The list of top 13 duplicated units.
See data for all 13 unit duplicates...
Size#FoldersFilesLinesCode
64 x 2 tensorflow_model_optimiz...erimental/default_n_bit
tensorflow_model_optimiz...tion/keras/default_8bit
default_n_bit_transforms.py
default_8bit_transforms.py
 0:0 
0:0 
 view
16 x 2 tensorflow_model_optimiz.../compression/algorithms
tensorflow_model_optimiz.../compression/algorithms
different_training_and_inference.py
periodical_update_and_scheduling.py
 0:0 
0:0 
 view
16 x 2 tensorflow_model_optimiz...erimental/default_n_bit
tensorflow_model_optimiz...tion/keras/default_8bit
default_n_bit_transforms.py
default_8bit_transforms.py
 0:0 
0:0 
 view
12 x 2 tensorflow_model_optimiz...erimental/default_n_bit
tensorflow_model_optimiz...tion/keras/default_8bit
default_n_bit_quantize_registry.py
default_8bit_quantize_registry.py
 0:0 
0:0 
 view
11 x 2 tensorflow_model_optimiz...erimental/default_n_bit
tensorflow_model_optimiz...tion/keras/default_8bit
default_n_bit_quantizers.py
default_8bit_quantizers.py
 0:0 
0:0 
 view
11 x 2 tensorflow_model_optimiz.../tensor_encoding/stages
tensorflow_model_optimiz...ncoding/stages/research
stages_impl.py
kashin.py
 0:0 
0:0 
 view
16 x 2 tensorflow_model_optimiz...erimental/default_n_bit
tensorflow_model_optimiz...tion/keras/default_8bit
default_n_bit_quantize_registry.py
default_8bit_quantize_registry.py
 0:0 
0:0 
 view
7 x 2 tensorflow_model_optimiz...erimental/default_n_bit
tensorflow_model_optimiz...tion/keras/default_8bit
default_n_bit_transforms.py
default_8bit_transforms.py
 0:0 
0:0 
 view
7 x 2 tensorflow_model_optimiz.../tensor_encoding/stages
tensorflow_model_optimiz...ncoding/stages/research
stages_impl.py
clipping.py
 0:0 
0:0 
 view
6 x 2 tensorflow_model_optimiz...erimental/default_n_bit
tensorflow_model_optimiz...tion/keras/default_8bit
default_n_bit_quantize_registry.py
default_8bit_quantize_registry.py
 0:0 
0:0 
 view
6 x 2 tensorflow_model_optimiz...core/quantization/keras
tensorflow_model_optimiz...core/quantization/keras
quantizers.py
quantizers.py
 0:0 
0:0 
 view
6 x 2 tensorflow_model_optimiz...erimental/default_n_bit
tensorflow_model_optimiz...tion/keras/default_8bit
default_n_bit_transforms.py
default_8bit_transforms.py
 0:0 
0:0 
 view
7 x 2 tensorflow_model_optimiz...ations/cluster_preserve
tensorflow_model_optimiz...izations/prune_preserve
cluster_preserve_quantize_registry.py
prune_preserve_quantize_registry.py
 0:0 
0:0 
 view