apache / flink-ml
Duplication

Places in code with 6 or more lines that are exactly the same.

Intro
Learn more...
Duplication Overall
system18% (5,032 lines)
dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...
Duplication per Extension
java20% (4,805 lines)
py5% (227 lines)
Duplication per Component (primary)
flink-ml-iteration41% (2,633 lines)
flink-ml-lib13% (1,590 lines)
flink-ml-core14% (440 lines)
flink-ml-python5% (227 lines)
flink-ml-servable-core6% (103 lines)
flink-ml-benchmark7% (39 lines)
tools0% (0 lines)
flink-ml-dist0% (0 lines)
flink-ml-servable-lib0% (0 lines)

Duplication Between Components (50+ lines)

G flink-ml-core flink-ml-core flink-ml-iteration flink-ml-iteration flink-ml-core--flink-ml-iteration 300 flink-ml-servable-core flink-ml-servable-core flink-ml-core--flink-ml-servable-core 70 flink-ml-lib flink-ml-lib flink-ml-core--flink-ml-lib 64 flink-ml-iteration--flink-ml-servable-core 88 flink-ml-iteration--flink-ml-lib 60 flink-ml-lib--flink-ml-servable-core 70

Download: SVG DOT (open online Graphviz editor)

Open 3D force graph...

Show more details on duplication between components...
Longest Duplicates
The list of 50 longest duplicates.
See data for all 788 duplicates...
Size#FoldersFilesLinesCode
373 x 2 flink-ml-iteration/flink...ation/operator/perround
flink-ml-iteration/flink...ation/operator/perround
90:613 (90%)
90:613 (88%)
view
371 x 2 flink-ml-iteration/flink.../apache/flink/iteration
flink-ml-iteration/flink.../apache/flink/iteration
108:596 (100%)
108:596 (100%)
view
69 x 2 flink-ml-iteration/flink...k/iteration/proxy/state
flink-ml-iteration/flink...k/iteration/proxy/state
139:234 (52%)
139:234 (52%)
view
62 x 2 flink-ml-iteration/flink...link/iteration/operator
flink-ml-iteration/flink...link/iteration/operator
55:137 (60%)
54:136 (55%)
view
53 x 2 flink-ml-iteration/flink...k/iteration/proxy/state
flink-ml-iteration/flink...k/iteration/proxy/state
52:129 (40%)
52:129 (40%)
view
33 x 2 flink-ml-lib/src/main/ja.../feature/standardscaler
flink-ml-lib/src/main/ja.../feature/standardscaler
157:192 (19%)
235:270 (19%)
view
30 x 2 flink-ml-iteration/flink...ation/operator/perround
flink-ml-iteration/flink...ation/operator/perround
611:641 (7%)
615:645 (7%)
view
28 x 2 flink-ml-iteration/flink...on/operator/coordinator
flink-ml-iteration/flink...on/operator/coordinator
120:155 (37%)
121:156 (36%)
view
25 x 2 flink-ml-lib/src/main/ja...lassification/linearsvc
flink-ml-lib/src/main/ja...tion/logisticregression
80:106 (38%)
88:114 (33%)
view
25 x 2 flink-ml-lib/src/main/ja...lassification/linearsvc
flink-ml-lib/src/main/ja...ession/linearregression
80:106 (38%)
76:102 (38%)
view
25 x 2 flink-ml-lib/src/main/ja...tion/logisticregression
flink-ml-lib/src/main/ja...ession/linearregression
88:114 (33%)
76:102 (38%)
view
24 x 2 flink-ml-core/src/main/j...mmon/broadcast/operator
flink-ml-iteration/flink...ation/operator/allround
620:657 (6%)
201:238 (14%)
view
20 x 2 flink-ml-iteration/flink...ation/operator/allround
flink-ml-iteration/flink...ation/operator/perround
70:101 (42%)
70:100 (42%)
view
20 x 2 flink-ml-iteration/flink...ation/operator/allround
flink-ml-iteration/flink...ation/operator/perround
62:85 (32%)
88:111 (24%)
view
18 x 2 flink-ml-iteration/flink...ation/operator/perround
flink-ml-iteration/flink...ation/operator/allround
289:307 (4%)
127:145 (11%)
view
18 x 2 flink-ml-iteration/flink...ation/operator/allround
flink-ml-iteration/flink...ation/operator/perround
127:145 (11%)
289:307 (4%)
view
18 x 2 flink-ml-iteration/flink...link/iteration/operator
flink-ml-iteration/flink...link/iteration/operator
164:186 (17%)
152:174 (16%)
view
18 x 2 flink-ml-core/src/main/j.../common/datastream/sort
flink-ml-core/src/main/j.../common/datastream/sort
157:186 (19%)
162:191 (18%)
view
17 x 2 flink-ml-iteration/flink...on/operator/coordinator
flink-ml-iteration/flink...on/operator/coordinator
90:117 (22%)
81:108 (22%)
view
17 x 2 flink-ml-core/src/main/j...apache/flink/ml/builder
flink-ml-core/src/main/j...apache/flink/ml/builder
92:114 (21%)
85:107 (22%)
view
16 x 2 flink-ml-lib/src/main/ja...l/feature/stringindexer
flink-ml-lib/src/main/ja...l/feature/stringindexer
86:106 (19%)
90:110 (13%)
view
15 x 2 flink-ml-core/src/main/j...mmon/broadcast/operator
flink-ml-iteration/flink...ation/operator/perround
489:503 (4%)
253:267 (3%)
view
15 x 2 flink-ml-core/src/main/j...mmon/broadcast/operator
flink-ml-iteration/flink...ation/operator/perround
489:503 (4%)
253:267 (3%)
view
15 x 2 flink-ml-lib/src/main/ja...lassification/linearsvc
flink-ml-lib/src/main/ja...ession/linearregression
59:74 (23%)
61:75 (23%)
view
14 x 2 flink-ml-lib/src/main/ja...lassification/linearsvc
flink-ml-lib/src/main/ja...tion/logisticregression
60:74 (21%)
66:80 (18%)
view
14 x 2 flink-ml-lib/src/main/ja...tion/logisticregression
flink-ml-lib/src/main/ja...ession/linearregression
66:80 (18%)
62:75 (21%)
view
14 x 2 flink-ml-lib/src/main/ja...tion/logisticregression
flink-ml-lib/src/main/ja...nk/ml/clustering/kmeans
117:133 (12%)
149:166 (14%)
view
14 x 2 flink-ml-lib/src/main/ja...ture/elementwiseproduct
flink-ml-lib/src/main/ja...ure/polynomialexpansion
57:72 (26%)
63:80 (8%)
view
14 x 2 flink-ml-iteration/flink...link/iteration/operator
flink-ml-iteration/flink...link/iteration/operator
189:203 (4%)
124:138 (8%)
view
14 x 2 flink-ml-iteration/flink...tion/compile/translator
flink-ml-iteration/flink...tion/compile/translator
46:59 (56%)
47:60 (48%)
view
13 x 2 flink-ml-lib/src/main/ja...ture/elementwiseproduct
flink-ml-lib/src/main/ja...ml/feature/vectorslicer
57:71 (24%)
59:73 (19%)
view
13 x 2 flink-ml-lib/src/main/ja...k/ml/feature/normalizer
flink-ml-lib/src/main/ja...ml/feature/vectorslicer
50:66 (32%)
59:73 (19%)
view
13 x 2 flink-ml-core/src/main/j.../common/datastream/sort
flink-ml-core/src/main/j.../common/datastream/sort
76:94 (13%)
70:88 (13%)
view
13 x 2 flink-ml-lib/src/main/ja.../ml/feature/interaction
flink-ml-lib/src/main/ja...k/ml/feature/normalizer
61:77 (13%)
50:66 (32%)
view
13 x 2 flink-ml-iteration/flink...tion/datacache/nonkeyed
flink-ml-iteration/flink...tion/datacache/nonkeyed
57:77 (44%)
52:72 (23%)
view
13 x 2 flink-ml-lib/src/main/ja...ure/polynomialexpansion
flink-ml-lib/src/main/ja...ml/feature/vectorslicer
63:79 (7%)
59:73 (19%)
view
13 x 2 flink-ml-lib/src/main/ja...ture/elementwiseproduct
flink-ml-lib/src/main/ja.../ml/feature/interaction
57:71 (24%)
61:77 (13%)
view
13 x 2 flink-ml-lib/src/main/ja.../ml/feature/interaction
flink-ml-lib/src/main/ja...ure/polynomialexpansion
61:77 (13%)
63:79 (7%)
view
13 x 2 flink-ml-servable-core/s...link/ml/linalg/typeinfo
flink-ml-servable-core/s...link/ml/linalg/typeinfo
34:54 (36%)
29:49 (38%)
view
13 x 2 flink-ml-lib/src/main/ja...k/ml/feature/normalizer
flink-ml-lib/src/main/ja...ure/polynomialexpansion
50:66 (32%)
63:79 (7%)
view
13 x 2 flink-ml-lib/src/main/ja...ture/elementwiseproduct
flink-ml-lib/src/main/ja...k/ml/feature/normalizer
57:71 (24%)
50:66 (32%)
view
13 x 2 flink-ml-lib/src/main/ja.../ml/feature/interaction
flink-ml-lib/src/main/ja...ml/feature/vectorslicer
61:77 (13%)
59:73 (19%)
view
13 x 2 flink-ml-core/src/main/j...mmon/broadcast/typeinfo
flink-ml-lib/src/main/ja...link/ml/common/typeinfo
40:60 (30%)
50:70 (26%)
view
13 x 2 flink-ml-lib/src/main/ja...link/ml/stats/anovatest
flink-ml-lib/src/main/ja...ink/ml/stats/fvaluetest
93:106 (7%)
99:112 (5%)
view
12 x 2 flink-ml-lib/src/main/ja...k/ml/classification/knn
flink-ml-lib/src/main/ja...ml/feature/maxabsscaler
62:77 (11%)
60:76 (15%)
view
12 x 2 flink-ml-lib/src/main/ja...k/ml/classification/knn
flink-ml-lib/src/main/ja...ml/feature/minmaxscaler
62:77 (11%)
59:74 (12%)
view
12 x 2 flink-ml-lib/src/main/ja...he/flink/ml/feature/idf
flink-ml-lib/src/main/ja...eature/kbinsdiscretizer
94:111 (16%)
102:119 (14%)
view
12 x 2 flink-ml-iteration/flink...on/operator/coordinator
flink-ml-iteration/flink...on/operator/coordinator
42:61 (16%)
42:61 (15%)
view
12 x 2 flink-ml-lib/src/main/ja...ml/feature/maxabsscaler
flink-ml-lib/src/main/ja...ml/feature/minmaxscaler
60:76 (15%)
59:74 (12%)
view
12 x 2 flink-ml-core/src/main/j...mmon/broadcast/typeinfo
flink-ml-iteration/flink...link/iteration/typeinfo
41:60 (28%)
41:60 (27%)
view
Duplicated Units
The list of top 38 duplicated units.
See data for all 38 unit duplicates...
Size#FoldersFilesLinesCode
96 x 2 flink-ml-iteration/flink.../apache/flink/iteration
flink-ml-iteration/flink.../apache/flink/iteration
178:291 
178:291 
view
54 x 2 flink-ml-iteration/flink...ation/operator/perround
flink-ml-iteration/flink...ation/operator/perround
285:352 
285:352 
view
49 x 2 flink-ml-iteration/flink...k/iteration/proxy/state
flink-ml-iteration/flink...k/iteration/proxy/state
143:193 
143:193 
view
43 x 2 flink-ml-iteration/flink...ation/operator/perround
flink-ml-iteration/flink...ation/operator/perround
510:555 
510:555 
view
42 x 2 flink-ml-iteration/flink.../apache/flink/iteration
flink-ml-iteration/flink.../apache/flink/iteration
331:385 
331:385 
view
31 x 2 flink-ml-iteration/flink...ation/operator/perround
flink-ml-iteration/flink...ation/operator/perround
247:282 
247:282 
view
30 x 2 flink-ml-iteration/flink.../apache/flink/iteration
flink-ml-iteration/flink.../apache/flink/iteration
293:329 
293:329 
view
29 x 2 flink-ml-iteration/flink...ation/operator/perround
flink-ml-iteration/flink...ation/operator/perround
399:440 
399:440 
view
27 x 2 flink-ml-iteration/flink...ation/operator/perround
flink-ml-iteration/flink...ation/operator/perround
151:182 
151:182 
view
24 x 2 flink-ml-iteration/flink.../apache/flink/iteration
flink-ml-iteration/flink.../apache/flink/iteration
448:474 
448:474 
view
23 x 2 flink-ml-iteration/flink.../apache/flink/iteration
flink-ml-iteration/flink.../apache/flink/iteration
502:526 
502:526 
view
22 x 2 flink-ml-iteration/flink.../apache/flink/iteration
flink-ml-iteration/flink.../apache/flink/iteration
149:175 
149:175 
view
21 x 2 flink-ml-iteration/flink.../apache/flink/iteration
flink-ml-iteration/flink.../apache/flink/iteration
388:410 
388:410 
view
21 x 2 flink-ml-iteration/flink...ation/operator/perround
flink-ml-iteration/flink...ation/operator/perround
207:234 
207:234 
view
21 x 2 flink-ml-iteration/flink...ation/operator/perround
flink-ml-iteration/flink...ation/operator/perround
557:579 
557:579 
view
20 x 2 flink-ml-iteration/flink.../apache/flink/iteration
flink-ml-iteration/flink.../apache/flink/iteration
476:499 
476:499 
view
20 x 2 flink-ml-iteration/flink...ation/operator/perround
flink-ml-iteration/flink...ation/operator/perround
581:603 
581:603 
view
18 x 2 flink-ml-iteration/flink...ation/operator/allround
flink-ml-iteration/flink...ation/operator/perround
62:82 
88:108 
view
15 x 2 flink-ml-iteration/flink...link/iteration/operator
flink-ml-iteration/flink...link/iteration/operator
79:95 
80:96 
view
15 x 2 flink-ml-iteration/flink...ation/operator/perround
flink-ml-iteration/flink...ation/operator/perround
184:204 
184:204 
view
14 x 2 flink-ml-iteration/flink.../apache/flink/iteration
flink-ml-iteration/flink.../apache/flink/iteration
413:429 
413:429 
view
14 x 2 flink-ml-iteration/flink...on/operator/coordinator
flink-ml-iteration/flink...on/operator/coordinator
142:157 
141:156 
view
14 x 2 flink-ml-iteration/flink...ation/operator/perround
flink-ml-iteration/flink...ation/operator/perround
381:396 
381:396 
view
10 x 2 flink-ml-iteration/flink.../apache/flink/iteration
flink-ml-iteration/flink.../apache/flink/iteration
435:446 
435:446 
view
10 x 2 flink-ml-iteration/flink.../apache/flink/iteration
flink-ml-iteration/flink.../apache/flink/iteration
550:561 
550:561 
view
9 x 2 flink-ml-iteration/flink...link/iteration/operator
flink-ml-iteration/flink...link/iteration/operator
67:77 
68:78 
view
9 x 2 flink-ml-iteration/flink...link/iteration/operator
flink-ml-iteration/flink...link/iteration/operator
165:175 
177:187 
view
8 x 2 flink-ml-iteration/flink.../apache/flink/iteration
flink-ml-iteration/flink.../apache/flink/iteration
123:132 
123:132 
view
8 x 2 flink-ml-iteration/flink.../apache/flink/iteration
flink-ml-iteration/flink.../apache/flink/iteration
528:538 
528:538 
view
7 x 2 flink-ml-iteration/flink.../apache/flink/iteration
flink-ml-iteration/flink.../apache/flink/iteration
540:548 
540:548 
view
7 x 2 flink-ml-iteration/flink.../apache/flink/iteration
flink-ml-iteration/flink.../apache/flink/iteration
573:582 
573:582 
view
7 x 2 flink-ml-iteration/flink...k/iteration/proxy/state
flink-ml-iteration/flink...k/iteration/proxy/state
80:88 
80:88 
view
7 x 2 flink-ml-iteration/flink...link/iteration/operator
flink-ml-iteration/flink...link/iteration/operator
155:163 
167:175 
view
7 x 2 flink-ml-iteration/flink...ation/operator/perround
flink-ml-iteration/flink...ation/operator/perround
454:462 
454:462 
view
7 x 2 flink-ml-core/src/main/j.../common/datastream/sort
flink-ml-core/src/main/j.../common/datastream/sort
84:92 
78:86 
view
7 x 2 flink-ml-lib/src/main/java/org/apache/flink/ml
flink-ml-benchmark/src/m...atagenerator/clustering
97:105 
85:93 
view
6 x 2 flink-ml-iteration/flink...k/iteration/proxy/state
flink-ml-iteration/flink...k/iteration/proxy/state
109:116 
109:116 
view
6 x 2 flink-ml-iteration/flink...ation/operator/allround
flink-ml-iteration/flink...ation/operator/allround
82:90 
115:123 
view