apache / incubator-paimon
Duplication

Places in code with 6 or more lines that are exactly the same.

Intro
Learn more...
Duplication Overall
system10% (7,432 lines)
dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...
Duplication per Extension
java10% (7,326 lines)
g48% (58 lines)
scala1% (30 lines)
sql28% (18 lines)
Duplication per Component (primary)
paimon-common11% (2,333 lines)
paimon-flink14% (2,067 lines)
paimon-core7% (1,489 lines)
paimon-filesystems25% (616 lines)
paimon-format5% (335 lines)
paimon-spark12% (233 lines)
paimon-hive6% (173 lines)
paimon-benchmark5% (144 lines)
paimon-codegen2% (42 lines)
tools0% (0 lines)
paimon-codegen-loader0% (0 lines)

Duplication Between Components (50+ lines)

G paimon-common paimon-common paimon-flink paimon-flink paimon-common--paimon-flink 924 paimon-filesystems paimon-filesystems paimon-common--paimon-filesystems 569 paimon-core paimon-core paimon-common--paimon-core 434 paimon-hive paimon-hive paimon-common--paimon-hive 202 paimon-spark paimon-spark paimon-common--paimon-spark 174 paimon-flink--paimon-hive 78 paimon-flink--paimon-spark 66 paimon-filesystems--paimon-flink 180 paimon-core--paimon-flink 397 paimon-core--paimon-filesystems 222 paimon-core--paimon-hive 216 paimon-core--paimon-spark 216 paimon-benchmark paimon-benchmark paimon-benchmark--paimon-common 258 paimon-benchmark--paimon-flink 66 paimon-benchmark--paimon-core 216 paimon-codegen paimon-codegen paimon-codegen--paimon-common 180 paimon-codegen--paimon-flink 72 paimon-codegen--paimon-core 222 paimon-hive--paimon-spark 204

Download: SVG DOT (open online Graphviz editor)

Open 3D force graph...

Show more details on duplication between components...
Longest Duplicates
The list of 50 longest duplicates.
See data for all 3,974 duplicates...
Size#FoldersFilesLinesCode
121 x 2 paimon-filesystems/paimo...a/org/apache/paimon/oss
paimon-filesystems/paimo...va/org/apache/paimon/s3
38:273 (100%)
38:273 (100%)
view
85 x 2 paimon-flink/paimon-flin...e/paimon/flink/sink/cdc
paimon-flink/paimon-flin...e/paimon/flink/sink/cdc
120:242 (64%)
136:258 (60%)
view
51 x 2 paimon-common/src/main/j...org/apache/paimon/utils
paimon-common/src/main/j...org/apache/paimon/utils
64:148 (66%)
84:168 (54%)
view
49 x 2 paimon-common/src/main/j...apache/paimon/fs/hadoop
paimon-filesystems/paimo...a/org/apache/paimon/oss
60:131 (37%)
44:115 (40%)
view
49 x 2 paimon-common/src/main/j...apache/paimon/fs/hadoop
paimon-filesystems/paimo...va/org/apache/paimon/s3
60:131 (37%)
44:115 (40%)
view
46 x 2 paimon-common/src/main/java/org/apache/paimon/data
paimon-common/src/main/java/org/apache/paimon/io
411:468 (15%)
255:312 (18%)
view
42 x 2 paimon-hive/paimon-hive-...on/hive/objectinspector
paimon-spark/paimon-spar...org/apache/paimon/spark
134:194 (40%)
302:362 (21%)
view
42 x 2 paimon-benchmark/paimon-...on/benchmark/metric/cpu
paimon-common/src/main/j...org/apache/paimon/utils
22:150 (100%)
22:150 (100%)
view
34 x 2 paimon-common/src/main/j...apache/paimon/fs/hadoop
paimon-filesystems/paimo...va/org/apache/paimon/s3
138:234 (25%)
121:217 (28%)
view
34 x 2 paimon-common/src/main/j...apache/paimon/fs/hadoop
paimon-filesystems/paimo...a/org/apache/paimon/oss
138:234 (25%)
121:217 (28%)
view
32 x 2 paimon-common/src/main/j...apache/paimon/fs/hadoop
paimon-filesystems/paimo...va/org/apache/paimon/s3
236:290 (24%)
219:273 (26%)
view
32 x 2 paimon-common/src/main/j...apache/paimon/fs/hadoop
paimon-filesystems/paimo...a/org/apache/paimon/oss
236:290 (24%)
219:273 (26%)
view
29 x 2 paimon-flink/paimon-flin...org/apache/paimon/flink
paimon-flink/paimon-flin...org/apache/paimon/flink
153:201 (16%)
141:189 (16%)
view
29 x 2 paimon-common/src/main/antlr4
paimon-common/src/main/antlr4
1:32 (15%)
1:32 (5%)
view
28 x 2 paimon-common/src/main/j...he/paimon/data/columnar
paimon-common/src/main/j...he/paimon/data/columnar
138:183 (20%)
168:213 (24%)
view
27 x 2 paimon-filesystems/paimo...a/org/apache/paimon/oss
paimon-filesystems/paimo...va/org/apache/paimon/s3
121:158 (35%)
124:161 (33%)
view
26 x 2 paimon-core/src/main/jav...pache/paimon/table/sink
paimon-flink/paimon-flin...org/apache/paimon/flink
59:100 (41%)
61:102 (14%)
view
26 x 2 paimon-spark/paimon-spar...org/apache/paimon/spark
paimon-spark/paimon-spar...org/apache/paimon/spark
57:93 (39%)
45:81 (72%)
view
25 x 2 paimon-common/src/main/j...org/apache/paimon/utils
paimon-common/src/main/j...org/apache/paimon/utils
104:155 (15%)
192:243 (15%)
view
25 x 2 paimon-common/src/main/j...org/apache/paimon/utils
paimon-flink/paimon-flin...org/apache/paimon/flink
62:102 (32%)
79:119 (26%)
view
25 x 2 paimon-flink/paimon-flin...org/apache/paimon/flink
paimon-flink/paimon-flin...org/apache/paimon/flink
68:108 (14%)
61:101 (14%)
view
25 x 2 paimon-core/src/main/jav...pache/paimon/table/sink
paimon-flink/paimon-flin...org/apache/paimon/flink
59:99 (40%)
68:108 (14%)
view
24 x 2 paimon-common/src/main/j...org/apache/paimon/utils
paimon-flink/paimon-flin...org/apache/paimon/flink
161:198 (12%)
93:130 (22%)
view
24 x 2 paimon-flink/paimon-flin...pache/paimon/flink/sink
paimon-flink/paimon-flin...pache/paimon/flink/sink
51:84 (58%)
83:116 (39%)
view
23 x 2 paimon-filesystems/paimo...ices/s3/model/transform
paimon-filesystems/paimo...ices/s3/model/transform
731:761 (1%)
878:908 (1%)
view
23 x 2 paimon-common/src/main/j...org/apache/paimon/utils
paimon-flink/paimon-flin...org/apache/paimon/flink
84:122 (24%)
81:119 (24%)
view
22 x 2 paimon-spark/paimon-spar...org/apache/paimon/spark
paimon-spark/paimon-spar...org/apache/paimon/spark
31:61 (95%)
31:61 (95%)
view
21 x 2 paimon-flink/paimon-flin...pache/paimon/flink/sink
paimon-flink/paimon-flin...pache/paimon/flink/sink
45:67 (41%)
104:126 (23%)
view
21 x 2 paimon-flink/paimon-flin...org/apache/paimon/flink
paimon-flink/paimon-flin...org/apache/paimon/flink
241:273 (11%)
224:256 (12%)
view
21 x 2 paimon-common/src/main/java/org/apache/paimon/data
paimon-common/src/main/java/org/apache/paimon/data
859:883 (3%)
957:981 (3%)
view
20 x 2 paimon-common/src/main/java/org/apache/paimon/data
paimon-common/src/main/java/org/apache/paimon/data
887:911 (3%)
985:1009 (3%)
view
20 x 2 paimon-flink/paimon-flin.../flink/action/cdc/kafka
paimon-flink/paimon-flin.../flink/action/cdc/mysql
162:184 (21%)
263:286 (7%)
view
20 x 2 paimon-flink/paimon-flin...ache/paimon/flink/utils
paimon-flink/paimon-flin...ache/paimon/flink/utils
43:63 (76%)
43:63 (76%)
view
19 x 2 paimon-common/src/main/java/org/apache/paimon/fs
paimon-flink/paimon-flin...org/apache/paimon/flink
29:59 (86%)
169:199 (16%)
view
19 x 2 paimon-flink/paimon-flin.../flink/action/cdc/kafka
paimon-flink/paimon-flin.../flink/action/cdc/mysql
40:64 (19%)
40:65 (19%)
view
19 x 2 paimon-common/src/main/java/org/apache/paimon/data
paimon-common/src/main/java/org/apache/paimon/io
323:346 (8%)
268:291 (9%)
view
19 x 2 paimon-flink/paimon-flin...pache/paimon/flink/sink
paimon-flink/paimon-flin...pache/paimon/flink/sink
72:94 (37%)
131:153 (21%)
view
18 x 2 paimon-common/src/main/java/org/apache/paimon/data
paimon-common/src/main/java/org/apache/paimon/data
361:389 (5%)
115:143 (9%)
view
17 x 2 paimon-filesystems/paimo...a/org/apache/paimon/oss
paimon-filesystems/paimo...va/org/apache/paimon/s3
100:116 (22%)
103:119 (21%)
view
16 x 2 paimon-flink/paimon-flin.../action/cdc/kafka/canal
paimon-flink/paimon-flin.../flink/action/cdc/mysql
295:318 (8%)
433:456 (5%)
view
16 x 2 paimon-core/src/main/jav...apache/paimon/operation
paimon-core/src/main/jav...apache/paimon/operation
44:59 (40%)
46:61 (38%)
view
16 x 2 paimon-spark/paimon-spar...org/apache/paimon/spark
paimon-spark/paimon-spar...org/apache/paimon/spark
93:117 (24%)
85:109 (30%)
view
16 x 2 paimon-common/src/main/j...org/apache/paimon/utils
paimon-flink/paimon-flin...org/apache/paimon/flink
154:175 (17%)
156:177 (16%)
view
15 x 2 paimon-common/src/main/java/org/apache/paimon/fs
paimon-common/src/main/j.../apache/paimon/fs/local
37:59 (68%)
288:310 (8%)
view
15 x 2 paimon-common/src/main/j...apache/paimon/fs/hadoop
paimon-flink/paimon-flin...org/apache/paimon/flink
231:255 (11%)
169:193 (12%)
view
15 x 2 paimon-core/src/main/jav...aimon/mergetree/compact
paimon-core/src/main/jav...aimon/mergetree/compact
50:64 (21%)
46:60 (35%)
view
15 x 2 paimon-flink/paimon-flin.../flink/action/cdc/kafka
paimon-flink/paimon-flin.../flink/action/cdc/mysql
87:103 (15%)
131:147 (10%)
view
15 x 2 paimon-common/src/main/j...org/apache/paimon/utils
paimon-common/src/main/j...org/apache/paimon/utils
175:193 (3%)
491:509 (3%)
view
15 x 2 paimon-core/src/main/java/org/apache/paimon
paimon-core/src/main/java/org/apache/paimon
187:201 (5%)
413:427 (5%)
view
15 x 2 paimon-flink/paimon-flin...imon/flink/source/table
paimon-flink/paimon-flin...imon/flink/source/table
29:51 (100%)
29:51 (100%)
view
Duplicated Units
The list of top 28 duplicated units.
See data for all 28 unit duplicates...
Size#FoldersFilesLinesCode
40 x 2 paimon-filesystems/paimo...a/org/apache/paimon/oss
paimon-filesystems/paimo...va/org/apache/paimon/s3
118:207 
118:207 
view
28 x 2 paimon-flink/paimon-flin...e/paimon/flink/sink/cdc
paimon-flink/paimon-flin...e/paimon/flink/sink/cdc
187:221 
203:237 
view
19 x 2 paimon-benchmark/paimon-...on/benchmark/metric/cpu
paimon-common/src/main/j...org/apache/paimon/utils
103:125 
103:125 
view
16 x 2 paimon-spark/paimon-spar...org/apache/paimon/spark
paimon-spark/paimon-spar...org/apache/paimon/spark
86:107 
94:115 
view
15 x 2 paimon-flink/paimon-flin.../flink/action/cdc/kafka
paimon-flink/paimon-flin.../flink/action/cdc/mysql
169:185 
271:287 
view
12 x 2 paimon-flink/paimon-flin...org/apache/paimon/flink
paimon-flink/paimon-flin...org/apache/paimon/flink
304:317 
320:333 
view
11 x 2 paimon-flink/paimon-flin...org/apache/paimon/flink
paimon-common/src/main/j...org/apache/paimon/utils
94:106 
162:174 
view
10 x 2 paimon-filesystems/paimo...a/org/apache/paimon/oss
paimon-filesystems/paimo...va/org/apache/paimon/s3
143:154 
146:157 
view
10 x 2 paimon-flink/paimon-flin...che/paimon/flink/action
paimon-flink/paimon-flin...che/paimon/flink/action
32:45 
37:50 
view
10 x 2 paimon-flink/paimon-flin.../action/cdc/kafka/canal
paimon-flink/paimon-flin.../flink/action/cdc/mysql
308:319 
446:457 
view
9 x 2 paimon-flink/paimon-flin...pache/paimon/flink/sink
paimon-flink/paimon-flin...pache/paimon/flink/sink
108:118 
76:86 
view
9 x 2 paimon-core/src/main/jav...pache/paimon/table/sink
paimon-core/src/main/jav...pache/paimon/table/sink
102:112 
92:102 
view
8 x 3 paimon-filesystems/paimo...a/org/apache/paimon/oss
paimon-filesystems/paimo...va/org/apache/paimon/s3
paimon-common/src/main/j...apache/paimon/fs/hadoop
107:116 
107:116 
123:132 
view
8 x 2 paimon-flink/paimon-flin...pache/paimon/flink/sink
paimon-flink/paimon-flin...pache/paimon/flink/sink
81:90 
49:58 
view
8 x 3 paimon-core/src/main/jav...n/table/source/snapshot
paimon-core/src/main/jav...n/table/source/snapshot
paimon-core/src/main/jav...n/table/source/snapshot
34:44 
34:44 
34:44 
view
7 x 2 paimon-flink/paimon-flin...org/apache/paimon/flink
paimon-common/src/main/j...org/apache/paimon/utils
170:178 
168:176 
view
7 x 2 paimon-flink/paimon-flin...che/paimon/flink/source
paimon-flink/paimon-flin...n/flink/source/operator
106:114 
215:224 
view
7 x 2 paimon-flink/paimon-flin...paimon/flink/sink/index
paimon-flink/paimon-flin...che/paimon/flink/lookup
195:204 
219:228 
view
7 x 2 paimon-flink/paimon-flin...che/paimon/flink/action
paimon-flink/paimon-flin...che/paimon/flink/action
54:63 
52:61 
view
7 x 2 paimon-core/src/main/jav...apache/paimon/mergetree
paimon-core/src/main/jav...apache/paimon/mergetree
130:138 
142:150 
view
7 x 2 paimon-spark/paimon-spar...org/apache/paimon/spark
paimon-spark/paimon-spar...org/apache/paimon/spark
71:79 
83:91 
view
6 x 2 paimon-flink/paimon-flin...e/paimon/flink/sink/cdc
paimon-flink/paimon-flin...e/paimon/flink/sink/cdc
47:54 
53:60 
view
6 x 2 paimon-flink/paimon-flin...pache/paimon/flink/sink
paimon-core/src/main/jav.../apache/paimon/manifest
107:114 
98:105 
view
6 x 3 paimon-flink/paimon-flin...che/paimon/flink/lookup
paimon-flink/paimon-flin...che/paimon/flink/lookup
paimon-flink/paimon-flin...che/paimon/flink/lookup
36:43 
36:43 
40:47 
view
6 x 2 paimon-core/src/main/jav...apache/paimon/operation
paimon-core/src/main/jav...apache/paimon/operation
41:48 
51:58 
view
6 x 2 paimon-core/src/main/jav...che/paimon/table/source
paimon-core/src/main/jav...che/paimon/table/source
103:110 
39:46 
view
6 x 2 paimon-core/src/main/jav...pache/paimon/table/sink
paimon-core/src/main/jav...pache/paimon/table/sink
33:40 
29:36 
view
6 x 2 paimon-format/src/main/j...pache/paimon/format/orc
paimon-format/src/main/j...e/paimon/format/parquet
235:242 
341:348 
view