apache / sedona
Duplication

Places in code with 6 or more lines that are exactly the same.

Intro
Learn more...
Duplication Overall
system25% (14,097 lines)
dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...
Duplication per Extension
scala46% (9,241 lines)
java14% (3,701 lines)
py15% (1,103 lines)
c4% (52 lines)
Duplication per Component (primary)
spark38% (11,378 lines)
python13% (1,155 lines)
common7% (764 lines)
flink25% (626 lines)
snowflake6% (174 lines)
tools0% (0 lines)
docs-overrides0% (0 lines)
ROOT0% (0 lines)
zeppelin0% (0 lines)
docker0% (0 lines)
Longest Duplicates
The list of 50 longest duplicates.
See data for all 2,079 duplicates...
Size#FoldersFilesLinesCode
312 x 2 spark/spark-3.4/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
108:631 (93%)
109:632 (93%)
view
291 x 2 spark/spark-3.4/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
50:611 (100%)
50:611 (100%)
view
263 x 2 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.4/src/main...ion/datasources/parquet
78:599 (91%)
90:611 (90%)
view
263 x 2 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
78:599 (91%)
90:611 (90%)
view
200 x 2 spark/spark-3.4/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
393:775 (50%)
396:778 (50%)
view
187 x 2 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.4/src/main...ion/datasources/parquet
385:743 (50%)
417:775 (47%)
view
187 x 2 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
385:743 (50%)
420:778 (47%)
view
166 x 2 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.4/src/main...ion/datasources/parquet
62:306 (50%)
62:306 (50%)
view
162 x 2 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
311:626 (49%)
317:632 (48%)
view
162 x 2 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.4/src/main...ion/datasources/parquet
311:626 (49%)
316:631 (48%)
view
161 x 2 spark/spark-3.4/src/main...l/datasources/shapefile
spark/spark-3.5/src/main...l/datasources/shapefile
54:284 (100%)
54:284 (100%)
view
151 x 2 spark/spark-3.3/src/main...l/datasources/shapefile
spark/spark-3.5/src/main...l/datasources/shapefile
65:284 (93%)
65:284 (93%)
view
151 x 2 spark/spark-3.3/src/main...l/datasources/shapefile
spark/spark-3.4/src/main...l/datasources/shapefile
65:284 (93%)
65:284 (93%)
view
146 x 2 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
108:306 (44%)
109:307 (43%)
view
141 x 2 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.4/src/main...ion/datasources/parquet
89:295 (37%)
91:297 (35%)
view
126 x 2 python/sedona/geopandas
python/sedona/geopandas
311:534 (44%)
280:503 (45%)
view
113 x 2 spark/spark-3.4/src/main...l/datasources/shapefile
spark/spark-3.5/src/main...l/datasources/shapefile
39:199 (100%)
39:199 (100%)
view
113 x 2 spark/spark-3.3/src/main...l/datasources/shapefile
spark/spark-3.5/src/main...l/datasources/shapefile
39:199 (100%)
39:199 (100%)
view
113 x 2 spark/spark-3.3/src/main...l/datasources/shapefile
spark/spark-3.4/src/main...l/datasources/shapefile
39:199 (100%)
39:199 (100%)
view
88 x 2 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.4/src/main...ion/datasources/parquet
69:197 (34%)
76:204 (32%)
view
81 x 2 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.4/src/main...ion/datasources/parquet
31:145 (100%)
31:145 (100%)
view
74 x 2 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.4/src/main...ion/datasources/parquet
252:377 (28%)
270:395 (27%)
view
74 x 2 spark/spark-3.4/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
266:390 (18%)
269:393 (18%)
view
65 x 2 spark/spark-3.4/src/main.../v2/geoparquet/metadata
spark/spark-3.5/src/main.../v2/geoparquet/metadata
41:119 (100%)
41:120 (100%)
view
61 x 2 spark/spark-3.4/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
357:453 (22%)
348:444 (23%)
view
60 x 2 spark/spark-3.4/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
160:248 (15%)
163:251 (15%)
view
60 x 2 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
158:246 (16%)
163:251 (15%)
view
59 x 2 spark/spark-3.4/src/main...l/datasources/shapefile
spark/spark-3.5/src/main...l/datasources/shapefile
41:117 (100%)
41:117 (100%)
view
57 x 2 spark/common/src/main/sc.../sedona_sql/expressions
spark/common/src/main/sc.../sedona_sql/expressions
656:712 (4%)
1307:1363 (4%)
view
54 x 2 spark/common/src/main/sc.../sedona_sql/expressions
spark/common/src/main/sc.../sedona_sql/expressions
578:631 (4%)
1233:1286 (4%)
view
51 x 2 spark/common/src/main/sc.../sedona_sql/expressions
spark/common/src/main/sc.../sedona_sql/expressions
504:554 (4%)
1163:1213 (4%)
view
50 x 2 spark/spark-3.3/src/main...l/datasources/shapefile
spark/spark-3.5/src/main...l/datasources/shapefile
37:102 (100%)
37:102 (100%)
view
50 x 2 spark/spark-3.3/src/main...l/datasources/shapefile
spark/spark-3.4/src/main...l/datasources/shapefile
37:102 (100%)
37:102 (100%)
view
50 x 2 spark/spark-3.4/src/main...l/datasources/shapefile
spark/spark-3.5/src/main...l/datasources/shapefile
37:102 (100%)
37:102 (100%)
view
48 x 2 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
28:123 (100%)
28:123 (100%)
view
48 x 2 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.4/src/main...ion/datasources/parquet
28:123 (100%)
28:123 (100%)
view
48 x 2 spark/spark-3.4/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
28:123 (100%)
28:123 (100%)
view
47 x 2 spark/common/src/main/sc.../sedona_sql/expressions
spark/common/src/main/sc.../sedona_sql/expressions
448:494 (3%)
1111:1157 (3%)
view
46 x 2 spark/spark-3.4/src/main.../datasources/geopackage
spark/spark-3.5/src/main.../datasources/geopackage
34:104 (100%)
34:104 (100%)
view
44 x 2 spark/common/src/main/sc.../sedona_sql/expressions
spark/common/src/main/sc.../sedona_sql/expressions
395:438 (3%)
1062:1105 (3%)
view
42 x 2 spark/spark-3.4/src/main.../datasources/geopackage
spark/spark-3.5/src/main.../datasources/geopackage
33:86 (100%)
33:86 (100%)
view
42 x 2 spark/common/src/main/ja.../apache/sedona/viz/core
spark/common/src/main/ja.../apache/sedona/viz/core
81:126 (19%)
282:327 (19%)
view
41 x 2 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.4/src/main...ion/datasources/parquet
384:435 (15%)
402:453 (15%)
view
41 x 2 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
384:435 (15%)
393:444 (15%)
view
40 x 2 spark/spark-3.3/src/main...l/datasources/shapefile
spark/spark-3.5/src/main...l/datasources/shapefile
45:97 (100%)
45:97 (100%)
view
40 x 2 spark/common/src/main/sc.../sedona_sql/expressions
spark/common/src/main/sc.../sedona_sql/expressions
346:385 (3%)
1017:1056 (3%)
view
40 x 2 spark/spark-3.3/src/main...l/datasources/shapefile
spark/spark-3.4/src/main...l/datasources/shapefile
45:97 (100%)
45:97 (100%)
view
40 x 2 spark/spark-3.4/src/main...l/datasources/shapefile
spark/spark-3.5/src/main...l/datasources/shapefile
45:97 (100%)
45:97 (100%)
view
39 x 2 spark/spark-3.4/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
142:194 (14%)
138:190 (14%)
view
39 x 2 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
135:187 (15%)
138:190 (14%)
view
Duplicated Units
The list of top 50 duplicated units.
See data for all 90 unit duplicates...
Size#FoldersFilesLinesCode
118 x 3 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.4/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
358:589 
370:601 
370:601 
view
77 x 2 spark/spark-3.4/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
254:355 
255:356 
view
75 x 3 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.4/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
115:201 
115:201 
116:202 
view
70 x 3 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.4/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
109:200 
121:212 
121:212 
view
60 x 2 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.4/src/main...ion/datasources/parquet
79:166 
86:173 
view
50 x 3 spark/spark-3.3/src/main...l/datasources/shapefile
spark/spark-3.4/src/main...l/datasources/shapefile
spark/spark-3.5/src/main...l/datasources/shapefile
196:253 
196:253 
196:253 
view
50 x 3 spark/spark-3.3/src/main...l/datasources/shapefile
spark/spark-3.4/src/main...l/datasources/shapefile
spark/spark-3.5/src/main...l/datasources/shapefile
150:201 
150:201 
150:201 
view
46 x 3 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.4/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
352:423 
357:428 
358:429 
view
45 x 3 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.4/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
425:503 
430:508 
431:509 
view
42 x 3 spark/spark-3.3/src/main...l/datasources/shapefile
spark/spark-3.4/src/main...l/datasources/shapefile
spark/spark-3.5/src/main...l/datasources/shapefile
51:96 
51:96 
51:96 
view
39 x 2 spark/spark-3.4/src/main.../datasources/geopackage
spark/spark-3.5/src/main.../datasources/geopackage
40:87 
40:87 
view
38 x 2 spark/spark-3.4/src/main.../v2/geoparquet/metadata
spark/spark-3.5/src/main.../v2/geoparquet/metadata
66:108 
66:109 
view
38 x 2 spark/spark-3.4/src/main...l/datasources/shapefile
spark/spark-3.5/src/main...l/datasources/shapefile
68:113 
68:113 
view
34 x 3 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.4/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
202:260 
214:272 
214:272 
view
32 x 3 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.4/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
505:561 
510:566 
511:567 
view
31 x 2 spark/common/src/main/ja.../extension/coloringRule
spark/common/src/main/ja.../extension/coloringRule
34:66 
24:56 
view
24 x 2 spark/spark-3.4/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
406:443 
409:446 
view
23 x 3 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.4/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
29:60 
29:60 
29:60 
view
23 x 3 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.4/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
207:231 
207:231 
208:232 
view
23 x 2 spark/spark-3.4/src/main.../datasources/geopackage
spark/spark-3.5/src/main.../datasources/geopackage
46:80 
46:80 
view
22 x 2 spark/common/src/main/ja...hapefileParser/boundary
spark/common/src/main/ja...apefileParser/fieldname
60:91 
60:91 
view
20 x 2 spark/common/src/main/ja...tMapper/shapefileParser
spark/common/src/main/ja...tMapper/shapefileParser
224:248 
117:141 
view
20 x 2 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.4/src/main...ion/datasources/parquet
367:389 
152:174 
view
20 x 3 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.4/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
396:420 
414:438 
405:429 
view
20 x 3 spark/spark-3.3/src/main.../datasources/geopackage
spark/spark-3.4/src/main.../datasources/geopackage
spark/spark-3.5/src/main.../datasources/geopackage
45:71 
45:71 
45:71 
view
19 x 2 spark/common/src/main/ja...ion/visualizationEffect
spark/common/src/main/ja...ion/visualizationEffect
136:156 
102:122 
view
19 x 2 spark/spark-3.4/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
60:85 
60:85 
view
18 x 2 spark/common/src/main/ja...ion/visualizationEffect
spark/common/src/main/ja...ion/visualizationEffect
103:122 
135:154 
view
18 x 3 spark/spark-3.3/src/main...l/datasources/shapefile
spark/spark-3.4/src/main...l/datasources/shapefile
spark/spark-3.5/src/main...l/datasources/shapefile
78:100 
78:100 
78:100 
view
18 x 3 spark/spark-3.3/src/main...l/datasources/shapefile
spark/spark-3.4/src/main...l/datasources/shapefile
spark/spark-3.5/src/main...l/datasources/shapefile
90:109 
90:109 
90:109 
view
18 x 3 spark/spark-3.3/src/main...l/datasources/shapefile
spark/spark-3.4/src/main...l/datasources/shapefile
spark/spark-3.5/src/main...l/datasources/shapefile
116:135 
116:135 
116:135 
view
18 x 2 spark/spark-3.4/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
378:400 
369:391 
view
17 x 3 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.4/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
391:417 
176:202 
106:132 
view
17 x 2 spark/spark-3.3/src/main.../datasources/geopackage
spark/spark-3.4/src/main.../datasources/geopackage
39:59 
39:59 
view
16 x 2 spark/common/src/main/ja...ion/visualizationEffect
spark/common/src/main/ja...ion/visualizationEffect
73:90 
71:88 
view
16 x 2 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.4/src/main...ion/datasources/parquet
131:158 
133:160 
view
16 x 3 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.4/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
711:734 
743:766 
746:769 
view
16 x 3 spark/spark-3.3/src/main...l/datasources/shapefile
spark/spark-3.4/src/main...l/datasources/shapefile
spark/spark-3.5/src/main...l/datasources/shapefile
53:70 
53:70 
53:70 
view
15 x 2 common/src/main/java/org/apache/sedona/common
common/src/main/java/org...he/sedona/common/sphere
582:598 
81:97 
view
15 x 2 spark/common/src/main/ja...ion/visualizationEffect
spark/common/src/main/ja...ion/visualizationEffect
46:62 
44:60 
view
15 x 3 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.4/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
577:602 
609:634 
612:637 
view
15 x 3 spark/spark-3.3/src/main.../datasources/geopackage
spark/spark-3.4/src/main.../datasources/geopackage
spark/spark-3.5/src/main.../datasources/geopackage
50:70 
50:70 
50:70 
view
14 x 2 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.4/src/main...ion/datasources/parquet
52:72 
52:72 
view
14 x 3 spark/spark-3.3/src/main...l/datasources/shapefile
spark/spark-3.4/src/main...l/datasources/shapefile
spark/spark-3.5/src/main...l/datasources/shapefile
72:88 
72:88 
72:88 
view
13 x 2 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.4/src/main...ion/datasources/parquet
123:137 
127:141 
view
13 x 3 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.4/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
422:436 
440:454 
431:445 
view
13 x 2 spark/spark-3.4/src/main.../v2/geoparquet/metadata
spark/spark-3.5/src/main.../v2/geoparquet/metadata
46:63 
46:63 
view
13 x 2 spark/spark-3.4/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
90:111 
90:111 
view
12 x 3 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.4/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
101:126 
101:126 
101:126 
view
12 x 3 spark/spark-3.3/src/main...ion/datasources/parquet
spark/spark-3.4/src/main...ion/datasources/parquet
spark/spark-3.5/src/main...ion/datasources/parquet
239:252 
239:252 
240:253 
view