apache / datafusion-comet
File Change Frequency

File change frequency (churn) shows the distribution of file updates (days with at least one commit).

Overview
File Change Frequency Overall
  • There are 326 files with 58,860 lines of code.
    • 1 file changed more than 100 times (2,504 lines of code)
    • 2 files changed 51-100 times (975 lines of code)
    • 7 files changed 21-50 times (4,435 lines of code)
    • 55 files changed 6-20 times (19,451 lines of code)
    • 261 files changed 1-5 times (31,495 lines of code)
4% | 1% | 7% | 33% | 53%
Legend:
101+
51-100
21-50
6-20
1-5

explore: grouped by folders | grouped by update frequency | data
Contributors Count Frequency Overall
  • There are 326 files with 58,860 lines of code.
    • 1 file changed by more than 25 contributors (2,504 lines of code)
    • 7 files changed by 11-25 contributors (4,758 lines of code)
    • 15 files changed by 6-10 contributors (4,073 lines of code)
    • 190 files changed by 2-5 contributors (39,189 lines of code)
    • 113 files changed by 1 contributor (8,336 lines of code)
4% | 8% | 6% | 66% | 14%
Legend:
26+
11-25
6-10
2-5
1

explore: grouped by folders | grouped by contributors count | data
File Change Frequency per File Extension
txt, scala, rs, java, md, sql, yaml, sh, json, svg, xml, toml, properties, diff, proto, py, gitignore, html, css, dockerignore, rst, bat, cmd
File Change Frequency per Extension
The number of recorded file updates
101+
51-100
21-50
6-20
1-5
scala17% | 6% | 6% | 29% | 39%
rs0% | 0% | 9% | 35% | 55%
toml0% | 0% | 48% | 18% | 33%
java0% | 0% | 0% | 27% | 72%
proto0% | 0% | 0% | 91% | 8%
xml0% | 0% | 0% | 0% | 100%
py0% | 0% | 0% | 0% | 100%
yaml0% | 0% | 0% | 0% | 100%
File Change Frequency per Logical Decomposition
primary
primary (file change frequency)
The number of recorded file updates
101+
51-100
21-50
6-20
1-5
spark19% | 1% | 6% | 31% | 40%
common0% | 8% | 0% | 23% | 67%
native0% | 0% | 9% | 36% | 54%
fuzz-testing0% | 0% | 0% | 21% | 78%
dev0% | 0% | 0% | 0% | 100%
ROOT0% | 0% | 0% | 0% | 100%
conf0% | 0% | 0% | 0% | 100%
Most Frequently Changed Files (Top 50)

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
QueryPlanSerde.scala
in spark/src/main/scala/org/apache/comet/serde
 2504 33 2024-02-09 2025-05-05 123 29 sunchao@apache.org mbutrovich@users.noreply.gi...
CometSparkSessionExtensions.scala
in spark/src/main/scala/org/apache/comet
 250 24 2024-02-09 2025-05-01 83 17 sunchao@apache.org 137842490+hsiang-c@users.no...
CometConf.scala
in common/src/main/scala/org/apache/comet
 725 22 2024-02-09 2025-05-05 65 12 sunchao@apache.org agrove@apache.org
Cargo.toml
in native
 54 - 2024-07-08 2025-04-24 43 11 agrove@apache.org 55631053+emilymatt@users.no...
jni_api.rs
in native/core/src/execution
 543 7 2024-07-08 2025-05-05 41 9 agrove@apache.org agrove@apache.org
operators.scala
in spark/src/main/scala/org/apache/spark/sql/comet
 746 41 2024-02-09 2025-03-17 33 10 sunchao@apache.org ktanimura@apple.com
Cargo.toml
in native/core
 111 - 2024-07-08 2025-05-05 31 11 vaibhaw.vipul@gmail.com agrove@apache.org
planner.rs
in native/core/src/execution
 2783 35 2024-12-12 2025-05-02 29 11 agrove@apache.org agrove@apache.org
lib.rs
in native/spark-expr/src
 56 - 2024-07-10 2025-02-28 28 9 agrove@apache.org 643348094@qq.com
CometExecIterator.scala
in spark/src/main/scala/org/apache/comet
 142 5 2024-02-09 2025-05-05 25 6 sunchao@apache.org agrove@apache.org
Native.scala
in spark/src/main/scala/org/apache/comet
 49 - 2024-02-09 2025-05-05 20 7 sunchao@apache.org agrove@apache.org
CometShuffleExchangeExec.scala
in spark/src/main/scala/org/apache/spark/sql/comet/execution/shuffle
 296 10 2024-02-16 2025-04-23 19 6 viirya@gmail.com agrove@apache.org
scan.rs
in native/core/src/execution/operators
 382 15 2024-07-08 2025-04-29 19 4 agrove@apache.org comphead@users.noreply.gith...
proto
expr.proto
in native/proto/src/proto
 410 - 2024-07-15 2025-03-25 19 11 agrove@apache.org kazantsev.m.n@yandex.ru
CometScanExec.scala
in spark/src/main/scala/org/apache/spark/sql/comet
 425 15 2024-02-09 2025-05-01 19 11 sunchao@apache.org 137842490+hsiang-c@users.no...
Cargo.toml
in native/spark-expr
 63 - 2024-07-10 2025-04-24 18 7 agrove@apache.org 55631053+emilymatt@users.no...
shuffle_writer.rs
in native/core/src/execution/shuffle
 1053 43 2024-12-12 2025-05-02 18 4 agrove@apache.org agrove@apache.org
CometCast.scala
in spark/src/main/scala/org/apache/comet/expressions
 229 12 2024-05-03 2025-03-11 15 6 agrove@apache.org mehimu@gmail.com
mod.rs
in native/core/src/parquet
 687 5 2024-07-08 2025-04-15 15 6 agrove@apache.org parthc@apache.org
row.rs
in native/core/src/execution/shuffle
 3089 24 2024-07-08 2025-05-02 15 4 agrove@apache.org agrove@apache.org
NativeUtil.scala
in common/src/main/scala/org/apache/comet/vector
 111 8 2024-02-09 2025-01-04 14 5 sunchao@apache.org agrove@apache.org
CometBroadcastExchangeExec.scala
in spark/src/main/scala/org/apache/spark/sql/comet
 208 11 2024-02-21 2025-04-04 13 4 viirya@gmail.com bo@wherobots.com
Plugins.scala
in spark/src/main/scala/org/apache/spark
 68 4 2024-02-09 2025-03-21 12 8 sunchao@apache.org agrove@apache.org
CometTakeOrderedAndProjectExec.scala
in spark/src/main/scala/org/apache/spark/sql/comet
 96 4 2024-02-24 2025-03-17 12 4 viirya@gmail.com ktanimura@apple.com
proto
operator.proto
in native/proto/src/proto
 198 - 2024-07-15 2025-05-02 11 4 agrove@apache.org agrove@apache.org
copy.rs
in native/core/src/execution/operators
 226 15 2024-07-08 2025-04-17 11 4 agrove@apache.org agrove@apache.org
NativeBatchReader.java
in common/src/main/java/org/apache/comet/parquet
 419 15 2025-01-21 2025-04-28 11 3 agrove@apache.org agrove@apache.org
comet_scalar_funcs.rs
in native/spark-expr/src
 142 - 2024-12-09 2025-04-29 10 5 agrove@apache.org comphead@users.noreply.gith...
BatchReader.java
in common/src/main/java/org/apache/comet/parquet
 445 19 2024-02-09 2025-04-28 10 6 sunchao@apache.org agrove@apache.org
filter.rs
in native/core/src/execution/operators
 470 20 2024-08-16 2025-04-17 10 5 agrove@apache.org agrove@apache.org
Native.java
in common/src/main/java/org/apache/comet/parquet
 76 1 2024-02-09 2025-04-15 9 6 sunchao@apache.org parthc@apache.org
CometMetricNode.scala
in spark/src/main/scala/org/apache/spark/sql/comet
 100 11 2024-02-09 2025-02-27 9 5 sunchao@apache.org agrove@apache.org
shuffle_writer.rs
in native/core/benches
 128 5 2024-07-08 2025-05-02 9 3 agrove@apache.org agrove@apache.org
CometVector.java
in common/src/main/java/org/apache/comet/vector
 176 22 2024-02-09 2025-01-21 9 6 sunchao@apache.org agrove@apache.org
Utils.scala
in common/src/main/scala/org/apache/spark/sql/comet/util
 216 13 2024-02-09 2025-04-09 9 7 sunchao@apache.org comphead@users.noreply.gith...
CometParquetFileFormat.scala
in spark/src/main/scala/org/apache/comet/parquet
 223 4 2024-02-09 2025-04-15 9 5 sunchao@apache.org parthc@apache.org
errors.rs
in native/core/src
 663 25 2024-07-08 2025-04-24 9 4 agrove@apache.org 55631053+emilymatt@users.no...
mod.rs
in native/core/src/execution/shuffle
 7 - 2024-07-08 2025-05-02 8 2 agrove@apache.org agrove@apache.org
lib.rs
in native/core/src
 73 1 2024-07-08 2025-04-25 8 4 agrove@apache.org mbutrovich@users.noreply.gi...
arrays.scala
in spark/src/main/scala/org/apache/comet/serde
 264 12 2025-01-22 2025-04-29 8 3 agrove@apache.org comphead@users.noreply.gith...
parquet_support.rs
in native/core/src/parquet
 281 6 2025-01-21 2025-04-18 8 6 agrove@apache.org mbutrovich@users.noreply.gi...
CometDictionary.java
in common/src/main/java/org/apache/comet/vector
 80 13 2024-02-09 2024-08-05 7 3 sunchao@apache.org ktanimura@apple.com
CometPlainVector.java
in common/src/main/java/org/apache/comet/vector
 147 19 2024-02-09 2025-01-03 7 4 sunchao@apache.org viirya@gmail.com
utils.rs
in native/spark-expr/src
 170 3 2024-07-12 2025-03-14 7 3 agrove@apache.org 55631053+emilymatt@users.no...
schema_adapter.rs
in native/core/src/parquet
 200 4 2025-01-21 2025-04-17 7 4 agrove@apache.org agrove@apache.org
ColumnReader.java
in common/src/main/java/org/apache/comet/parquet
 210 8 2024-02-09 2025-04-28 7 4 sunchao@apache.org agrove@apache.org
values.rs
in native/core/src/parquet/read
 888 44 2024-07-08 2024-12-10 7 3 agrove@apache.org agrove@apache.org
bit.rs
in native/core/src/common
 1249 43 2024-07-08 2025-04-24 7 4 agrove@apache.org 55631053+emilymatt@users.no...
cast.rs
in native/spark-expr/src/conversion_funcs
 2312 77 2025-01-18 2025-05-02 7 5 16746759+rluvaton@users.nor... mbutrovich@users.noreply.gi...
mod.rs
in native/core/src/execution
 21 1 2024-07-08 2025-04-22 6 3 agrove@apache.org 55631053+emilymatt@users.no...
Files With Most Contributors (Top 50)
Based on the number of unique email addresses found in commits.

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
QueryPlanSerde.scala
in spark/src/main/scala/org/apache/comet/serde
 2504 33 2024-02-09 2025-05-05 123 29 sunchao@apache.org mbutrovich@users.noreply.gi...
CometSparkSessionExtensions.scala
in spark/src/main/scala/org/apache/comet
 250 24 2024-02-09 2025-05-01 83 17 sunchao@apache.org 137842490+hsiang-c@users.no...
CometConf.scala
in common/src/main/scala/org/apache/comet
 725 22 2024-02-09 2025-05-05 65 12 sunchao@apache.org agrove@apache.org
Cargo.toml
in native
 54 - 2024-07-08 2025-04-24 43 11 agrove@apache.org 55631053+emilymatt@users.no...
Cargo.toml
in native/core
 111 - 2024-07-08 2025-05-05 31 11 vaibhaw.vipul@gmail.com agrove@apache.org
planner.rs
in native/core/src/execution
 2783 35 2024-12-12 2025-05-02 29 11 agrove@apache.org agrove@apache.org
CometScanExec.scala
in spark/src/main/scala/org/apache/spark/sql/comet
 425 15 2024-02-09 2025-05-01 19 11 sunchao@apache.org 137842490+hsiang-c@users.no...
proto
expr.proto
in native/proto/src/proto
 410 - 2024-07-15 2025-03-25 19 11 agrove@apache.org kazantsev.m.n@yandex.ru
operators.scala
in spark/src/main/scala/org/apache/spark/sql/comet
 746 41 2024-02-09 2025-03-17 33 10 sunchao@apache.org ktanimura@apple.com
jni_api.rs
in native/core/src/execution
 543 7 2024-07-08 2025-05-05 41 9 agrove@apache.org agrove@apache.org
lib.rs
in native/spark-expr/src
 56 - 2024-07-10 2025-02-28 28 9 agrove@apache.org 643348094@qq.com
Plugins.scala
in spark/src/main/scala/org/apache/spark
 68 4 2024-02-09 2025-03-21 12 8 sunchao@apache.org agrove@apache.org
Native.scala
in spark/src/main/scala/org/apache/comet
 49 - 2024-02-09 2025-05-05 20 7 sunchao@apache.org agrove@apache.org
Cargo.toml
in native/spark-expr
 63 - 2024-07-10 2025-04-24 18 7 agrove@apache.org 55631053+emilymatt@users.no...
Utils.scala
in common/src/main/scala/org/apache/spark/sql/comet/util
 216 13 2024-02-09 2025-04-09 9 7 sunchao@apache.org comphead@users.noreply.gith...
CometExecIterator.scala
in spark/src/main/scala/org/apache/comet
 142 5 2024-02-09 2025-05-05 25 6 sunchao@apache.org agrove@apache.org
CometShuffleExchangeExec.scala
in spark/src/main/scala/org/apache/spark/sql/comet/execution/shuffle
 296 10 2024-02-16 2025-04-23 19 6 viirya@gmail.com agrove@apache.org
CometCast.scala
in spark/src/main/scala/org/apache/comet/expressions
 229 12 2024-05-03 2025-03-11 15 6 agrove@apache.org mehimu@gmail.com
mod.rs
in native/core/src/parquet
 687 5 2024-07-08 2025-04-15 15 6 agrove@apache.org parthc@apache.org
BatchReader.java
in common/src/main/java/org/apache/comet/parquet
 445 19 2024-02-09 2025-04-28 10 6 sunchao@apache.org agrove@apache.org
CometVector.java
in common/src/main/java/org/apache/comet/vector
 176 22 2024-02-09 2025-01-21 9 6 sunchao@apache.org agrove@apache.org
Native.java
in common/src/main/java/org/apache/comet/parquet
 76 1 2024-02-09 2025-04-15 9 6 sunchao@apache.org parthc@apache.org
parquet_support.rs
in native/core/src/parquet
 281 6 2025-01-21 2025-04-18 8 6 agrove@apache.org mbutrovich@users.noreply.gi...
NativeUtil.scala
in common/src/main/scala/org/apache/comet/vector
 111 8 2024-02-09 2025-01-04 14 5 sunchao@apache.org agrove@apache.org
filter.rs
in native/core/src/execution/operators
 470 20 2024-08-16 2025-04-17 10 5 agrove@apache.org agrove@apache.org
comet_scalar_funcs.rs
in native/spark-expr/src
 142 - 2024-12-09 2025-04-29 10 5 agrove@apache.org comphead@users.noreply.gith...
CometParquetFileFormat.scala
in spark/src/main/scala/org/apache/comet/parquet
 223 4 2024-02-09 2025-04-15 9 5 sunchao@apache.org parthc@apache.org
CometMetricNode.scala
in spark/src/main/scala/org/apache/spark/sql/comet
 100 11 2024-02-09 2025-02-27 9 5 sunchao@apache.org agrove@apache.org
cast.rs
in native/spark-expr/src/conversion_funcs
 2312 77 2025-01-18 2025-05-02 7 5 16746759+rluvaton@users.nor... mbutrovich@users.noreply.gi...
ParquetFilters.scala
in spark/src/main/scala/org/apache/comet/parquet
 834 16 2024-02-09 2025-03-31 6 5 sunchao@apache.org 643348094@qq.com
CometShuffleManager.scala
in spark/src/main/scala/org/apache/spark/sql/comet/execution/shuffle
 231 7 2024-02-16 2025-04-04 6 5 viirya@gmail.com bo@wherobots.com
CometBatchScanExec.scala
in spark/src/main/scala/org/apache/spark/sql/comet
 95 7 2024-02-09 2025-03-17 6 5 sunchao@apache.org ktanimura@apple.com
CometShuffleExternalSorter.java
in spark/src/main/java/org/apache/spark/shuffle/sort
 410 20 2024-02-16 2025-01-07 6 5 viirya@gmail.com agrove@apache.org
ShimCometScanExec.scala
in spark/src/main/spark-3.5/org/apache/spark/sql/comet/shims
 101 3 2024-06-20 2025-03-31 6 5 agrove@apache.org ykunda@akamai.com
scan.rs
in native/core/src/execution/operators
 382 15 2024-07-08 2025-04-29 19 4 agrove@apache.org comphead@users.noreply.gith...
shuffle_writer.rs
in native/core/src/execution/shuffle
 1053 43 2024-12-12 2025-05-02 18 4 agrove@apache.org agrove@apache.org
row.rs
in native/core/src/execution/shuffle
 3089 24 2024-07-08 2025-05-02 15 4 agrove@apache.org agrove@apache.org
CometBroadcastExchangeExec.scala
in spark/src/main/scala/org/apache/spark/sql/comet
 208 11 2024-02-21 2025-04-04 13 4 viirya@gmail.com bo@wherobots.com
CometTakeOrderedAndProjectExec.scala
in spark/src/main/scala/org/apache/spark/sql/comet
 96 4 2024-02-24 2025-03-17 12 4 viirya@gmail.com ktanimura@apple.com
copy.rs
in native/core/src/execution/operators
 226 15 2024-07-08 2025-04-17 11 4 agrove@apache.org agrove@apache.org
proto
operator.proto
in native/proto/src/proto
 198 - 2024-07-15 2025-05-02 11 4 agrove@apache.org agrove@apache.org
errors.rs
in native/core/src
 663 25 2024-07-08 2025-04-24 9 4 agrove@apache.org 55631053+emilymatt@users.no...
lib.rs
in native/core/src
 73 1 2024-07-08 2025-04-25 8 4 agrove@apache.org mbutrovich@users.noreply.gi...
CometPlainVector.java
in common/src/main/java/org/apache/comet/vector
 147 19 2024-02-09 2025-01-03 7 4 sunchao@apache.org viirya@gmail.com
ColumnReader.java
in common/src/main/java/org/apache/comet/parquet
 210 8 2024-02-09 2025-04-28 7 4 sunchao@apache.org agrove@apache.org
bit.rs
in native/core/src/common
 1249 43 2024-07-08 2025-04-24 7 4 agrove@apache.org 55631053+emilymatt@users.no...
schema_adapter.rs
in native/core/src/parquet
 200 4 2025-01-21 2025-04-17 7 4 agrove@apache.org agrove@apache.org
CometNativeScanExec.scala
in spark/src/main/scala/org/apache/spark/sql/comet
 199 6 2025-01-21 2025-05-01 6 4 agrove@apache.org 137842490+hsiang-c@users.no...
jni.rs
in native/core/src/parquet/util
 212 6 2024-07-08 2025-05-02 6 4 agrove@apache.org agrove@apache.org
TypeUtil.java
in common/src/main/java/org/apache/comet/parquet
 293 16 2024-02-09 2025-04-15 5 4 sunchao@apache.org parthc@apache.org
Files With Least Contributors (Top 50)
Based on the number of unique email addresses found in commits.

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
bit_packing.rs
in native/core/src/parquet/util
 3070 - 2024-07-08 2024-07-08 1 1 agrove@apache.org agrove@apache.org
CometExecRule.scala
in spark/src/main/scala/org/apache/comet/rules
 536 8 2025-04-30 2025-05-02 2 1 agrove@apache.org agrove@apache.org
CometUnsafeShuffleWriter.java
in spark/src/main/java/org/apache/spark/sql/comet/execution/shuffle
 425 15 2024-02-16 2024-02-22 2 1 viirya@gmail.com viirya@gmail.com
CometBufferImportTypeVisitor.java
in common/src/main/java/org/apache/arrow/c
 316 29 2024-06-29 2024-06-29 1 1 viirya@gmail.com viirya@gmail.com
ColumnPageReader.java
in common/src/main/java/org/apache/comet/parquet
 212 6 2024-02-09 2024-02-09 1 1 sunchao@apache.org sunchao@apache.org
BloomFilterReader.java
in common/src/main/java/org/apache/comet/parquet
 197 5 2024-02-09 2024-02-09 1 1 sunchao@apache.org sunchao@apache.org
ColumnIndexReader.java
in common/src/main/java/org/apache/comet/parquet
 177 12 2024-02-09 2024-02-09 1 1 sunchao@apache.org sunchao@apache.org
array_repeat.rs
in native/spark-expr/src/array_funcs
 147 3 2025-04-29 2025-04-29 1 1 comphead@users.noreply.gith... comphead@users.noreply.gith...
DictionaryPageReader.java
in common/src/main/java/org/apache/comet/parquet
 145 4 2024-02-09 2024-02-09 1 1 sunchao@apache.org sunchao@apache.org
QueryRunner.scala
in fuzz-testing/src/main/scala/org/apache/comet/fuzz
 142 6 2024-06-03 2025-01-22 4 1 agrove@apache.org agrove@apache.org
SourceFilterSerde.scala
in spark/src/main/scala/org/apache/comet/parquet
 135 4 2025-03-31 2025-03-31 1 1 643348094@qq.com 643348094@qq.com
QueryGen.scala
in fuzz-testing/src/main/scala/org/apache/comet/fuzz
 133 9 2024-06-03 2024-07-17 4 1 agrove@apache.org agrove@apache.org
NativeBatchDecoderIterator.scala
in spark/src/main/scala/org/apache/spark/sql/comet/execution/shuffle
 131 4 2025-01-07 2025-01-13 2 1 agrove@apache.org agrove@apache.org
CometBlockStoreShuffleReader.scala
in spark/src/main/scala/org/apache/spark/sql/comet/execution/shuffle
 119 2 2024-12-22 2025-01-07 2 1 agrove@apache.org agrove@apache.org
CometShuffledRowRDD.scala
in spark/src/main/scala/org/apache/spark/sql/comet/execution/shuffle
 109 5 2024-12-22 2024-12-22 1 1 agrove@apache.org agrove@apache.org
CometInputFile.java
in common/src/main/java/org/apache/comet/parquet
 104 11 2024-02-09 2024-02-09 1 1 sunchao@apache.org sunchao@apache.org
IndexFilter.java
in common/src/main/java/org/apache/comet/parquet
 104 12 2024-02-09 2024-02-09 1 1 sunchao@apache.org sunchao@apache.org
CometArrayImporter.java
in common/src/main/java/org/apache/arrow/c
 103 3 2024-06-29 2024-06-29 1 1 viirya@gmail.com viirya@gmail.com
generate-changelog.py
in dev/release
 94 3 2024-06-12 2024-08-25 2 1 agrove@apache.org agrove@apache.org
NativeColumnReader.java
in common/src/main/java/org/apache/comet/parquet
 89 6 2025-01-21 2025-04-28 2 1 agrove@apache.org agrove@apache.org
mod.rs
in native/core/src/execution/memory_pools
 89 - 2025-04-22 2025-04-22 1 1 55631053+emilymatt@users.no... 55631053+emilymatt@users.no...
row_columnar.rs
in native/core/benches
 80 2 2024-07-08 2025-05-02 4 1 agrove@apache.org agrove@apache.org
config.rs
in native/core/src/execution/memory_pools
 79 - 2025-04-22 2025-04-22 1 1 55631053+emilymatt@users.no... 55631053+emilymatt@users.no...
RewriteJoin.scala
in spark/src/main/scala/org/apache/comet/rules
 69 4 2024-10-21 2025-02-21 2 1 agrove@apache.org agrove@apache.org
CometParquetScan.scala
in spark/src/main/scala/org/apache/comet/parquet
 57 2 2024-02-09 2024-02-09 1 1 sunchao@apache.org sunchao@apache.org
EliminateRedundantTransitions.scala
in spark/src/main/scala/org/apache/comet/rules
 53 2 2025-04-30 2025-04-30 1 1 agrove@apache.org agrove@apache.org
ArrowReaderIterator.scala
in common/src/main/scala/org/apache/spark/sql/comet/execution/arrow
 52 3 2025-04-04 2025-04-04 1 1 bo@wherobots.com bo@wherobots.com
mod.rs
in native/core/src/parquet/read
 52 2 2024-07-08 2024-12-10 2 1 agrove@apache.org agrove@apache.org
CometLazyVector.java
in common/src/main/java/org/apache/comet/vector
 50 9 2024-02-09 2024-02-09 1 1 sunchao@apache.org sunchao@apache.org
Cargo.toml
in native/hdfs
 47 - 2025-02-13 2025-02-13 1 1 comphead@users.noreply.gith... comphead@users.noreply.gith...
RowGroupReader.java
in common/src/main/java/org/apache/comet/parquet
 44 5 2024-02-09 2024-02-09 1 1 sunchao@apache.org sunchao@apache.org
ShimCometScanExec.scala
in spark/src/main/spark-3.4/org/apache/spark/sql/comet/shims
 44 2 2025-03-17 2025-03-17 1 1 ktanimura@apple.com ktanimura@apple.com
AbstractCometSchemaImporter.java
in common/src/main/java/org/apache/arrow/c
 36 6 2025-04-28 2025-04-28 1 1 agrove@apache.org agrove@apache.org
CometUnifiedShuffleMemoryAllocator.java
in spark/src/main/java/org/apache/spark/shuffle/comet
 35 6 2025-03-13 2025-03-13 1 1 mbutrovich@users.noreply.gi... mbutrovich@users.noreply.gi...
CometTaskMemoryManager.java
in spark/src/main/java/org/apache/spark
 34 6 2024-03-06 2024-03-06 1 1 sunchao@apache.org sunchao@apache.org
comet_exec.rs
in native/core/src/jvm_bridge
 34 - 2024-07-08 2024-07-08 1 1 agrove@apache.org agrove@apache.org
perf.rs
in native/core/benches
 34 2 2024-07-08 2025-03-03 2 1 agrove@apache.org agrove@apache.org
CometReaderThreadPool.scala
in common/src/main/scala/org/apache/comet/parquet
 33 2 2024-02-09 2024-02-09 1 1 sunchao@apache.org sunchao@apache.org
ZippedPartitionsRDD.scala
in spark/src/main/scala/org/apache/spark/sql/comet
 33 3 2024-02-22 2024-11-25 2 1 viirya@gmail.com viirya@gmail.com
check-rat-report.py
in dev/release
 33 - 2024-06-08 2024-06-08 1 1 agrove@apache.org agrove@apache.org
proto
partitioning.proto
in native/proto/src/proto
 33 - 2024-07-15 2024-07-15 1 1 agrove@apache.org agrove@apache.org
MetricsSupport.scala
in spark/src/main/scala/org/apache/comet
 31 1 2024-02-09 2024-02-09 1 1 sunchao@apache.org sunchao@apache.org
task_shared.rs
in native/core/src/execution/memory_pools
 31 - 2025-04-22 2025-04-22 1 1 55631053+emilymatt@users.no... 55631053+emilymatt@users.no...
ShuffleUtils.scala
in spark/src/main/scala/org/apache/spark/sql/comet/execution/shuffle
 30 - 2024-12-22 2024-12-22 1 1 agrove@apache.org agrove@apache.org
CometExecRDD.scala
in spark/src/main/scala/org/apache/spark/sql/comet
 29 2 2025-01-21 2025-01-21 1 1 agrove@apache.org agrove@apache.org
RowPartition.scala
in spark/src/main/scala/org/apache/spark/shuffle/sort
 29 3 2024-02-16 2024-08-28 3 1 viirya@gmail.com viirya@gmail.com
mod.rs
in native/core/src/execution/operators
 29 - 2024-07-08 2024-12-12 4 1 agrove@apache.org agrove@apache.org
FooterReader.java
in common/src/main/java/org/apache/comet/parquet
 27 1 2024-02-09 2024-02-09 1 1 sunchao@apache.org sunchao@apache.org
fair_pool.rs
in native/core/src/execution/memory_pools
 27 - 2025-04-22 2025-04-22 1 1 55631053+emilymatt@users.no... 55631053+emilymatt@users.no...
CometShuffleChecksumSupport.java
in spark/src/main/java/org/apache/spark/shuffle/comet
 24 1 2024-02-16 2024-02-16 1 1 viirya@gmail.com viirya@gmail.com
Correlations

File Size vs. Number of Changes: 326 points

spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala x: 2504 lines of code y: 123 # changes spark/src/main/scala/org/apache/comet/testing/ParquetGenerator.scala x: 194 lines of code y: 5 # changes common/src/main/scala/org/apache/comet/CometConf.scala x: 725 lines of code y: 65 # changes native/core/Cargo.toml x: 111 lines of code y: 31 # changes native/core/src/execution/jni_api.rs x: 543 lines of code y: 41 # changes spark/src/main/scala/org/apache/comet/CometExecIterator.scala x: 142 lines of code y: 25 # changes spark/src/main/scala/org/apache/comet/Native.scala x: 49 lines of code y: 20 # changes native/core/benches/row_columnar.rs x: 80 lines of code y: 4 # changes native/core/benches/shuffle_writer.rs x: 128 lines of code y: 9 # changes native/core/src/execution/planner.rs x: 2783 lines of code y: 29 # changes native/core/src/execution/shuffle/codec.rs x: 186 lines of code y: 6 # changes native/core/src/execution/shuffle/mod.rs x: 7 lines of code y: 8 # changes native/core/src/execution/shuffle/row.rs x: 3089 lines of code y: 15 # changes native/core/src/execution/shuffle/shuffle_writer.rs x: 1053 lines of code y: 18 # changes native/core/src/parquet/util/jni.rs x: 212 lines of code y: 6 # changes native/proto/src/proto/operator.proto x: 198 lines of code y: 11 # changes spark/src/main/java/org/apache/spark/sql/comet/execution/shuffle/SpillWriter.java x: 149 lines of code y: 6 # changes spark/src/main/scala/org/apache/comet/rules/CometExecRule.scala x: 536 lines of code y: 2 # changes spark/src/main/scala/org/apache/spark/sql/comet/execution/shuffle/CometNativeShuffleWriter.scala x: 160 lines of code y: 3 # changes native/spark-expr/src/conversion_funcs/cast.rs x: 2312 lines of code y: 7 # changes spark/src/main/scala/org/apache/comet/CometSparkSessionExtensions.scala x: 250 lines of code y: 83 # changes spark/src/main/scala/org/apache/comet/DataTypeSupport.scala x: 62 lines of code y: 5 # changes spark/src/main/scala/org/apache/comet/rules/CometScanRule.scala x: 141 lines of code y: 2 # changes spark/src/main/scala/org/apache/spark/sql/comet/CometNativeScanExec.scala x: 199 lines of code y: 6 # changes spark/src/main/scala/org/apache/spark/sql/comet/CometScanExec.scala x: 425 lines of code y: 19 # changes spark/src/main/scala/org/apache/spark/sql/comet/CometSparkToColumnarExec.scala x: 108 lines of code y: 5 # changes spark/src/main/scala/org/apache/comet/rules/EliminateRedundantTransitions.scala x: 53 lines of code y: 1 # changes spark/src/main/scala/org/apache/comet/serde/arrays.scala x: 264 lines of code y: 8 # changes native/core/src/execution/operators/scan.rs x: 382 lines of code y: 19 # changes native/spark-expr/src/array_funcs/array_repeat.rs x: 147 lines of code y: 1 # changes native/spark-expr/src/array_funcs/mod.rs x: 8 lines of code y: 2 # changes native/spark-expr/src/comet_scalar_funcs.rs x: 142 lines of code y: 10 # changes spark/src/main/scala/org/apache/comet/serde/hash.scala x: 57 lines of code y: 2 # changes fuzz-testing/src/main/scala/org/apache/comet/fuzz/Meta.scala x: 104 lines of code y: 6 # changes common/src/main/java/org/apache/arrow/c/AbstractCometSchemaImporter.java x: 36 lines of code y: 1 # changes common/src/main/java/org/apache/comet/CometSchemaImporter.java x: 8 lines of code y: 1 # changes common/src/main/java/org/apache/comet/parquet/BatchReader.java x: 445 lines of code y: 10 # changes common/src/main/java/org/apache/comet/parquet/ColumnReader.java x: 210 lines of code y: 7 # changes common/src/main/java/org/apache/comet/parquet/LazyColumnReader.java x: 100 lines of code y: 3 # changes common/src/main/java/org/apache/comet/parquet/NativeBatchReader.java x: 419 lines of code y: 11 # changes common/src/main/java/org/apache/comet/parquet/NativeColumnReader.java x: 89 lines of code y: 2 # changes common/src/main/java/org/apache/comet/parquet/SupportsComet.java x: 4 lines of code y: 2 # changes common/src/main/java/org/apache/comet/parquet/Utils.java x: 187 lines of code y: 5 # changes native/core/src/lib.rs x: 73 lines of code y: 8 # changes native/Cargo.toml x: 54 lines of code y: 43 # changes native/core/benches/bit_util.rs x: 162 lines of code y: 4 # changes native/core/benches/common.rs x: 60 lines of code y: 3 # changes native/core/benches/parquet_read.rs x: 125 lines of code y: 5 # changes native/core/src/common/bit.rs x: 1249 lines of code y: 7 # changes native/core/src/errors.rs x: 663 lines of code y: 9 # changes native/core/src/execution/serde.rs x: 157 lines of code y: 4 # changes native/proto/Cargo.toml x: 30 lines of code y: 3 # changes native/spark-expr/Cargo.toml x: 63 lines of code y: 18 # changes spark/src/main/scala/org/apache/spark/sql/comet/execution/shuffle/CometShuffleExchangeExec.scala x: 296 lines of code y: 19 # changes native/core/src/execution/memory_pools/config.rs x: 79 lines of code y: 1 # changes native/core/src/execution/memory_pools/fair_pool.rs x: 27 lines of code y: 1 # changes native/core/src/execution/memory_pools/mod.rs x: 89 lines of code y: 1 # changes native/core/src/execution/memory_pools/task_shared.rs x: 31 lines of code y: 1 # changes native/core/src/execution/memory_pools/unified_pool.rs x: 22 lines of code y: 1 # changes native/core/src/execution/mod.rs x: 21 lines of code y: 6 # changes native/core/src/parquet/parquet_support.rs x: 281 lines of code y: 8 # changes native/core/src/execution/expressions/bloom_filter_might_contain.rs x: 109 lines of code y: 4 # changes native/core/src/execution/operators/copy.rs x: 226 lines of code y: 11 # changes native/core/src/execution/operators/expand.rs x: 150 lines of code y: 4 # changes native/core/src/execution/operators/filter.rs x: 470 lines of code y: 10 # changes native/core/src/parquet/schema_adapter.rs x: 200 lines of code y: 7 # changes native/spark-expr/src/array_funcs/array_insert.rs x: 252 lines of code y: 3 # changes native/spark-expr/src/array_funcs/get_array_struct_fields.rs x: 133 lines of code y: 3 # changes native/spark-expr/src/array_funcs/list_extract.rs x: 262 lines of code y: 3 # changes native/spark-expr/src/bitwise_funcs/bitwise_not.rs x: 90 lines of code y: 3 # changes native/spark-expr/src/conditional_funcs/if_expr.rs x: 116 lines of code y: 3 # changes native/spark-expr/src/datetime_funcs/date_trunc.rs x: 86 lines of code y: 3 # changes native/spark-expr/src/datetime_funcs/timestamp_trunc.rs x: 119 lines of code y: 3 # changes native/spark-expr/src/json_funcs/to_json.rs x: 303 lines of code y: 3 # changes native/spark-expr/src/math_funcs/internal/checkoverflow.rs x: 127 lines of code y: 3 # changes native/spark-expr/src/math_funcs/negative.rs x: 208 lines of code y: 3 # changes native/spark-expr/src/string_funcs/prediction.rs x: 102 lines of code y: 3 # changes native/spark-expr/src/string_funcs/string_space.rs x: 77 lines of code y: 3 # changes native/spark-expr/src/unbound.rs x: 33 lines of code y: 4 # changes common/src/main/java/org/apache/comet/parquet/FileReader.java x: 938 lines of code y: 4 # changes common/src/main/java/org/apache/comet/parquet/Native.java x: 76 lines of code y: 9 # changes common/src/main/java/org/apache/comet/parquet/TypeUtil.java x: 293 lines of code y: 5 # changes native/core/src/parquet/mod.rs x: 687 lines of code y: 15 # changes spark/src/main/scala/org/apache/comet/parquet/CometParquetFileFormat.scala x: 223 lines of code y: 9 # changes native/core/src/execution/shuffle/map.rs x: 2574 lines of code y: 4 # changes common/src/main/scala/org/apache/spark/sql/comet/util/Utils.scala x: 216 lines of code y: 9 # changes spark/src/main/scala/org/apache/spark/sql/comet/execution/shuffle/CometShuffleDependency.scala x: 36 lines of code y: 3 # changes spark/src/main/scala/org/apache/spark/sql/comet/execution/shuffle/CometShuffleManager.scala x: 231 lines of code y: 6 # changes spark/src/main/scala/org/apache/comet/serde/aggregates.scala x: 644 lines of code y: 3 # changes spark/src/main/scala/org/apache/spark/sql/comet/CometBroadcastExchangeExec.scala x: 208 lines of code y: 13 # changes spark/src/main/scala/org/apache/spark/sql/comet/CometColumnarToRowExec.scala x: 233 lines of code y: 2 # changes native/spark-expr/src/hash_funcs/utils.rs x: 431 lines of code y: 4 # changes native/spark-expr/src/agg_funcs/correlation.rs x: 195 lines of code y: 3 # changes spark/src/main/scala/org/apache/comet/parquet/CometParquetPartitionReaderFactory.scala x: 178 lines of code y: 5 # changes spark/src/main/scala/org/apache/comet/parquet/ParquetFilters.scala x: 834 lines of code y: 6 # changes spark/src/main/scala/org/apache/comet/parquet/SourceFilterSerde.scala x: 135 lines of code y: 1 # changes native/proto/src/proto/expr.proto x: 410 lines of code y: 19 # changes spark/src/main/scala/org/apache/spark/Plugins.scala x: 68 lines of code y: 12 # changes spark/src/main/java/org/apache/spark/shuffle/comet/CometBoundedShuffleMemoryAllocator.java x: 121 lines of code y: 2 # changes common/src/main/scala/org/apache/spark/sql/comet/CastOverflowException.scala x: 14 lines of code y: 2 # changes spark/src/main/scala/org/apache/spark/sql/comet/CometBatchScanExec.scala x: 95 lines of code y: 6 # changes spark/src/main/scala/org/apache/spark/sql/comet/CometTakeOrderedAndProjectExec.scala x: 96 lines of code y: 12 # changes spark/src/main/scala/org/apache/spark/sql/comet/operators.scala x: 746 lines of code y: 33 # changes spark/src/main/scala/org/apache/spark/sql/comet/plans/AliasAwareOutputExpression.scala x: 48 lines of code y: 4 # changes spark/src/main/spark-3.4/org/apache/spark/sql/comet/shims/ShimCometScanExec.scala x: 44 lines of code y: 1 # changes spark/src/main/spark-3.x/org/apache/comet/shims/ShimCometShuffleExchangeExec.scala x: 24 lines of code y: 5 # changes spark/src/main/spark-3.x/org/apache/comet/shims/ShimCometSparkSessionExtensions.scala x: 16 lines of code y: 5 # changes spark/src/main/spark-4.0/org/apache/spark/sql/comet/shims/ShimCometScanExec.scala x: 55 lines of code y: 4 # changes spark/src/main/spark-3.4/org/apache/comet/shims/CometExprShim.scala x: 17 lines of code y: 5 # changes spark/src/main/spark-3.5/org/apache/comet/shims/CometExprShim.scala x: 17 lines of code y: 2 # changes spark/src/main/spark-4.0/org/apache/comet/shims/CometExprShim.scala x: 17 lines of code y: 4 # changes native/core/benches/bloom_filter_agg.rs x: 129 lines of code y: 6 # changes native/core/benches/filter.rs x: 81 lines of code y: 2 # changes native/core/src/execution/shuffle/list.rs x: 291 lines of code y: 3 # changes native/core/src/execution/spark_plan.rs x: 63 lines of code y: 2 # changes native/core/src/execution/util/spark_bit_array.rs x: 163 lines of code y: 3 # changes native/core/src/execution/util/spark_bloom_filter.rs x: 126 lines of code y: 4 # changes native/spark-expr/benches/decimal_div.rs x: 41 lines of code y: 4 # changes native/spark-expr/src/agg_funcs/avg.rs x: 257 lines of code y: 2 # changes native/spark-expr/src/agg_funcs/avg_decimal.rs x: 409 lines of code y: 3 # changes native/spark-expr/src/agg_funcs/sum_decimal.rs x: 429 lines of code y: 3 # changes native/spark-expr/src/agg_funcs/variance.rs x: 188 lines of code y: 4 # changes native/spark-expr/src/error.rs x: 45 lines of code y: 2 # changes native/spark-expr/src/hash_funcs/murmur3.rs x: 225 lines of code y: 2 # changes native/spark-expr/src/hash_funcs/xxhash64.rs x: 218 lines of code y: 2 # changes native/spark-expr/src/kernels/strings.rs x: 90 lines of code y: 2 # changes native/spark-expr/src/kernels/temporal.rs x: 1010 lines of code y: 3 # changes native/spark-expr/src/math_funcs/internal/make_decimal.rs x: 43 lines of code y: 2 # changes native/spark-expr/src/math_funcs/internal/unscaled_value.rs x: 25 lines of code y: 2 # changes native/spark-expr/src/math_funcs/round.rs x: 182 lines of code y: 3 # changes native/spark-expr/src/math_funcs/unhex.rs x: 191 lines of code y: 2 # changes native/spark-expr/src/math_funcs/utils.rs x: 53 lines of code y: 2 # changes native/spark-expr/src/utils.rs x: 170 lines of code y: 7 # changes spark/src/main/scala/org/apache/comet/GenerateDocs.scala x: 80 lines of code y: 6 # changes spark/src/main/scala/org/apache/comet/expressions/CometCast.scala x: 229 lines of code y: 15 # changes native/core/benches/perf.rs x: 34 lines of code y: 2 # changes native/core/src/execution/sort.rs x: 154 lines of code y: 4 # changes native/core/src/parquet/data_type.rs x: 2 lines of code y: 3 # changes rust-toolchain.toml x: 19 lines of code y: 3 # changes native/spark-expr/src/lib.rs x: 56 lines of code y: 28 # changes spark/src/main/scala/org/apache/spark/sql/comet/CometMetricNode.scala x: 100 lines of code y: 9 # changes spark/src/main/scala/org/apache/comet/rules/RewriteJoin.scala x: 69 lines of code y: 2 # changes fuzz-testing/src/main/scala/org/apache/comet/fuzz/Main.scala x: 85 lines of code y: 4 # changes native/hdfs/Cargo.toml x: 47 lines of code y: 1 # changes native/hdfs/src/lib.rs x: 1 lines of code y: 1 # changes native/core/src/execution/metrics/utils.rs x: 55 lines of code y: 6 # changes fuzz-testing/src/main/scala/org/apache/comet/fuzz/QueryRunner.scala x: 142 lines of code y: 4 # changes common/src/main/java/org/apache/comet/vector/CometVector.java x: 176 lines of code y: 9 # changes spark/src/main/scala/org/apache/spark/sql/comet/execution/shuffle/NativeBatchDecoderIterator.scala x: 131 lines of code y: 2 # changes native/spark-expr/src/datetime_funcs/mod.rs x: 12 lines of code y: 1 # changes spark/src/main/java/org/apache/spark/shuffle/sort/CometShuffleExternalSorter.java x: 410 lines of code y: 6 # changes spark/src/main/java/org/apache/spark/sql/comet/execution/shuffle/CometDiskBlockWriter.java x: 304 lines of code y: 5 # changes common/src/main/scala/org/apache/comet/vector/NativeUtil.scala x: 111 lines of code y: 14 # changes common/src/main/java/org/apache/comet/vector/CometPlainVector.java x: 147 lines of code y: 7 # changes native/core/src/common/buffer.rs x: 254 lines of code y: 2 # changes native/core/src/parquet/read/column.rs x: 806 lines of code y: 5 # changes spark/src/main/scala/org/apache/spark/sql/comet/execution/shuffle/CometShuffledRowRDD.scala x: 109 lines of code y: 1 # changes spark/src/main/scala/org/apache/spark/sql/comet/CometCollectLimitExec.scala x: 75 lines of code y: 6 # changes native/core/src/parquet/read/values.rs x: 888 lines of code y: 7 # changes native/core/src/parquet/read/levels.rs x: 170 lines of code y: 4 # changes spark/src/main/scala/org/apache/spark/sql/comet/CometExecUtils.scala x: 105 lines of code y: 5 # changes spark/src/main/scala/org/apache/spark/sql/comet/ZippedPartitionsRDD.scala x: 33 lines of code y: 2 # changes common/src/main/scala/org/apache/comet/package.scala x: 47 lines of code y: 3 # changes common/src/main/java/org/apache/comet/parquet/ReadOptions.java x: 137 lines of code y: 4 # changes common/src/main/scala/org/apache/spark/sql/comet/execution/arrow/ArrowWriters.scala x: 384 lines of code y: 2 # changes common/src/main/scala/org/apache/spark/sql/comet/execution/arrow/CometArrowConverters.scala x: 139 lines of code y: 2 # changes spark/src/main/scala/org/apache/spark/sql/comet/CometWindowExec.scala x: 41 lines of code y: 6 # changes native/core/src/parquet/util/memory.rs x: 393 lines of code y: 2 # changes common/src/main/java/org/apache/comet/vector/CometDictionary.java x: 80 lines of code y: 7 # changes common/src/main/java/org/apache/comet/vector/CometDictionaryVector.java x: 96 lines of code y: 4 # changes fuzz-testing/src/main/scala/org/apache/comet/fuzz/QueryGen.scala x: 133 lines of code y: 4 # changes common/src/main/scala/org/apache/comet/vector/StreamReader.scala x: 31 lines of code y: 5 # changes native/core/src/parquet/util/bit_packing.rs x: 3070 lines of code y: 1 # changes common/src/main/java/org/apache/arrow/c/CometArrayImporter.java x: 103 lines of code y: 1 # changes common/src/main/java/org/apache/arrow/c/CometBufferImportTypeVisitor.java x: 316 lines of code y: 1 # changes common/src/main/scala/org/apache/comet/parquet/CometParquetUtils.scala x: 16 lines of code y: 3 # changes common/src/main/scala/org/apache/spark/sql/comet/parquet/CometSparkToParquetSchemaConverter.scala x: 174 lines of code y: 2 # changes dev/scalastyle-config.xml x: 238 lines of code y: 3 # changes common/src/main/java/org/apache/comet/vector/CometDecodedVector.java x: 68 lines of code y: 3 # changes spark/src/main/java/org/apache/spark/sql/comet/execution/shuffle/CometBypassMergeSortShuffleWriter.java x: 276 lines of code y: 2 # changes spark/src/main/java/org/apache/spark/sql/comet/execution/shuffle/CometUnsafeShuffleWriter.java x: 425 lines of code y: 2 # changes common/src/main/java/org/apache/comet/parquet/BloomFilterReader.java x: 197 lines of code y: 1 # changes common/src/main/java/org/apache/comet/parquet/ColumnIndexReader.java x: 177 lines of code y: 1 # changes common/src/main/java/org/apache/comet/parquet/ColumnPageReader.java x: 212 lines of code y: 1 # changes spark/src/main/scala/org/apache/comet/parquet/CometParquetScan.scala x: 57 lines of code y: 1 # changes
123.0
# changes
  min: 1.0
  average: 5.06
  25th percentile: 1.0
  median: 3.0
  75th percentile: 5.0
  max: 123.0
0 3089.0
lines of code
min: 1.0 | average: 180.55 | 25th percentile: 22.0 | median: 80.0 | 75th percentile: 174.5 | max: 3089.0

Number of Contributors vs. Number of Changes: 326 points

spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala x: 29 # contributors y: 123 # changes spark/src/main/scala/org/apache/comet/testing/ParquetGenerator.scala x: 2 # contributors y: 5 # changes common/src/main/scala/org/apache/comet/CometConf.scala x: 12 # contributors y: 65 # changes native/core/Cargo.toml x: 11 # contributors y: 31 # changes native/core/src/execution/jni_api.rs x: 9 # contributors y: 41 # changes spark/src/main/scala/org/apache/comet/CometExecIterator.scala x: 6 # contributors y: 25 # changes spark/src/main/scala/org/apache/comet/Native.scala x: 7 # contributors y: 20 # changes native/core/benches/row_columnar.rs x: 1 # contributors y: 4 # changes native/core/benches/shuffle_writer.rs x: 3 # contributors y: 9 # changes native/core/src/execution/planner.rs x: 11 # contributors y: 29 # changes native/core/src/execution/shuffle/codec.rs x: 3 # contributors y: 6 # changes native/core/src/execution/shuffle/mod.rs x: 2 # contributors y: 8 # changes native/core/src/execution/shuffle/row.rs x: 4 # contributors y: 15 # changes native/core/src/execution/shuffle/shuffle_writer.rs x: 4 # contributors y: 18 # changes native/core/src/parquet/util/jni.rs x: 4 # contributors y: 6 # changes native/proto/src/proto/operator.proto x: 4 # contributors y: 11 # changes spark/src/main/scala/org/apache/comet/rules/CometExecRule.scala x: 1 # contributors y: 2 # changes spark/src/main/scala/org/apache/spark/sql/comet/execution/shuffle/CometNativeShuffleWriter.scala x: 2 # contributors y: 3 # changes native/spark-expr/src/conversion_funcs/cast.rs x: 5 # contributors y: 7 # changes spark/src/main/scala/org/apache/comet/CometSparkSessionExtensions.scala x: 17 # contributors y: 83 # changes spark/src/main/scala/org/apache/comet/DataTypeSupport.scala x: 4 # contributors y: 5 # changes spark/src/main/scala/org/apache/comet/rules/CometScanRule.scala x: 2 # contributors y: 2 # changes spark/src/main/scala/org/apache/spark/sql/comet/CometScanExec.scala x: 11 # contributors y: 19 # changes spark/src/main/scala/org/apache/comet/rules/EliminateRedundantTransitions.scala x: 1 # contributors y: 1 # changes spark/src/main/scala/org/apache/comet/serde/arrays.scala x: 3 # contributors y: 8 # changes native/core/src/execution/operators/scan.rs x: 4 # contributors y: 19 # changes native/spark-expr/src/comet_scalar_funcs.rs x: 5 # contributors y: 10 # changes common/src/main/java/org/apache/comet/parquet/BatchReader.java x: 6 # contributors y: 10 # changes common/src/main/java/org/apache/comet/parquet/ColumnReader.java x: 4 # contributors y: 7 # changes common/src/main/java/org/apache/comet/parquet/LazyColumnReader.java x: 3 # contributors y: 3 # changes common/src/main/java/org/apache/comet/parquet/NativeBatchReader.java x: 3 # contributors y: 11 # changes native/core/src/lib.rs x: 4 # contributors y: 8 # changes native/Cargo.toml x: 11 # contributors y: 43 # changes native/core/benches/bit_util.rs x: 3 # contributors y: 4 # changes native/core/src/errors.rs x: 4 # contributors y: 9 # changes native/core/src/execution/serde.rs x: 2 # contributors y: 4 # changes native/spark-expr/Cargo.toml x: 7 # contributors y: 18 # changes spark/src/main/scala/org/apache/spark/sql/comet/execution/shuffle/CometShuffleExchangeExec.scala x: 6 # contributors y: 19 # changes native/core/src/parquet/parquet_support.rs x: 6 # contributors y: 8 # changes common/src/main/java/org/apache/comet/parquet/Native.java x: 6 # contributors y: 9 # changes native/core/src/parquet/mod.rs x: 6 # contributors y: 15 # changes spark/src/main/scala/org/apache/comet/parquet/CometParquetFileFormat.scala x: 5 # contributors y: 9 # changes common/src/main/scala/org/apache/spark/sql/comet/util/Utils.scala x: 7 # contributors y: 9 # changes spark/src/main/scala/org/apache/spark/sql/comet/execution/shuffle/CometShuffleManager.scala x: 5 # contributors y: 6 # changes spark/src/main/scala/org/apache/spark/sql/comet/CometBroadcastExchangeExec.scala x: 4 # contributors y: 13 # changes native/spark-expr/src/hash_funcs/utils.rs x: 4 # contributors y: 4 # changes spark/src/main/scala/org/apache/spark/Plugins.scala x: 8 # contributors y: 12 # changes spark/src/main/scala/org/apache/spark/sql/comet/CometTakeOrderedAndProjectExec.scala x: 4 # contributors y: 12 # changes spark/src/main/scala/org/apache/spark/sql/comet/operators.scala x: 10 # contributors y: 33 # changes spark/src/main/spark-3.x/org/apache/comet/shims/ShimCometShuffleExchangeExec.scala x: 3 # contributors y: 5 # changes native/spark-expr/src/utils.rs x: 3 # contributors y: 7 # changes native/spark-expr/src/lib.rs x: 9 # contributors y: 28 # changes common/src/main/scala/org/apache/comet/vector/NativeUtil.scala x: 5 # contributors y: 14 # changes spark/src/main/scala/org/apache/spark/shuffle/sort/RowPartition.scala x: 1 # contributors y: 3 # changes
123.0
# changes
  min: 1.0
  average: 5.06
  25th percentile: 1.0
  median: 3.0
  75th percentile: 5.0
  max: 123.0
0 29.0
# contributors
min: 1.0 | average: 2.68 | 25th percentile: 1.0 | median: 2.0 | 75th percentile: 3.0 | max: 29.0

Number of Contributors vs. File Size: 326 points

spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala x: 29 # contributors y: 2504 lines of code spark/src/main/scala/org/apache/comet/testing/ParquetGenerator.scala x: 2 # contributors y: 194 lines of code common/src/main/scala/org/apache/comet/CometConf.scala x: 12 # contributors y: 725 lines of code native/core/Cargo.toml x: 11 # contributors y: 111 lines of code native/core/src/execution/jni_api.rs x: 9 # contributors y: 543 lines of code spark/src/main/scala/org/apache/comet/CometExecIterator.scala x: 6 # contributors y: 142 lines of code spark/src/main/scala/org/apache/comet/Native.scala x: 7 # contributors y: 49 lines of code native/core/benches/row_columnar.rs x: 1 # contributors y: 80 lines of code native/core/benches/shuffle_writer.rs x: 3 # contributors y: 128 lines of code native/core/src/execution/planner.rs x: 11 # contributors y: 2783 lines of code native/core/src/execution/shuffle/codec.rs x: 3 # contributors y: 186 lines of code native/core/src/execution/shuffle/mod.rs x: 2 # contributors y: 7 lines of code native/core/src/execution/shuffle/row.rs x: 4 # contributors y: 3089 lines of code native/core/src/execution/shuffle/shuffle_writer.rs x: 4 # contributors y: 1053 lines of code native/core/src/parquet/util/jni.rs x: 4 # contributors y: 212 lines of code native/proto/src/proto/operator.proto x: 4 # contributors y: 198 lines of code spark/src/main/java/org/apache/spark/sql/comet/execution/shuffle/SpillWriter.java x: 3 # contributors y: 149 lines of code spark/src/main/scala/org/apache/comet/rules/CometExecRule.scala x: 1 # contributors y: 536 lines of code spark/src/main/scala/org/apache/spark/sql/comet/execution/shuffle/CometNativeShuffleWriter.scala x: 2 # contributors y: 160 lines of code native/spark-expr/src/conversion_funcs/cast.rs x: 5 # contributors y: 2312 lines of code spark/src/main/scala/org/apache/comet/CometSparkSessionExtensions.scala x: 17 # contributors y: 250 lines of code spark/src/main/scala/org/apache/comet/DataTypeSupport.scala x: 4 # contributors y: 62 lines of code spark/src/main/scala/org/apache/comet/rules/CometScanRule.scala x: 2 # contributors y: 141 lines of code spark/src/main/scala/org/apache/spark/sql/comet/CometScanExec.scala x: 11 # contributors y: 425 lines of code spark/src/main/scala/org/apache/spark/sql/comet/CometSparkToColumnarExec.scala x: 4 # contributors y: 108 lines of code spark/src/main/scala/org/apache/comet/rules/EliminateRedundantTransitions.scala x: 1 # contributors y: 53 lines of code spark/src/main/scala/org/apache/comet/serde/arrays.scala x: 3 # contributors y: 264 lines of code native/core/src/execution/operators/scan.rs x: 4 # contributors y: 382 lines of code native/spark-expr/src/array_funcs/array_repeat.rs x: 1 # contributors y: 147 lines of code native/spark-expr/src/comet_scalar_funcs.rs x: 5 # contributors y: 142 lines of code spark/src/main/scala/org/apache/comet/serde/hash.scala x: 2 # contributors y: 57 lines of code fuzz-testing/src/main/scala/org/apache/comet/fuzz/Meta.scala x: 3 # contributors y: 104 lines of code common/src/main/java/org/apache/arrow/c/AbstractCometSchemaImporter.java x: 1 # contributors y: 36 lines of code common/src/main/java/org/apache/comet/CometSchemaImporter.java x: 1 # contributors y: 8 lines of code common/src/main/java/org/apache/comet/parquet/BatchReader.java x: 6 # contributors y: 445 lines of code common/src/main/java/org/apache/comet/parquet/NativeBatchReader.java x: 3 # contributors y: 419 lines of code common/src/main/java/org/apache/comet/parquet/NativeColumnReader.java x: 1 # contributors y: 89 lines of code common/src/main/java/org/apache/comet/parquet/Utils.java x: 4 # contributors y: 187 lines of code native/core/src/lib.rs x: 4 # contributors y: 73 lines of code native/Cargo.toml x: 11 # contributors y: 54 lines of code native/core/benches/bit_util.rs x: 3 # contributors y: 162 lines of code native/core/benches/parquet_read.rs x: 4 # contributors y: 125 lines of code native/core/src/common/bit.rs x: 4 # contributors y: 1249 lines of code native/core/src/errors.rs x: 4 # contributors y: 663 lines of code native/core/src/execution/serde.rs x: 2 # contributors y: 157 lines of code native/proto/Cargo.toml x: 2 # contributors y: 30 lines of code native/spark-expr/Cargo.toml x: 7 # contributors y: 63 lines of code spark/src/main/scala/org/apache/spark/sql/comet/execution/shuffle/CometShuffleExchangeExec.scala x: 6 # contributors y: 296 lines of code native/core/src/execution/memory_pools/unified_pool.rs x: 1 # contributors y: 22 lines of code native/core/src/execution/mod.rs x: 3 # contributors y: 21 lines of code native/core/src/parquet/parquet_support.rs x: 6 # contributors y: 281 lines of code native/core/src/execution/expressions/bloom_filter_might_contain.rs x: 2 # contributors y: 109 lines of code native/core/src/execution/operators/copy.rs x: 4 # contributors y: 226 lines of code native/core/src/execution/operators/filter.rs x: 5 # contributors y: 470 lines of code native/hdfs/src/object_store/hdfs.rs x: 2 # contributors y: 536 lines of code native/spark-expr/src/array_funcs/array_insert.rs x: 3 # contributors y: 252 lines of code native/spark-expr/src/bitwise_funcs/bitwise_not.rs x: 3 # contributors y: 90 lines of code native/spark-expr/src/conditional_funcs/if_expr.rs x: 3 # contributors y: 116 lines of code native/spark-expr/src/json_funcs/to_json.rs x: 3 # contributors y: 303 lines of code native/spark-expr/src/math_funcs/negative.rs x: 3 # contributors y: 208 lines of code native/spark-expr/src/string_funcs/string_space.rs x: 3 # contributors y: 77 lines of code common/src/main/java/org/apache/comet/parquet/FileReader.java x: 3 # contributors y: 938 lines of code common/src/main/java/org/apache/comet/parquet/Native.java x: 6 # contributors y: 76 lines of code common/src/main/java/org/apache/comet/parquet/RowGroupFilter.java x: 2 # contributors y: 86 lines of code common/src/main/java/org/apache/comet/parquet/TypeUtil.java x: 4 # contributors y: 293 lines of code native/core/src/parquet/mod.rs x: 6 # contributors y: 687 lines of code spark/src/main/scala/org/apache/comet/parquet/CometParquetFileFormat.scala x: 5 # contributors y: 223 lines of code native/core/src/execution/shuffle/map.rs x: 3 # contributors y: 2574 lines of code common/src/main/scala/org/apache/spark/sql/comet/util/Utils.scala x: 7 # contributors y: 216 lines of code spark/src/main/scala/org/apache/comet/serde/aggregates.scala x: 2 # contributors y: 644 lines of code spark/src/main/scala/org/apache/spark/sql/comet/CometColumnarToRowExec.scala x: 2 # contributors y: 233 lines of code native/spark-expr/src/hash_funcs/utils.rs x: 4 # contributors y: 431 lines of code native/spark-expr/src/agg_funcs/correlation.rs x: 3 # contributors y: 195 lines of code spark/src/main/scala/org/apache/comet/parquet/CometParquetPartitionReaderFactory.scala x: 4 # contributors y: 178 lines of code spark/src/main/scala/org/apache/comet/parquet/ParquetFilters.scala x: 5 # contributors y: 834 lines of code spark/src/main/scala/org/apache/comet/parquet/SourceFilterSerde.scala x: 1 # contributors y: 135 lines of code spark/src/main/spark-3.5/org/apache/spark/sql/comet/shims/ShimCometScanExec.scala x: 5 # contributors y: 101 lines of code native/proto/src/proto/expr.proto x: 11 # contributors y: 410 lines of code spark/src/main/scala/org/apache/spark/Plugins.scala x: 8 # contributors y: 68 lines of code spark/src/main/java/org/apache/spark/shuffle/comet/CometBoundedShuffleMemoryAllocator.java x: 2 # contributors y: 121 lines of code spark/src/main/scala/org/apache/spark/sql/comet/CometBatchScanExec.scala x: 5 # contributors y: 95 lines of code spark/src/main/scala/org/apache/spark/sql/comet/CometTakeOrderedAndProjectExec.scala x: 4 # contributors y: 96 lines of code spark/src/main/scala/org/apache/spark/sql/comet/operators.scala x: 10 # contributors y: 746 lines of code spark/src/main/scala/org/apache/spark/sql/comet/plans/AliasAwareOutputExpression.scala x: 3 # contributors y: 48 lines of code spark/src/main/spark-3.4/org/apache/spark/sql/comet/shims/ShimCometScanExec.scala x: 1 # contributors y: 44 lines of code spark/src/main/spark-3.x/org/apache/comet/shims/ShimCometSparkSessionExtensions.scala x: 2 # contributors y: 16 lines of code spark/src/main/spark-4.0/org/apache/spark/sql/comet/shims/ShimCometScanExec.scala x: 3 # contributors y: 55 lines of code native/core/benches/filter.rs x: 2 # contributors y: 81 lines of code native/core/benches/parquet_decode.rs x: 3 # contributors y: 35 lines of code native/core/src/execution/expressions/bloom_filter_agg.rs x: 2 # contributors y: 133 lines of code native/core/src/execution/shuffle/list.rs x: 2 # contributors y: 291 lines of code native/core/src/execution/spark_plan.rs x: 2 # contributors y: 63 lines of code native/spark-expr/benches/cast_numeric.rs x: 2 # contributors y: 46 lines of code native/spark-expr/benches/decimal_div.rs x: 4 # contributors y: 41 lines of code native/spark-expr/src/agg_funcs/avg.rs x: 2 # contributors y: 257 lines of code native/spark-expr/src/agg_funcs/avg_decimal.rs x: 3 # contributors y: 409 lines of code native/spark-expr/src/agg_funcs/sum_decimal.rs x: 3 # contributors y: 429 lines of code native/spark-expr/src/hash_funcs/murmur3.rs x: 2 # contributors y: 225 lines of code native/spark-expr/src/hash_funcs/xxhash64.rs x: 2 # contributors y: 218 lines of code native/spark-expr/src/kernels/temporal.rs x: 3 # contributors y: 1010 lines of code native/spark-expr/src/math_funcs/round.rs x: 3 # contributors y: 182 lines of code spark/src/main/scala/org/apache/comet/expressions/CometCast.scala x: 6 # contributors y: 229 lines of code native/core/src/jvm_bridge/mod.rs x: 3 # contributors y: 290 lines of code native/spark-expr/src/lib.rs x: 9 # contributors y: 56 lines of code spark/src/main/scala/org/apache/comet/rules/RewriteJoin.scala x: 1 # contributors y: 69 lines of code common/src/main/java/org/apache/comet/vector/CometVector.java x: 6 # contributors y: 176 lines of code spark/src/main/scala/org/apache/spark/sql/comet/execution/shuffle/NativeBatchDecoderIterator.scala x: 1 # contributors y: 131 lines of code spark/src/main/java/org/apache/spark/shuffle/sort/CometShuffleExternalSorter.java x: 5 # contributors y: 410 lines of code spark/src/main/scala/org/apache/spark/sql/comet/execution/shuffle/CometBlockStoreShuffleReader.scala x: 1 # contributors y: 119 lines of code common/src/main/scala/org/apache/comet/vector/NativeUtil.scala x: 5 # contributors y: 111 lines of code common/src/main/java/org/apache/comet/vector/CometPlainVector.java x: 4 # contributors y: 147 lines of code native/core/src/common/buffer.rs x: 2 # contributors y: 254 lines of code native/core/src/parquet/read/column.rs x: 4 # contributors y: 806 lines of code spark/src/main/scala/org/apache/spark/sql/comet/execution/shuffle/CometShuffledRowRDD.scala x: 1 # contributors y: 109 lines of code native/core/src/parquet/read/values.rs x: 3 # contributors y: 888 lines of code common/src/main/java/org/apache/comet/parquet/ReadOptions.java x: 3 # contributors y: 137 lines of code common/src/main/scala/org/apache/spark/sql/comet/execution/arrow/ArrowWriters.scala x: 2 # contributors y: 384 lines of code native/core/src/parquet/util/memory.rs x: 2 # contributors y: 393 lines of code native/core/src/parquet/util/bit_packing.rs x: 1 # contributors y: 3070 lines of code common/src/main/java/org/apache/arrow/c/CometBufferImportTypeVisitor.java x: 1 # contributors y: 316 lines of code common/src/main/scala/org/apache/spark/sql/comet/parquet/CometSparkToParquetSchemaConverter.scala x: 2 # contributors y: 174 lines of code common/src/main/java/org/apache/comet/vector/CometDecodedVector.java x: 3 # contributors y: 68 lines of code spark/src/main/java/org/apache/spark/sql/comet/execution/shuffle/CometBypassMergeSortShuffleWriter.java x: 2 # contributors y: 276 lines of code spark/src/main/java/org/apache/spark/sql/comet/execution/shuffle/CometUnsafeShuffleWriter.java x: 1 # contributors y: 425 lines of code common/src/main/java/org/apache/comet/parquet/BloomFilterReader.java x: 1 # contributors y: 197 lines of code common/src/main/java/org/apache/comet/parquet/ColumnIndexReader.java x: 1 # contributors y: 177 lines of code common/src/main/java/org/apache/comet/parquet/ColumnPageReader.java x: 1 # contributors y: 212 lines of code
3089.0
lines of code
  min: 1.0
  average: 180.55
  25th percentile: 22.0
  median: 80.0
  75th percentile: 174.5
  max: 3089.0
0 29.0
# contributors
min: 1.0 | average: 2.68 | 25th percentile: 1.0 | median: 2.0 | 75th percentile: 3.0 | max: 29.0