apache / incubator-celeborn
File Change Frequency

File change frequency (churn) shows the distribution of file updates (days with at least one commit).

Overview
File Change Frequency Overall
  • There are 370 files with 47,226 lines of code.
    • 0 files changed more than 100 times (0 lines of code)
    • 6 files changed 51-100 times (7,272 lines of code)
    • 11 files changed 21-50 times (6,123 lines of code)
    • 82 files changed 6-20 times (14,703 lines of code)
    • 271 files changed 1-5 times (19,128 lines of code)
0% | 15% | 12% | 31% | 40%
Legend:
101+
51-100
21-50
6-20
1-5

explore: grouped by folders | grouped by update frequency | data
Contributors Count Frequency Overall
  • There are 370 files with 47,226 lines of code.
    • 0 files changed by more than 25 contributors (0 lines of code)
    • 13 files changed by 11-25 contributors (11,837 lines of code)
    • 38 files changed by 6-10 contributors (9,829 lines of code)
    • 154 files changed by 2-5 contributors (15,730 lines of code)
    • 165 files changed by 1 contributor (9,830 lines of code)
0% | 25% | 20% | 33% | 20%
Legend:
26+
11-25
6-10
2-5
1

explore: grouped by folders | grouped by contributors count | data
File Change Frequency per File Extension
java, scala, md, xml, sh, svg, yml, txt, yaml, py, patch, properties, sbt, proto, json, gitignore, gitattributes, tpl, bash
File Change Frequency per Extension
The number of recorded file updates
101+
51-100
21-50
6-20
1-5
scala0% | 25% | 20% | 23% | 30%
java0% | 6% | 7% | 37% | 48%
proto0% | 73% | 0% | 0% | 26%
yaml0% | 0% | 0% | 81% | 18%
py0% | 0% | 0% | 22% | 77%
yml0% | 0% | 0% | 87% | 12%
bash0% | 0% | 0% | 0% | 100%
tpl0% | 0% | 0% | 0% | 100%
sbt0% | 0% | 0% | 0% | 100%
File Change Frequency per Logical Decomposition
primary
primary (file change frequency)
The number of recorded file updates
101+
51-100
21-50
6-20
1-5
common0% | 20% | 10% | 26% | 42%
client0% | 40% | 1% | 42% | 15%
master0% | 22% | 7% | 55% | 14%
worker0% | 8% | 48% | 17% | 26%
client-flink0% | 0% | 8% | 19% | 72%
client-spark0% | 0% | 0% | 46% | 53%
charts0% | 0% | 0% | 72% | 27%
service0% | 0% | 0% | 60% | 39%
toolkit0% | 0% | 0% | 63% | 36%
ROOT0% | 0% | 0% | 86% | 13%
project0% | 0% | 0% | 0% | 100%
dev0% | 0% | 0% | 0% | 100%
build0% | 0% | 0% | 0% | 100%
Most Frequently Changed Files (Top 50)

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
CelebornConf.scala
in common/src/main/scala/org/apache/celeborn/common
 3090 81 2022-10-20 2023-08-07 92 20 angers.zhu@gmail.com zky.zhoukeyong@alibaba-inc.com
ShuffleClientImpl.java
in client/src/main/java/org/apache/celeborn/client
 1513 45 2022-10-02 2023-07-25 73 20 zky.zhoukeyong@alibaba-inc.com 1178404354@qq.com
LifecycleManager.scala
in client/src/main/scala/org/apache/celeborn/client
 884 33 2022-10-08 2023-08-08 71 14 angers.zhu@gmail.com fengmingxiao.fmx@alibaba-in...
Worker.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker
 595 12 2022-10-08 2023-07-27 62 18 chengpan@apache.org angers.zhu@gmail.com
proto
TransportMessages.proto
in common/src/main/proto
 407 - 2022-01-29 2023-08-07 60 11 fengmingxiao.fmx@alibaba-in... zky.zhoukeyong@alibaba-inc.com
Master.scala
in master/src/main/scala/org/apache/celeborn/service/deploy/master
 783 23 2022-10-08 2023-08-07 55 11 angers.zhu@gmail.com zky.zhoukeyong@alibaba-inc.com
StorageManager.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage
 713 28 2022-10-08 2023-08-04 47 19 chengpan@apache.org fengmingxiao.fmx@alibaba-in...
PushDataHandler.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker
 953 23 2022-10-08 2023-08-01 47 15 chengpan@apache.org caojiaqing@bilibili.com
ControlMessages.scala
in common/src/main/scala/org/apache/celeborn/common/protocol/message
 842 14 2022-10-02 2023-08-07 40 12 zky.zhoukeyong@alibaba-inc.com zky.zhoukeyong@alibaba-inc.com
Utils.scala
in common/src/main/scala/org/apache/celeborn/common/util
 882 78 2022-10-02 2023-08-04 40 16 zky.zhoukeyong@alibaba-inc.com zky.zhoukeyong@alibaba-inc.com
Controller.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker
 587 6 2022-10-08 2023-07-03 28 12 chengpan@apache.org chengpan@apache.org
ShuffleClient.java
in client/src/main/java/org/apache/celeborn/client
 103 4 2022-10-02 2023-07-31 26 13 zky.zhoukeyong@alibaba-inc.com zky.zhoukeyong@alibaba-inc.com
AbstractMetaManager.java
in master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta
 267 12 2022-10-08 2023-07-27 26 9 chengpan@apache.org angers.zhu@gmail.com
FetchHandler.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker
 319 13 2022-10-08 2023-08-08 26 9 chengpan@apache.org lvshuang.tb@gmail.com
FileWriter.java
in worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage
 364 29 2022-10-08 2023-08-04 24 10 chengpan@apache.org fengmingxiao.fmx@alibaba-in...
PartitionFilesSorter.java
in worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage
 608 27 2022-10-08 2023-07-27 22 7 chengpan@apache.org fengmingxiao.fmx@alibaba-in...
FlinkShuffleClientImpl.java
in client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient
 485 17 2023-02-17 2023-08-08 21 11 ethanfeng@apache.org fengmingxiao.fmx@alibaba-in...
CommitHandler.scala
in client/src/main/scala/org/apache/celeborn/client/commit
 386 13 2022-12-15 2023-06-29 20 8 lvshuang.tb@gmail.com cfmcgrady@gmail.com
ChangePartitionManager.scala
in client/src/main/scala/org/apache/celeborn/client
 267 8 2022-12-05 2023-08-08 19 6 angers.zhu@gmail.com fengmingxiao.fmx@alibaba-in...
HashBasedShuffleWriter.java
in client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn
 416 14 2022-10-08 2023-07-19 19 9 chengpan@apache.org lyh-36@163.com
WorkerSource.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker
 83 - 2022-10-08 2023-08-01 18 10 chengpan@apache.org caojiaqing@bilibili.com
CommitManager.scala
in client/src/main/scala/org/apache/celeborn/client
 265 18 2022-12-06 2023-07-19 18 10 angers.zhu@gmail.com lyh-36@163.com
StatusCode.java
in common/src/main/java/org/apache/celeborn/common/protocol/message
 59 1 2022-10-02 2023-06-29 17 6 zky.zhoukeyong@alibaba-inc.com cfmcgrady@gmail.com
DeviceMonitor.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage
 248 19 2022-10-08 2023-07-03 17 6 chengpan@apache.org chengpan@apache.org
PbSerDeUtils.scala
in common/src/main/scala/org/apache/celeborn/common/util
 350 17 2022-10-31 2023-06-29 17 9 30563796+nafiyaix@users.nor... cfmcgrady@gmail.com
SortBasedShuffleWriter.java
in client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn
 359 13 2022-10-08 2023-07-19 17 7 chengpan@apache.org lyh-36@163.com
HttpService.scala
in service/src/main/scala/org/apache/celeborn/server/common
 73 5 2022-10-08 2023-07-27 16 6 chengpan@apache.org angers.zhu@gmail.com
WorkerInfo.scala
in common/src/main/scala/org/apache/celeborn/common/meta
 219 19 2022-10-02 2023-07-14 16 10 zky.zhoukeyong@alibaba-inc.com fengmingxiao.fmx@alibaba-in...
AbstractSource.scala
in common/src/main/scala/org/apache/celeborn/common/metrics/source
 339 36 2022-10-02 2023-07-04 15 9 zky.zhoukeyong@alibaba-inc.com angers.zhu@gmail.com
mkdocs.yml
in root
 75 - 2022-09-09 2023-08-04 14 5 chengpan@apache.org xiyu.zk@alibaba-inc.com
Flusher.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage
 163 11 2022-10-08 2023-07-13 14 8 chengpan@apache.org zky.zhoukeyong@alibaba-inc.com
MapPartitionCommitHandler.scala
in client/src/main/scala/org/apache/celeborn/client/commit
 172 14 2022-12-15 2023-06-29 14 5 lvshuang.tb@gmail.com cfmcgrady@gmail.com
WorkerStatusTracker.scala
in client/src/main/scala/org/apache/celeborn/client
 188 8 2023-04-12 2023-07-19 14 5 angers.zhu@gmail.com lyh-36@163.com
DataPusher.java
in client/src/main/java/org/apache/celeborn/client/write
 193 10 2022-10-02 2023-07-31 14 6 zky.zhoukeyong@alibaba-inc.com cfmcgrady@gmail.com
ReducePartitionCommitHandler.scala
in client/src/main/scala/org/apache/celeborn/client/commit
 236 20 2022-12-15 2023-06-29 14 6 lvshuang.tb@gmail.com cfmcgrady@gmail.com
SortBasedPusher.java
in client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn
 341 16 2022-10-08 2023-07-17 14 6 chengpan@apache.org zky.zhoukeyong@alibaba-inc.com
WorkerPartitionReader.java
in client/src/main/java/org/apache/celeborn/client/read
 166 8 2022-10-02 2023-08-05 13 8 zky.zhoukeyong@alibaba-inc.com fengmingxiao.fmx@alibaba-in...
TransportClientFactory.java
in common/src/main/java/org/apache/celeborn/common/network/client
 181 8 2022-10-02 2023-08-05 13 8 zky.zhoukeyong@alibaba-inc.com cfmcgrady@gmail.com
TransportClient.java
in common/src/main/java/org/apache/celeborn/common/network/client
 253 24 2022-10-02 2023-08-05 13 8 zky.zhoukeyong@alibaba-inc.com cfmcgrady@gmail.com
HAMasterMetaManager.java
in master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha
 257 13 2022-10-08 2023-07-27 13 6 chengpan@apache.org angers.zhu@gmail.com
TransportResponseHandler.java
in common/src/main/java/org/apache/celeborn/common/network/client
 307 17 2022-10-02 2023-08-05 13 6 zky.zhoukeyong@alibaba-inc.com cfmcgrady@gmail.com
HashBasedShuffleWriter.java
in client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn
 316 11 2022-10-08 2023-07-17 13 7 chengpan@apache.org zky.zhoukeyong@alibaba-inc.com
SortBasedShuffleWriter.java
in client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn
 342 12 2022-10-08 2023-07-17 13 6 chengpan@apache.org zky.zhoukeyong@alibaba-inc.com
HARaftServer.java
in master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha
 394 23 2022-10-08 2023-07-19 13 6 chengpan@apache.org lyh-36@163.com
FileInfo.java
in common/src/main/java/org/apache/celeborn/common/meta
 177 31 2022-10-02 2023-07-05 12 7 zky.zhoukeyong@alibaba-inc.com fengmingxiao.fmx@alibaba-in...
ConfigEntry.scala
in common/src/main/scala/org/apache/celeborn/common/internal/config
 185 8 2022-10-02 2023-07-04 12 7 zky.zhoukeyong@alibaba-inc.com angers.zhu@gmail.com
master-statefulset.yaml
in charts/celeborn/templates
 123 - 2023-01-11 2023-06-16 11 5 52876270+zwangsheng@users.n... 2213335496@qq.com
worker-statefulset.yaml
in charts/celeborn/templates
 129 - 2023-01-11 2023-06-16 11 4 52876270+zwangsheng@users.n... 2213335496@qq.com
InFlightRequestTracker.java
in common/src/main/java/org/apache/celeborn/common/write
 140 10 2023-02-03 2023-07-17 11 5 angers.zhu@gmail.com zky.zhoukeyong@alibaba-inc.com
SingleMasterMetaManager.java
in master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta
 98 11 2022-10-08 2023-07-27 10 4 chengpan@apache.org angers.zhu@gmail.com
Files With Most Contributors (Top 50)
Based on the number of unique email addresses found in commits.

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
CelebornConf.scala
in common/src/main/scala/org/apache/celeborn/common
 3090 81 2022-10-20 2023-08-07 92 20 angers.zhu@gmail.com zky.zhoukeyong@alibaba-inc.com
ShuffleClientImpl.java
in client/src/main/java/org/apache/celeborn/client
 1513 45 2022-10-02 2023-07-25 73 20 zky.zhoukeyong@alibaba-inc.com 1178404354@qq.com
StorageManager.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage
 713 28 2022-10-08 2023-08-04 47 19 chengpan@apache.org fengmingxiao.fmx@alibaba-in...
Worker.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker
 595 12 2022-10-08 2023-07-27 62 18 chengpan@apache.org angers.zhu@gmail.com
Utils.scala
in common/src/main/scala/org/apache/celeborn/common/util
 882 78 2022-10-02 2023-08-04 40 16 zky.zhoukeyong@alibaba-inc.com zky.zhoukeyong@alibaba-inc.com
PushDataHandler.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker
 953 23 2022-10-08 2023-08-01 47 15 chengpan@apache.org caojiaqing@bilibili.com
LifecycleManager.scala
in client/src/main/scala/org/apache/celeborn/client
 884 33 2022-10-08 2023-08-08 71 14 angers.zhu@gmail.com fengmingxiao.fmx@alibaba-in...
ShuffleClient.java
in client/src/main/java/org/apache/celeborn/client
 103 4 2022-10-02 2023-07-31 26 13 zky.zhoukeyong@alibaba-inc.com zky.zhoukeyong@alibaba-inc.com
ControlMessages.scala
in common/src/main/scala/org/apache/celeborn/common/protocol/message
 842 14 2022-10-02 2023-08-07 40 12 zky.zhoukeyong@alibaba-inc.com zky.zhoukeyong@alibaba-inc.com
Controller.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker
 587 6 2022-10-08 2023-07-03 28 12 chengpan@apache.org chengpan@apache.org
proto
TransportMessages.proto
in common/src/main/proto
 407 - 2022-01-29 2023-08-07 60 11 fengmingxiao.fmx@alibaba-in... zky.zhoukeyong@alibaba-inc.com
Master.scala
in master/src/main/scala/org/apache/celeborn/service/deploy/master
 783 23 2022-10-08 2023-08-07 55 11 angers.zhu@gmail.com zky.zhoukeyong@alibaba-inc.com
FlinkShuffleClientImpl.java
in client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient
 485 17 2023-02-17 2023-08-08 21 11 ethanfeng@apache.org fengmingxiao.fmx@alibaba-in...
FileWriter.java
in worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage
 364 29 2022-10-08 2023-08-04 24 10 chengpan@apache.org fengmingxiao.fmx@alibaba-in...
WorkerSource.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker
 83 - 2022-10-08 2023-08-01 18 10 chengpan@apache.org caojiaqing@bilibili.com
CommitManager.scala
in client/src/main/scala/org/apache/celeborn/client
 265 18 2022-12-06 2023-07-19 18 10 angers.zhu@gmail.com lyh-36@163.com
WorkerInfo.scala
in common/src/main/scala/org/apache/celeborn/common/meta
 219 19 2022-10-02 2023-07-14 16 10 zky.zhoukeyong@alibaba-inc.com fengmingxiao.fmx@alibaba-in...
AbstractMetaManager.java
in master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta
 267 12 2022-10-08 2023-07-27 26 9 chengpan@apache.org angers.zhu@gmail.com
FetchHandler.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker
 319 13 2022-10-08 2023-08-08 26 9 chengpan@apache.org lvshuang.tb@gmail.com
HashBasedShuffleWriter.java
in client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn
 416 14 2022-10-08 2023-07-19 19 9 chengpan@apache.org lyh-36@163.com
PbSerDeUtils.scala
in common/src/main/scala/org/apache/celeborn/common/util
 350 17 2022-10-31 2023-06-29 17 9 30563796+nafiyaix@users.nor... cfmcgrady@gmail.com
AbstractSource.scala
in common/src/main/scala/org/apache/celeborn/common/metrics/source
 339 36 2022-10-02 2023-07-04 15 9 zky.zhoukeyong@alibaba-inc.com angers.zhu@gmail.com
CommitHandler.scala
in client/src/main/scala/org/apache/celeborn/client/commit
 386 13 2022-12-15 2023-06-29 20 8 lvshuang.tb@gmail.com cfmcgrady@gmail.com
Flusher.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage
 163 11 2022-10-08 2023-07-13 14 8 chengpan@apache.org zky.zhoukeyong@alibaba-inc.com
TransportClient.java
in common/src/main/java/org/apache/celeborn/common/network/client
 253 24 2022-10-02 2023-08-05 13 8 zky.zhoukeyong@alibaba-inc.com cfmcgrady@gmail.com
TransportClientFactory.java
in common/src/main/java/org/apache/celeborn/common/network/client
 181 8 2022-10-02 2023-08-05 13 8 zky.zhoukeyong@alibaba-inc.com cfmcgrady@gmail.com
WorkerPartitionReader.java
in client/src/main/java/org/apache/celeborn/client/read
 166 8 2022-10-02 2023-08-05 13 8 zky.zhoukeyong@alibaba-inc.com fengmingxiao.fmx@alibaba-in...
PartitionFilesSorter.java
in worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage
 608 27 2022-10-08 2023-07-27 22 7 chengpan@apache.org fengmingxiao.fmx@alibaba-in...
SortBasedShuffleWriter.java
in client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn
 359 13 2022-10-08 2023-07-19 17 7 chengpan@apache.org lyh-36@163.com
HashBasedShuffleWriter.java
in client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn
 316 11 2022-10-08 2023-07-17 13 7 chengpan@apache.org zky.zhoukeyong@alibaba-inc.com
FileInfo.java
in common/src/main/java/org/apache/celeborn/common/meta
 177 31 2022-10-02 2023-07-05 12 7 zky.zhoukeyong@alibaba-inc.com fengmingxiao.fmx@alibaba-in...
ConfigEntry.scala
in common/src/main/scala/org/apache/celeborn/common/internal/config
 185 8 2022-10-02 2023-07-04 12 7 zky.zhoukeyong@alibaba-inc.com angers.zhu@gmail.com
DeviceInfo.scala
in common/src/main/scala/org/apache/celeborn/common/meta
 225 17 2022-10-02 2023-07-06 10 7 zky.zhoukeyong@alibaba-inc.com chengpan@apache.org
PartitionLocation.java
in common/src/main/java/org/apache/celeborn/common/protocol
 271 38 2022-10-02 2023-06-29 9 7 zky.zhoukeyong@alibaba-inc.com cfmcgrady@gmail.com
ChangePartitionManager.scala
in client/src/main/scala/org/apache/celeborn/client
 267 8 2022-12-05 2023-08-08 19 6 angers.zhu@gmail.com fengmingxiao.fmx@alibaba-in...
StatusCode.java
in common/src/main/java/org/apache/celeborn/common/protocol/message
 59 1 2022-10-02 2023-06-29 17 6 zky.zhoukeyong@alibaba-inc.com cfmcgrady@gmail.com
DeviceMonitor.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage
 248 19 2022-10-08 2023-07-03 17 6 chengpan@apache.org chengpan@apache.org
HttpService.scala
in service/src/main/scala/org/apache/celeborn/server/common
 73 5 2022-10-08 2023-07-27 16 6 chengpan@apache.org angers.zhu@gmail.com
SortBasedPusher.java
in client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn
 341 16 2022-10-08 2023-07-17 14 6 chengpan@apache.org zky.zhoukeyong@alibaba-inc.com
DataPusher.java
in client/src/main/java/org/apache/celeborn/client/write
 193 10 2022-10-02 2023-07-31 14 6 zky.zhoukeyong@alibaba-inc.com cfmcgrady@gmail.com
ReducePartitionCommitHandler.scala
in client/src/main/scala/org/apache/celeborn/client/commit
 236 20 2022-12-15 2023-06-29 14 6 lvshuang.tb@gmail.com cfmcgrady@gmail.com
SortBasedShuffleWriter.java
in client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn
 342 12 2022-10-08 2023-07-17 13 6 chengpan@apache.org zky.zhoukeyong@alibaba-inc.com
TransportResponseHandler.java
in common/src/main/java/org/apache/celeborn/common/network/client
 307 17 2022-10-02 2023-08-05 13 6 zky.zhoukeyong@alibaba-inc.com cfmcgrady@gmail.com
HAMasterMetaManager.java
in master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha
 257 13 2022-10-08 2023-07-27 13 6 chengpan@apache.org angers.zhu@gmail.com
HARaftServer.java
in master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha
 394 23 2022-10-08 2023-07-19 13 6 chengpan@apache.org lyh-36@163.com
MetaHandler.java
in master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha
 213 6 2022-10-08 2023-07-14 10 6 chengpan@apache.org fengmingxiao.fmx@alibaba-in...
DfsPartitionReader.java
in client/src/main/java/org/apache/celeborn/client/read
 228 8 2022-10-02 2023-08-05 10 6 zky.zhoukeyong@alibaba-inc.com fengmingxiao.fmx@alibaba-in...
MapPartitionFileWriter.java
in worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage
 246 10 2022-12-08 2023-04-25 9 6 96606293+zhongqiangczq@user... lvshuang.tb@gmail.com
PushState.java
in common/src/main/java/org/apache/celeborn/common/write
 55 12 2023-02-03 2023-06-29 8 6 angers.zhu@gmail.com cfmcgrady@gmail.com
StateMachine.java
in master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha
 334 23 2022-10-08 2023-07-19 7 6 chengpan@apache.org lyh-36@163.com
Files With Least Contributors (Top 50)
Based on the number of unique email addresses found in commits.

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
588 4 2023-07-28 2023-08-01 2 1 cfmcgrady@gmail.com cfmcgrady@gmail.com
CelebornInputStream.java
in client/src/main/java/org/apache/celeborn/client/read
 497 20 2023-07-04 2023-07-04 1 1 angers.zhu@gmail.com angers.zhu@gmail.com
CelebornColumnType.scala
in client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar
 485 94 2023-07-04 2023-07-04 1 1 angers.zhu@gmail.com angers.zhu@gmail.com
406 14 2023-06-02 2023-06-02 1 1 chengpan@apache.org chengpan@apache.org
CelebornCompressionSchemes.scala
in client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar
 355 24 2023-07-04 2023-07-04 1 1 angers.zhu@gmail.com angers.zhu@gmail.com
CelebornColumnBuilder.scala
in client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar
 299 17 2023-07-04 2023-07-04 1 1 angers.zhu@gmail.com angers.zhu@gmail.com
CelebornColumnarBatchCodeGenBuild.scala
in client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar
 271 3 2023-07-04 2023-07-04 1 1 angers.zhu@gmail.com angers.zhu@gmail.com
DynMethods.java
in common/src/main/java/org/apache/celeborn/reflect
 262 40 2022-10-29 2022-10-29 1 1 chengpan@apache.org chengpan@apache.org
CreditStreamManager.java
in worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage
 260 24 2023-04-20 2023-04-20 1 1 ethanfeng@apache.org ethanfeng@apache.org
CelebornColumnStats.scala
in client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar
 233 21 2023-07-04 2023-07-04 1 1 angers.zhu@gmail.com angers.zhu@gmail.com
DynConstructors.java
in common/src/main/java/org/apache/celeborn/reflect
 233 26 2022-10-29 2022-10-29 1 1 chengpan@apache.org chengpan@apache.org
DynFields.java
in common/src/main/java/org/apache/celeborn/reflect
 225 36 2022-10-29 2022-10-29 1 1 chengpan@apache.org chengpan@apache.org
RemoteShuffleInputGate.java
in client-flink/flink-1.17/src/main/java/org/apache/celeborn/plugin/flink
 219 33 2023-05-05 2023-05-05 1 1 ethanfeng@apache.org ethanfeng@apache.org
RemoteShuffleInputGate.java
in client-flink/flink-1.15/src/main/java/org/apache/celeborn/plugin/flink
 212 32 2023-05-04 2023-05-04 1 1 ethanfeng@apache.org ethanfeng@apache.org
TransferBufferPool.java
in client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/buffer
 154 12 2023-02-17 2023-02-17 1 1 ethanfeng@apache.org ethanfeng@apache.org
151 - 2023-07-28 2023-07-28 1 1 cfmcgrady@gmail.com cfmcgrady@gmail.com
AbstractRemoteShuffleResultPartitionFactory.java
in client-flink/common/src/main/java/org/apache/celeborn/plugin/flink
 145 5 2023-05-04 2023-06-05 4 1 ethanfeng@apache.org ethanfeng@apache.org
CelebornColumnarBatchSerializer.scala
in client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar
 138 8 2023-07-04 2023-07-04 1 1 angers.zhu@gmail.com angers.zhu@gmail.com
AbstractRemoteShuffleEnvironment.java
in client-flink/common/src/main/java/org/apache/celeborn/plugin/flink
 132 10 2023-05-04 2023-05-04 1 1 ethanfeng@apache.org ethanfeng@apache.org
ChunkStreamManager.java
in worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage
 119 12 2023-04-20 2023-04-20 1 1 ethanfeng@apache.org ethanfeng@apache.org
BufferQueue.java
in worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory
 115 13 2023-04-20 2023-04-25 2 1 ethanfeng@apache.org ethanfeng@apache.org
LevelDBProvider.java
in worker/src/main/java/org/apache/celeborn/service/deploy/worker
 110 7 2022-10-08 2022-10-08 1 1 chengpan@apache.org chengpan@apache.org
CelebornColumnAccessor.scala
in client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar
 105 8 2023-07-04 2023-07-04 1 1 angers.zhu@gmail.com angers.zhu@gmail.com
ShuffleInMemorySorter.java
in client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn
 103 12 2022-10-08 2023-06-09 2 1 chengpan@apache.org chengpan@apache.org
CelebornColumnarBatchBuilder.scala
in client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar
 102 4 2023-07-04 2023-07-04 1 1 angers.zhu@gmail.com angers.zhu@gmail.com
ReadBufferDispatcher.java
in worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory
 87 7 2023-04-20 2023-05-18 2 1 ethanfeng@apache.org ethanfeng@apache.org
AbstractRemoteShuffleInputGateFactory.java
in client-flink/common/src/main/java/org/apache/celeborn/plugin/flink
 78 3 2023-05-04 2023-06-05 3 1 ethanfeng@apache.org ethanfeng@apache.org
TransportRequestHandler.java
in common/src/main/java/org/apache/celeborn/common/network/server
 73 7 2022-10-02 2022-10-02 1 1 zky.zhoukeyong@alibaba-inc.com zky.zhoukeyong@alibaba-inc.com
tpl
_helpers.tpl
in charts/celeborn/templates
 70 - 2023-01-11 2023-01-11 1 1 52876270+zwangsheng@users.n... 52876270+zwangsheng@users.n...
Serializer.scala
in common/src/main/scala/org/apache/celeborn/common/serializer
 70 7 2022-10-02 2022-10-02 1 1 zky.zhoukeyong@alibaba-inc.com zky.zhoukeyong@alibaba-inc.com
CelebornCompressibleColumnBuilder.scala
in client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar
 67 6 2023-07-04 2023-07-04 1 1 angers.zhu@gmail.com angers.zhu@gmail.com
ShuffleTaskInfo.java
in client-flink/common/src/main/java/org/apache/celeborn/plugin/flink
 67 5 2023-05-04 2023-05-04 1 1 ethanfeng@apache.org ethanfeng@apache.org
AbstractRemoteShuffleServiceFactory.java
in client-flink/common/src/main/java/org/apache/celeborn/plugin/flink
 67 3 2023-05-04 2023-05-04 1 1 ethanfeng@apache.org ethanfeng@apache.org
Encoders.java
in common/src/main/java/org/apache/celeborn/common/network/protocol
 63 7 2022-10-02 2022-10-02 1 1 zky.zhoukeyong@alibaba-inc.com zky.zhoukeyong@alibaba-inc.com
StreamChunkSlice.java
in common/src/main/java/org/apache/celeborn/common/network/protocol
 63 8 2022-10-02 2022-10-02 1 1 zky.zhoukeyong@alibaba-inc.com zky.zhoukeyong@alibaba-inc.com
ZstdCompressor.java
in client/src/main/java/org/apache/celeborn/client/compress
 62 4 2023-07-04 2023-07-04 1 1 angers.zhu@gmail.com angers.zhu@gmail.com
RpcResponse.java
in common/src/main/java/org/apache/celeborn/common/network/protocol
 57 10 2022-10-02 2022-10-02 1 1 zky.zhoukeyong@alibaba-inc.com zky.zhoukeyong@alibaba-inc.com
RemoteShuffleDescriptor.java
in client-flink/common/src/main/java/org/apache/celeborn/plugin/flink
 56 8 2023-05-04 2023-05-04 1 1 ethanfeng@apache.org ethanfeng@apache.org
GraphiteSink.scala
in common/src/main/scala/org/apache/celeborn/common/metrics/sink
 55 4 2022-10-02 2022-10-02 1 1 zky.zhoukeyong@alibaba-inc.com zky.zhoukeyong@alibaba-inc.com
ConfigReader.scala
in common/src/main/scala/org/apache/celeborn/common/internal/config
 55 4 2022-10-02 2022-10-02 1 1 zky.zhoukeyong@alibaba-inc.com zky.zhoukeyong@alibaba-inc.com
Lz4Compressor.java
in client/src/main/java/org/apache/celeborn/client/compress
 55 4 2023-07-04 2023-07-04 1 1 angers.zhu@gmail.com angers.zhu@gmail.com
RpcRequest.java
in common/src/main/java/org/apache/celeborn/common/network/protocol
 54 9 2022-10-02 2022-10-02 1 1 zky.zhoukeyong@alibaba-inc.com zky.zhoukeyong@alibaba-inc.com
RemoteShuffleResultPartitionFactory.java
in client-flink/flink-1.17/src/main/java/org/apache/celeborn/plugin/flink
 54 2 2023-05-05 2023-06-05 2 1 ethanfeng@apache.org ethanfeng@apache.org
RemoteShuffleResultPartitionFactory.java
in client-flink/flink-1.15/src/main/java/org/apache/celeborn/plugin/flink
 54 2 2023-05-04 2023-06-05 3 1 ethanfeng@apache.org ethanfeng@apache.org
ByteUnit.java
in common/src/main/java/org/apache/celeborn/common/network/util
 53 8 2022-10-02 2022-10-02 1 1 zky.zhoukeyong@alibaba-inc.com zky.zhoukeyong@alibaba-inc.com
DynClasses.java
in common/src/main/java/org/apache/celeborn/reflect
 51 8 2022-10-29 2022-10-29 1 1 chengpan@apache.org chengpan@apache.org
MessageEncoder.java
in common/src/main/java/org/apache/celeborn/common/network/protocol
 51 2 2022-10-02 2022-10-02 1 1 zky.zhoukeyong@alibaba-inc.com zky.zhoukeyong@alibaba-inc.com
Logging.scala
in common/src/main/scala/org/apache/celeborn/common/internal
 51 10 2022-10-02 2022-10-02 1 1 zky.zhoukeyong@alibaba-inc.com zky.zhoukeyong@alibaba-inc.com
ReadData.java
in client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/protocol
 51 11 2023-02-17 2023-03-14 3 1 ethanfeng@apache.org ethanfeng@apache.org
ReadAddCredit.java
in common/src/main/java/org/apache/celeborn/common/network/protocol
 50 10 2023-01-06 2023-01-06 1 1 ethanfeng@apache.org ethanfeng@apache.org
Correlations

File Size vs. Number of Changes: 370 points

client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java x: 485 lines of code y: 21 # changes client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala x: 267 lines of code y: 19 # changes client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala x: 884 lines of code y: 71 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteBufferStreamReader.java x: 118 lines of code y: 4 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/CelebornBufferStream.java x: 154 lines of code y: 2 # changes common/src/main/java/org/apache/celeborn/common/util/ExceptionUtils.java x: 38 lines of code y: 5 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapDataPartitionReader.java x: 380 lines of code y: 4 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala x: 319 lines of code y: 26 # changes common/src/main/proto/TransportMessages.proto x: 407 lines of code y: 60 # changes common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala x: 3090 lines of code y: 92 # changes common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala x: 842 lines of code y: 40 # changes master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala x: 783 lines of code y: 55 # changes client/src/main/java/org/apache/celeborn/client/read/DfsPartitionReader.java x: 228 lines of code y: 10 # changes client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java x: 166 lines of code y: 13 # changes common/src/main/java/org/apache/celeborn/common/network/protocol/Message.java x: 185 lines of code y: 10 # changes common/src/main/java/org/apache/celeborn/common/network/protocol/OpenStream.java x: 75 lines of code y: 2 # changes common/src/main/java/org/apache/celeborn/common/network/protocol/OpenStreamWithCredit.java x: 60 lines of code y: 2 # changes common/src/main/java/org/apache/celeborn/common/network/protocol/StreamHandle.java x: 47 lines of code y: 2 # changes common/src/main/java/org/apache/celeborn/common/network/protocol/TransportMessage.java x: 65 lines of code y: 3 # changes common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java x: 253 lines of code y: 13 # changes common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java x: 181 lines of code y: 13 # changes common/src/main/java/org/apache/celeborn/common/network/client/TransportResponseHandler.java x: 307 lines of code y: 13 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java x: 364 lines of code y: 24 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala x: 713 lines of code y: 47 # changes common/src/main/scala/org/apache/celeborn/common/util/Utils.scala x: 882 lines of code y: 40 # changes mkdocs.yml x: 75 lines of code y: 14 # changes master/src/main/java/org/apache/celeborn/service/deploy/master/SlotsAllocator.java x: 411 lines of code y: 7 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala x: 953 lines of code y: 47 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala x: 83 lines of code y: 18 # changes project/CelebornBuild.scala x: 588 lines of code y: 2 # changes client/src/main/java/org/apache/celeborn/client/ShuffleClient.java x: 103 lines of code y: 26 # changes client/src/main/java/org/apache/celeborn/client/write/DataPusher.java x: 193 lines of code y: 14 # changes build/sbt-launch-lib.bash x: 151 lines of code y: 1 # changes project/plugins.sbt x: 2 lines of code y: 1 # changes master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java x: 267 lines of code y: 26 # changes master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/IMetadataHandler.java x: 44 lines of code y: 5 # changes master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/SingleMasterMetaManager.java x: 98 lines of code y: 10 # changes master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java x: 257 lines of code y: 13 # changes service/src/main/scala/org/apache/celeborn/server/common/HttpService.scala x: 73 lines of code y: 16 # changes service/src/main/scala/org/apache/celeborn/server/common/http/HttpRequestHandler.scala x: 73 lines of code y: 8 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala x: 595 lines of code y: 62 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java x: 608 lines of code y: 22 # changes client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java x: 1513 lines of code y: 73 # changes client/src/main/java/org/apache/celeborn/client/ReviveManager.java x: 92 lines of code y: 3 # changes common/src/main/java/org/apache/celeborn/common/network/server/TransportServer.java x: 118 lines of code y: 6 # changes common/src/main/scala/org/apache/celeborn/common/util/CelebornExitKind.scala x: 6 lines of code y: 1 # changes service/src/main/scala/org/apache/celeborn/server/common/Service.scala x: 20 lines of code y: 5 # changes client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java x: 202 lines of code y: 8 # changes client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java x: 287 lines of code y: 7 # changes client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SendBufferPool.java x: 80 lines of code y: 4 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleMaster.java x: 191 lines of code y: 9 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/buffer/SortBuffer.java x: 32 lines of code y: 4 # changes client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java x: 416 lines of code y: 19 # changes client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java x: 359 lines of code y: 17 # changes client/src/main/scala/org/apache/celeborn/client/CommitManager.scala x: 265 lines of code y: 18 # changes common/src/main/java/org/apache/celeborn/common/client/MasterClient.java x: 170 lines of code y: 3 # changes common/src/main/java/org/apache/celeborn/common/network/TransportContext.java x: 115 lines of code y: 7 # changes common/src/main/java/org/apache/celeborn/common/network/buffer/ManagedBuffer.java x: 12 lines of code y: 2 # changes common/src/main/java/org/apache/celeborn/common/network/protocol/MessageWithHeader.java x: 121 lines of code y: 2 # changes common/src/main/java/org/apache/celeborn/common/network/server/TransportChannelHandler.java x: 141 lines of code y: 3 # changes common/src/main/java/org/apache/celeborn/common/util/ShutdownHookManager.java x: 194 lines of code y: 6 # changes master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HARaftServer.java x: 394 lines of code y: 13 # changes master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/StateMachine.java x: 334 lines of code y: 7 # changes client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala x: 111 lines of code y: 3 # changes client/src/main/scala/org/apache/celeborn/client/WorkerStatusTracker.scala x: 188 lines of code y: 14 # changes client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java x: 341 lines of code y: 14 # changes client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java x: 316 lines of code y: 13 # changes client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java x: 342 lines of code y: 13 # changes client/src/main/java/org/apache/celeborn/client/write/DataPushQueue.java x: 108 lines of code y: 10 # changes common/src/main/java/org/apache/celeborn/common/write/InFlightRequestTracker.java x: 140 lines of code y: 11 # changes common/src/main/java/org/apache/celeborn/common/write/SimplePushStrategy.java x: 26 lines of code y: 3 # changes common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala x: 219 lines of code y: 16 # changes master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MetaHandler.java x: 213 lines of code y: 10 # changes master/src/main/proto/Resource.proto x: 146 lines of code y: 5 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala x: 163 lines of code y: 14 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/ChannelsLimiter.java x: 114 lines of code y: 3 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/MemoryManager.java x: 340 lines of code y: 6 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/congestcontrol/BufferStatusHub.java x: 53 lines of code y: 4 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/congestcontrol/TimeSlidingHub.java x: 87 lines of code y: 3 # changes common/src/main/scala/org/apache/celeborn/common/rpc/netty/Dispatcher.scala x: 164 lines of code y: 5 # changes common/src/main/java/org/apache/celeborn/common/meta/FileInfo.java x: 177 lines of code y: 12 # changes common/src/main/scala/org/apache/celeborn/common/util/CelebornHadoopUtils.scala x: 49 lines of code y: 3 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateDelegation.java x: 445 lines of code y: 5 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGate.java x: 176 lines of code y: 4 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResource.java x: 41 lines of code y: 3 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/utils/FlinkUtils.java x: 49 lines of code y: 6 # changes client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkUtils.java x: 100 lines of code y: 6 # changes client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleFallbackPolicyRunner.scala x: 32 lines of code y: 1 # changes client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleHandle.scala x: 13 lines of code y: 1 # changes client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkUtils.java x: 132 lines of code y: 7 # changes client-spark/spark-3/src/main/java/org/apache/spark/sql/execution/columnar/CelebornColumnDictionary.java x: 36 lines of code y: 1 # changes client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnAccessor.scala x: 105 lines of code y: 1 # changes client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala x: 299 lines of code y: 1 # changes client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala x: 233 lines of code y: 1 # changes client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala x: 485 lines of code y: 1 # changes client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchCodeGenBuild.scala x: 271 lines of code y: 1 # changes client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchSerializer.scala x: 138 lines of code y: 1 # changes client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressibleColumnAccessor.scala x: 18 lines of code y: 1 # changes client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressibleColumnBuilder.scala x: 67 lines of code y: 1 # changes client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressionScheme.scala x: 48 lines of code y: 1 # changes client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressionSchemes.scala x: 355 lines of code y: 1 # changes client/src/main/java/org/apache/celeborn/client/compress/Compressor.java x: 28 lines of code y: 8 # changes client/src/main/java/org/apache/celeborn/client/compress/Decompressor.java x: 35 lines of code y: 6 # changes client/src/main/java/org/apache/celeborn/client/compress/Lz4Compressor.java x: 55 lines of code y: 1 # changes client/src/main/java/org/apache/celeborn/client/compress/ZstdCompressor.java x: 62 lines of code y: 1 # changes client/src/main/java/org/apache/celeborn/client/read/CelebornInputStream.java x: 497 lines of code y: 1 # changes client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala x: 124 lines of code y: 6 # changes common/src/main/java/org/apache/celeborn/common/protocol/RpcNameConstants.java x: 9 lines of code y: 3 # changes common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigBuilder.scala x: 240 lines of code y: 9 # changes common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigEntry.scala x: 185 lines of code y: 12 # changes common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigProvider.scala x: 24 lines of code y: 5 # changes common/src/main/scala/org/apache/celeborn/common/metrics/MetricsConfig.scala x: 71 lines of code y: 5 # changes common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala x: 339 lines of code y: 15 # changes toolkit/scripts/genConfs.py x: 135 lines of code y: 8 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala x: 587 lines of code y: 28 # changes common/src/main/java/org/apache/celeborn/common/meta/FileManagedBuffers.java x: 36 lines of code y: 4 # changes common/src/main/java/org/apache/celeborn/common/util/JavaUtils.java x: 322 lines of code y: 5 # changes common/src/main/scala/org/apache/celeborn/common/metrics/MetricLabels.scala x: 10 lines of code y: 4 # changes common/src/main/scala/org/apache/celeborn/common/metrics/sink/PrometheusServlet.scala x: 35 lines of code y: 3 # changes common/src/main/scala/org/apache/celeborn/common/metrics/source/Source.scala x: 12 lines of code y: 3 # changes master/src/main/scala/org/apache/celeborn/service/deploy/master/MasterSource.scala x: 21 lines of code y: 6 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/congestcontrol/CongestionController.java x: 190 lines of code y: 8 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitor.scala x: 248 lines of code y: 17 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/ObservedDevice.scala x: 139 lines of code y: 5 # changes common/src/main/java/org/apache/celeborn/common/protocol/CompressionCodec.java x: 6 lines of code y: 2 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/ShuffleResourceTracker.java x: 159 lines of code y: 2 # changes client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala x: 386 lines of code y: 20 # changes client/src/main/scala/org/apache/celeborn/client/commit/MapPartitionCommitHandler.scala x: 172 lines of code y: 14 # changes client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala x: 236 lines of code y: 14 # changes common/src/main/java/org/apache/celeborn/common/network/protocol/PushData.java x: 82 lines of code y: 3 # changes common/src/main/java/org/apache/celeborn/common/network/protocol/PushDataHandShake.java x: 87 lines of code y: 2 # changes common/src/main/java/org/apache/celeborn/common/network/protocol/PushMergedData.java x: 96 lines of code y: 2 # changes common/src/main/java/org/apache/celeborn/common/network/protocol/RegionFinish.java x: 65 lines of code y: 2 # changes common/src/main/java/org/apache/celeborn/common/protocol/PartitionLocation.java x: 271 lines of code y: 9 # changes common/src/main/java/org/apache/celeborn/common/protocol/message/StatusCode.java x: 59 lines of code y: 17 # changes common/src/main/java/org/apache/celeborn/common/write/PushState.java x: 55 lines of code y: 8 # changes common/src/main/scala/org/apache/celeborn/common/meta/ShufflePartitionLocationInfo.scala x: 84 lines of code y: 9 # changes common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala x: 350 lines of code y: 17 # changes client/src/main/scala/org/apache/celeborn/client/ApplicationHeartbeater.scala x: 77 lines of code y: 6 # changes master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAHelper.java x: 91 lines of code y: 6 # changes common/src/main/scala/org/apache/celeborn/common/serializer/SerializationDebugger.scala x: 266 lines of code y: 2 # changes client/src/main/scala/org/apache/celeborn/client/RequestLocationCallContext.scala x: 53 lines of code y: 3 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionDelegation.java x: 261 lines of code y: 2 # changes client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartition.java x: 156 lines of code y: 4 # changes client-flink/flink-1.17/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartition.java x: 169 lines of code y: 2 # changes common/src/main/java/org/apache/celeborn/common/protocol/StorageInfo.java x: 110 lines of code y: 2 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerArguments.scala x: 51 lines of code y: 9 # changes common/src/main/scala/org/apache/celeborn/common/rpc/RpcAddress.scala x: 21 lines of code y: 3 # changes master/src/main/scala/org/apache/celeborn/service/deploy/master/MasterArguments.scala x: 57 lines of code y: 9 # changes charts/celeborn/templates/configmap.yaml x: 102 lines of code y: 9 # changes common/src/main/scala/org/apache/celeborn/common/rpc/netty/NettyRpcEnv.scala x: 475 lines of code y: 8 # changes common/src/main/scala/org/apache/celeborn/common/metrics/MetricsSystem.scala x: 134 lines of code y: 4 # changes master/src/main/scala/org/apache/celeborn/service/deploy/master/clustermeta/ha/MasterNode.scala x: 69 lines of code y: 4 # changes charts/celeborn/templates/master-statefulset.yaml x: 123 lines of code y: 11 # changes charts/celeborn/templates/worker-statefulset.yaml x: 129 lines of code y: 11 # changes common/src/main/java/org/apache/celeborn/common/network/protocol/Heartbeat.java x: 20 lines of code y: 2 # changes common/src/main/java/org/apache/celeborn/common/network/util/TransportFrameDecoder.java x: 126 lines of code y: 3 # changes client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/ShuffleInMemorySorter.java x: 103 lines of code y: 2 # changes common/src/main/java/org/apache/celeborn/common/network/util/NettyUtils.java x: 123 lines of code y: 5 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/ReducePartitionFileWriter.java x: 76 lines of code y: 4 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/AbstractRemoteShuffleInputGateFactory.java x: 78 lines of code y: 3 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/AbstractRemoteShuffleResultPartitionFactory.java x: 145 lines of code y: 4 # changes client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateFactory.java x: 29 lines of code y: 6 # changes client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionFactory.java x: 54 lines of code y: 5 # changes client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleServiceFactory.java x: 34 lines of code y: 7 # changes client-flink/flink-1.15/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateFactory.java x: 29 lines of code y: 2 # changes client-flink/flink-1.17/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionFactory.java x: 54 lines of code y: 2 # changes client-flink/flink-1.17/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleServiceFactory.java x: 38 lines of code y: 2 # changes dev/merge_pr.py x: 406 lines of code y: 1 # changes common/src/main/java/org/apache/celeborn/common/write/PushStrategy.java x: 26 lines of code y: 2 # changes common/src/main/scala/org/apache/celeborn/common/metrics/source/SystemMiscSource.scala x: 27 lines of code y: 1 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/MessageDecoderExt.java x: 65 lines of code y: 4 # changes client-flink/flink-1.17/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleEnvironment.java x: 44 lines of code y: 1 # changes client-flink/flink-1.17/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGate.java x: 219 lines of code y: 1 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/AbstractRemoteShuffleEnvironment.java x: 132 lines of code y: 1 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleDescriptor.java x: 56 lines of code y: 1 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/buffer/BufferPacker.java x: 254 lines of code y: 6 # changes client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGate.java x: 197 lines of code y: 8 # changes client-flink/flink-1.15/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGate.java x: 212 lines of code y: 1 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapDataPartition.java x: 217 lines of code y: 2 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriter.java x: 246 lines of code y: 9 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/BufferQueue.java x: 115 lines of code y: 2 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/ChunkStreamManager.java x: 119 lines of code y: 1 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/CreditStreamManager.java x: 260 lines of code y: 1 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/TransportFrameDecoderWithBufferSupplier.java x: 182 lines of code y: 6 # changes common/src/main/scala/org/apache/celeborn/common/rpc/RpcEnv.scala x: 60 lines of code y: 4 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/FlinkTransportClientFactory.java x: 59 lines of code y: 6 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/buffer/PartitionSortedBuffer.java x: 272 lines of code y: 2 # changes common/src/main/java/org/apache/celeborn/common/network/protocol/TransportableError.java x: 44 lines of code y: 2 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/utils/BufferUtils.java x: 80 lines of code y: 2 # changes common/src/main/java/org/apache/celeborn/common/meta/DiskStatus.java x: 28 lines of code y: 3 # changes common/src/main/scala/org/apache/celeborn/common/quota/Quota.scala x: 81 lines of code y: 5 # changes common/src/main/java/org/apache/celeborn/common/unsafe/Platform.java x: 235 lines of code y: 2 # changes common/src/main/scala/org/apache/celeborn/common/rpc/RpcEndpointNotFoundException.scala x: 4 lines of code y: 2 # changes common/src/main/scala/org/apache/celeborn/common/rpc/netty/Outbox.scala x: 186 lines of code y: 2 # changes common/src/main/java/org/apache/celeborn/reflect/DynFields.java x: 225 lines of code y: 1 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/LevelDBProvider.java x: 110 lines of code y: 1 # changes common/src/main/java/org/apache/celeborn/common/network/server/TransportRequestHandler.java x: 73 lines of code y: 1 # changes
92.0
# changes
  min: 1.0
  average: 5.74
  25th percentile: 1.0
  median: 2.0
  75th percentile: 6.0
  max: 92.0
0 3090.0
lines of code
min: 1.0 | average: 127.64 | 25th percentile: 25.5 | median: 55.5 | 75th percentile: 154.5 | max: 3090.0

Number of Contributors vs. Number of Changes: 370 points

client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java x: 11 # contributors y: 21 # changes client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala x: 6 # contributors y: 19 # changes client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala x: 14 # contributors y: 71 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteBufferStreamReader.java x: 4 # contributors y: 4 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/CelebornBufferStream.java x: 2 # contributors y: 2 # changes common/src/main/java/org/apache/celeborn/common/util/ExceptionUtils.java x: 2 # contributors y: 5 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapDataPartitionReader.java x: 3 # contributors y: 4 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala x: 9 # contributors y: 26 # changes common/src/main/proto/TransportMessages.proto x: 11 # contributors y: 60 # changes common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala x: 20 # contributors y: 92 # changes common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala x: 12 # contributors y: 40 # changes master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala x: 11 # contributors y: 55 # changes client/src/main/java/org/apache/celeborn/client/read/DfsPartitionReader.java x: 6 # contributors y: 10 # changes client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java x: 8 # contributors y: 13 # changes common/src/main/java/org/apache/celeborn/common/network/protocol/Message.java x: 5 # contributors y: 10 # changes common/src/main/java/org/apache/celeborn/common/network/protocol/TransportMessage.java x: 3 # contributors y: 3 # changes common/src/main/java/org/apache/celeborn/common/network/client/TransportResponseHandler.java x: 6 # contributors y: 13 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java x: 10 # contributors y: 24 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala x: 19 # contributors y: 47 # changes common/src/main/scala/org/apache/celeborn/common/util/Utils.scala x: 16 # contributors y: 40 # changes mkdocs.yml x: 5 # contributors y: 14 # changes master/src/main/java/org/apache/celeborn/service/deploy/master/SlotsAllocator.java x: 5 # contributors y: 7 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala x: 15 # contributors y: 47 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala x: 10 # contributors y: 18 # changes project/CelebornBuild.scala x: 1 # contributors y: 2 # changes client/src/main/java/org/apache/celeborn/client/ShuffleClient.java x: 13 # contributors y: 26 # changes client/src/main/java/org/apache/celeborn/client/write/DataPusher.java x: 6 # contributors y: 14 # changes build/sbt-launch-lib.bash x: 1 # contributors y: 1 # changes master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/IMetadataHandler.java x: 4 # contributors y: 5 # changes master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/SingleMasterMetaManager.java x: 4 # contributors y: 10 # changes service/src/main/scala/org/apache/celeborn/server/common/HttpService.scala x: 6 # contributors y: 16 # changes service/src/main/scala/org/apache/celeborn/server/common/http/HttpRequestHandler.scala x: 3 # contributors y: 8 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala x: 18 # contributors y: 62 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java x: 7 # contributors y: 22 # changes client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java x: 20 # contributors y: 73 # changes client/src/main/java/org/apache/celeborn/client/ReviveManager.java x: 2 # contributors y: 3 # changes common/src/main/java/org/apache/celeborn/common/network/server/TransportServer.java x: 5 # contributors y: 6 # changes service/src/main/scala/org/apache/celeborn/server/common/Service.scala x: 3 # contributors y: 5 # changes client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java x: 5 # contributors y: 8 # changes client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java x: 4 # contributors y: 7 # changes client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SendBufferPool.java x: 2 # contributors y: 4 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleMaster.java x: 4 # contributors y: 9 # changes client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java x: 9 # contributors y: 19 # changes client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java x: 7 # contributors y: 17 # changes common/src/main/java/org/apache/celeborn/common/util/ShutdownHookManager.java x: 4 # contributors y: 6 # changes master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/StateMachine.java x: 6 # contributors y: 7 # changes client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java x: 7 # contributors y: 13 # changes common/src/main/java/org/apache/celeborn/common/write/InFlightRequestTracker.java x: 5 # contributors y: 11 # changes common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala x: 10 # contributors y: 16 # changes master/src/main/proto/Resource.proto x: 5 # contributors y: 5 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala x: 8 # contributors y: 14 # changes common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala x: 7 # contributors y: 10 # changes common/src/main/java/org/apache/celeborn/common/meta/FileInfo.java x: 7 # contributors y: 12 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/utils/FlinkUtils.java x: 3 # contributors y: 6 # changes client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkUtils.java x: 2 # contributors y: 6 # changes client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkUtils.java x: 2 # contributors y: 7 # changes client/src/main/java/org/apache/celeborn/client/compress/Compressor.java x: 4 # contributors y: 8 # changes client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala x: 6 # contributors y: 6 # changes common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigBuilder.scala x: 5 # contributors y: 9 # changes common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala x: 9 # contributors y: 15 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala x: 12 # contributors y: 28 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitor.scala x: 6 # contributors y: 17 # changes client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala x: 8 # contributors y: 20 # changes common/src/main/java/org/apache/celeborn/common/protocol/PartitionLocation.java x: 7 # contributors y: 9 # changes common/src/main/java/org/apache/celeborn/common/write/PushState.java x: 6 # contributors y: 8 # changes common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala x: 9 # contributors y: 17 # changes charts/celeborn/templates/worker-statefulset.yaml x: 4 # contributors y: 11 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/AbstractRemoteShuffleInputGateFactory.java x: 1 # contributors y: 3 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/AbstractRemoteShuffleResultPartitionFactory.java x: 1 # contributors y: 4 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriter.java x: 6 # contributors y: 9 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/ReadClientHandler.java x: 3 # contributors y: 9 # changes
92.0
# changes
  min: 1.0
  average: 5.74
  25th percentile: 1.0
  median: 2.0
  75th percentile: 6.0
  max: 92.0
0 20.0
# contributors
min: 1.0 | average: 3.01 | 25th percentile: 1.0 | median: 2.0 | 75th percentile: 4.0 | max: 20.0

Number of Contributors vs. File Size: 370 points

client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java x: 11 # contributors y: 485 lines of code client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala x: 6 # contributors y: 267 lines of code client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala x: 14 # contributors y: 884 lines of code client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteBufferStreamReader.java x: 4 # contributors y: 118 lines of code client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/CelebornBufferStream.java x: 2 # contributors y: 154 lines of code common/src/main/java/org/apache/celeborn/common/util/ExceptionUtils.java x: 2 # contributors y: 38 lines of code worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapDataPartitionReader.java x: 3 # contributors y: 380 lines of code worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala x: 9 # contributors y: 319 lines of code common/src/main/proto/TransportMessages.proto x: 11 # contributors y: 407 lines of code common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala x: 20 # contributors y: 3090 lines of code common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala x: 12 # contributors y: 842 lines of code master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala x: 11 # contributors y: 783 lines of code client/src/main/java/org/apache/celeborn/client/read/DfsPartitionReader.java x: 6 # contributors y: 228 lines of code client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java x: 8 # contributors y: 166 lines of code common/src/main/java/org/apache/celeborn/common/network/protocol/Message.java x: 5 # contributors y: 185 lines of code common/src/main/java/org/apache/celeborn/common/network/protocol/OpenStream.java x: 2 # contributors y: 75 lines of code common/src/main/java/org/apache/celeborn/common/network/protocol/OpenStreamWithCredit.java x: 2 # contributors y: 60 lines of code common/src/main/java/org/apache/celeborn/common/network/protocol/TransportMessage.java x: 3 # contributors y: 65 lines of code common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java x: 8 # contributors y: 253 lines of code common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java x: 8 # contributors y: 181 lines of code common/src/main/java/org/apache/celeborn/common/network/client/TransportResponseHandler.java x: 6 # contributors y: 307 lines of code worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java x: 10 # contributors y: 364 lines of code worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala x: 19 # contributors y: 713 lines of code common/src/main/scala/org/apache/celeborn/common/util/Utils.scala x: 16 # contributors y: 882 lines of code mkdocs.yml x: 5 # contributors y: 75 lines of code master/src/main/java/org/apache/celeborn/service/deploy/master/SlotsAllocator.java x: 5 # contributors y: 411 lines of code worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala x: 15 # contributors y: 953 lines of code worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala x: 10 # contributors y: 83 lines of code project/CelebornBuild.scala x: 1 # contributors y: 588 lines of code client/src/main/java/org/apache/celeborn/client/ShuffleClient.java x: 13 # contributors y: 103 lines of code client/src/main/java/org/apache/celeborn/client/write/DataPusher.java x: 6 # contributors y: 193 lines of code build/sbt-launch-lib.bash x: 1 # contributors y: 151 lines of code project/plugins.sbt x: 1 # contributors y: 2 lines of code master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java x: 9 # contributors y: 267 lines of code master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/IMetadataHandler.java x: 4 # contributors y: 44 lines of code master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/SingleMasterMetaManager.java x: 4 # contributors y: 98 lines of code service/src/main/scala/org/apache/celeborn/server/common/HttpService.scala x: 6 # contributors y: 73 lines of code service/src/main/scala/org/apache/celeborn/server/common/http/HttpRequestHandler.scala x: 3 # contributors y: 73 lines of code worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala x: 18 # contributors y: 595 lines of code worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java x: 7 # contributors y: 608 lines of code client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java x: 20 # contributors y: 1513 lines of code client/src/main/java/org/apache/celeborn/client/ReviveManager.java x: 2 # contributors y: 92 lines of code common/src/main/java/org/apache/celeborn/common/network/server/TransportServer.java x: 5 # contributors y: 118 lines of code service/src/main/scala/org/apache/celeborn/server/common/Service.scala x: 3 # contributors y: 20 lines of code client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java x: 5 # contributors y: 202 lines of code client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java x: 4 # contributors y: 287 lines of code client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleMaster.java x: 4 # contributors y: 191 lines of code client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/buffer/SortBuffer.java x: 4 # contributors y: 32 lines of code client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java x: 9 # contributors y: 416 lines of code client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java x: 7 # contributors y: 359 lines of code client/src/main/scala/org/apache/celeborn/client/CommitManager.scala x: 10 # contributors y: 265 lines of code common/src/main/java/org/apache/celeborn/common/client/MasterClient.java x: 2 # contributors y: 170 lines of code common/src/main/java/org/apache/celeborn/common/network/buffer/ManagedBuffer.java x: 2 # contributors y: 12 lines of code common/src/main/java/org/apache/celeborn/common/network/protocol/MessageWithHeader.java x: 2 # contributors y: 121 lines of code common/src/main/java/org/apache/celeborn/common/network/server/TransportChannelHandler.java x: 3 # contributors y: 141 lines of code master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HARaftServer.java x: 6 # contributors y: 394 lines of code master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/StateMachine.java x: 6 # contributors y: 334 lines of code client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala x: 3 # contributors y: 94 lines of code client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala x: 3 # contributors y: 111 lines of code client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java x: 6 # contributors y: 341 lines of code client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java x: 7 # contributors y: 316 lines of code common/src/main/java/org/apache/celeborn/common/write/InFlightRequestTracker.java x: 5 # contributors y: 140 lines of code common/src/main/java/org/apache/celeborn/common/write/SimplePushStrategy.java x: 3 # contributors y: 26 lines of code common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala x: 10 # contributors y: 219 lines of code master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MetaHandler.java x: 6 # contributors y: 213 lines of code master/src/main/proto/Resource.proto x: 5 # contributors y: 146 lines of code worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/MemoryManager.java x: 5 # contributors y: 340 lines of code common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala x: 7 # contributors y: 225 lines of code common/src/main/scala/org/apache/celeborn/common/rpc/netty/Dispatcher.scala x: 5 # contributors y: 164 lines of code common/src/main/java/org/apache/celeborn/common/meta/FileInfo.java x: 7 # contributors y: 177 lines of code client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateDelegation.java x: 4 # contributors y: 445 lines of code client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGate.java x: 4 # contributors y: 176 lines of code client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResource.java x: 3 # contributors y: 41 lines of code client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/utils/FlinkUtils.java x: 3 # contributors y: 49 lines of code client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkUtils.java x: 2 # contributors y: 100 lines of code client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleFallbackPolicyRunner.scala x: 1 # contributors y: 32 lines of code client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleHandle.scala x: 1 # contributors y: 13 lines of code client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkUtils.java x: 2 # contributors y: 132 lines of code client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleFallbackPolicyRunner.scala x: 1 # contributors y: 38 lines of code client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnAccessor.scala x: 1 # contributors y: 105 lines of code client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala x: 1 # contributors y: 299 lines of code client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala x: 1 # contributors y: 233 lines of code client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala x: 1 # contributors y: 485 lines of code client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchCodeGenBuild.scala x: 1 # contributors y: 271 lines of code client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchSerializer.scala x: 1 # contributors y: 138 lines of code client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressibleColumnBuilder.scala x: 1 # contributors y: 67 lines of code client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressionSchemes.scala x: 1 # contributors y: 355 lines of code client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornNullableColumnBuilder.scala x: 1 # contributors y: 49 lines of code client/src/main/java/org/apache/celeborn/client/read/CelebornInputStream.java x: 1 # contributors y: 497 lines of code client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala x: 6 # contributors y: 124 lines of code common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigBuilder.scala x: 5 # contributors y: 240 lines of code common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigEntry.scala x: 7 # contributors y: 185 lines of code common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala x: 9 # contributors y: 339 lines of code worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala x: 12 # contributors y: 587 lines of code common/src/main/java/org/apache/celeborn/common/util/JavaUtils.java x: 4 # contributors y: 322 lines of code common/src/main/scala/org/apache/celeborn/common/metrics/MetricLabels.scala x: 4 # contributors y: 10 lines of code common/src/main/scala/org/apache/celeborn/common/metrics/source/Source.scala x: 3 # contributors y: 12 lines of code master/src/main/scala/org/apache/celeborn/service/deploy/master/MasterSource.scala x: 2 # contributors y: 21 lines of code worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitor.scala x: 6 # contributors y: 248 lines of code client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala x: 8 # contributors y: 386 lines of code client/src/main/scala/org/apache/celeborn/client/commit/MapPartitionCommitHandler.scala x: 5 # contributors y: 172 lines of code client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala x: 6 # contributors y: 236 lines of code common/src/main/java/org/apache/celeborn/common/network/protocol/RegionFinish.java x: 2 # contributors y: 65 lines of code common/src/main/java/org/apache/celeborn/common/protocol/PartitionLocation.java x: 7 # contributors y: 271 lines of code common/src/main/java/org/apache/celeborn/common/protocol/message/StatusCode.java x: 6 # contributors y: 59 lines of code common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala x: 9 # contributors y: 350 lines of code client/src/main/scala/org/apache/celeborn/client/ApplicationHeartbeater.scala x: 4 # contributors y: 77 lines of code master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAHelper.java x: 4 # contributors y: 91 lines of code common/src/main/scala/org/apache/celeborn/common/serializer/SerializationDebugger.scala x: 2 # contributors y: 266 lines of code client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartition.java x: 4 # contributors y: 156 lines of code worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerArguments.scala x: 4 # contributors y: 51 lines of code charts/celeborn/templates/configmap.yaml x: 5 # contributors y: 102 lines of code common/src/main/scala/org/apache/celeborn/common/rpc/netty/NettyRpcEnv.scala x: 5 # contributors y: 475 lines of code common/src/main/scala/org/apache/celeborn/common/util/ThreadUtils.scala x: 3 # contributors y: 168 lines of code charts/celeborn/templates/master-statefulset.yaml x: 5 # contributors y: 123 lines of code charts/celeborn/templates/worker-statefulset.yaml x: 4 # contributors y: 129 lines of code common/src/main/java/org/apache/celeborn/common/network/util/TransportFrameDecoder.java x: 3 # contributors y: 126 lines of code client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/AbstractRemoteShuffleInputGateFactory.java x: 1 # contributors y: 78 lines of code dev/merge_pr.py x: 1 # contributors y: 406 lines of code common/src/main/java/org/apache/celeborn/common/write/PushStrategy.java x: 2 # contributors y: 26 lines of code worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/ReadBufferDispatcher.java x: 1 # contributors y: 87 lines of code client-flink/flink-1.17/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGate.java x: 1 # contributors y: 219 lines of code client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/AbstractRemoteShuffleEnvironment.java x: 1 # contributors y: 132 lines of code client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/buffer/BufferPacker.java x: 5 # contributors y: 254 lines of code client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGate.java x: 3 # contributors y: 197 lines of code client-flink/flink-1.15/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGate.java x: 1 # contributors y: 212 lines of code worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapDataPartition.java x: 2 # contributors y: 217 lines of code worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/BufferQueue.java x: 1 # contributors y: 115 lines of code worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/CreditStreamManager.java x: 1 # contributors y: 260 lines of code client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/TransportFrameDecoderWithBufferSupplier.java x: 3 # contributors y: 182 lines of code client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/ReadClientHandler.java x: 3 # contributors y: 101 lines of code client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/buffer/PartitionSortedBuffer.java x: 2 # contributors y: 272 lines of code common/src/main/scala/org/apache/celeborn/common/meta/AppDiskUsageMetric.scala x: 2 # contributors y: 142 lines of code common/src/main/java/org/apache/celeborn/common/unsafe/Platform.java x: 2 # contributors y: 235 lines of code common/src/main/scala/org/apache/celeborn/common/rpc/netty/Outbox.scala x: 2 # contributors y: 186 lines of code
3090.0
lines of code
  min: 1.0
  average: 127.64
  25th percentile: 25.5
  median: 55.5
  75th percentile: 154.5
  max: 3090.0
0 20.0
# contributors
min: 1.0 | average: 3.01 | 25th percentile: 1.0 | median: 2.0 | 75th percentile: 4.0 | max: 20.0