apache / celeborn
File Change Frequency

File change frequency (churn) shows the distribution of file updates (days with at least one commit).

Overview
File Change Frequency Overall
  • There are 881 files with 106,311 lines of code.
    • 6 files changed more than 100 times (11,924 lines of code)
    • 8 files changed 51-100 times (8,007 lines of code)
    • 39 files changed 21-50 times (13,802 lines of code)
    • 113 files changed 6-20 times (18,094 lines of code)
    • 715 files changed 1-5 times (54,484 lines of code)
11% | 7% | 12% | 17% | 51%
Legend:
101+
51-100
21-50
6-20
1-5

explore: grouped by folders | grouped by update frequency | data
Contributors Count Frequency Overall
  • There are 881 files with 106,311 lines of code.
    • 9 files changed by more than 25 contributors (15,840 lines of code)
    • 47 files changed by 11-25 contributors (17,999 lines of code)
    • 53 files changed by 6-10 contributors (9,730 lines of code)
    • 277 files changed by 2-5 contributors (27,493 lines of code)
    • 495 files changed by 1 contributor (35,249 lines of code)
14% | 16% | 9% | 25% | 33%
Legend:
26+
11-25
6-10
2-5
1

explore: grouped by folders | grouped by contributors count | data
File Change Frequency per File Extension
java, scala, xml, yaml, md, ts, txt, vue, cpp, sh, h, svg, patch, properties, json, sql, py, proto, tpl, sbt, scss, html, gitignore, in, clang-format, gitattributes, mustache, dockerfile, cjs, cmake, bash
File Change Frequency per Extension
The number of recorded file updates
101+
51-100
21-50
6-20
1-5
scala22% | 18% | 12% | 13% | 32%
java3% | <1% | 15% | 17% | 61%
proto43% | 0% | 12% | 0% | 43%
yaml0% | 0% | 5% | 81% | 12%
py0% | 0% | 0% | 90% | 9%
tpl0% | 0% | 0% | 36% | 63%
h0% | 0% | 0% | 3% | 96%
sbt0% | 0% | 0% | 83% | 16%
cpp0% | 0% | 0% | 0% | 100%
vue0% | 0% | 0% | 0% | 100%
ts0% | 0% | 0% | 0% | 100%
cmake0% | 0% | 0% | 0% | 100%
bash0% | 0% | 0% | 0% | 100%
sql0% | 0% | 0% | 0% | 100%
xml0% | 0% | 0% | 0% | 100%
html0% | 0% | 0% | 0% | 100%
in0% | 0% | 0% | 0% | 100%
mustache0% | 0% | 0% | 0% | 100%
scss0% | 0% | 0% | 0% | 100%
File Change Frequency per Logical Decomposition
primary
primary (file change frequency)
The number of recorded file updates
101+
51-100
21-50
6-20
1-5
common24% | 8% | 13% | 18% | 35%
client41% | 0% | 40% | 11% | 6%
master21% | 8% | 34% | 24% | 10%
worker7% | 31% | 16% | 16% | 27%
project0% | 82% | 0% | <1% | 16%
client-spark0% | 0% | 20% | 14% | 64%
service0% | 0% | 7% | 30% | 61%
charts0% | 0% | 12% | 41% | 45%
client-flink0% | 0% | 0% | 20% | 79%
openapi0% | 0% | 0% | 17% | 82%
dev0% | 0% | 0% | 100% | 0%
cli0% | 0% | 0% | 52% | 47%
client-mr0% | 0% | 0% | 19% | 80%
toolkit0% | 0% | 0% | 63% | 36%
cpp0% | 0% | 0% | 1% | 98%
client-tez0% | 0% | 0% | 0% | 100%
web0% | 0% | 0% | 0% | 100%
multipart-uploader0% | 0% | 0% | 0% | 100%
build0% | 0% | 0% | 0% | 100%
spi0% | 0% | 0% | 0% | 100%
ROOT0% | 0% | 0% | 0% | 100%
Most Frequently Changed Files (Top 50)

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
CelebornConf.scala
in common/src/main/scala/org/apache/celeborn/common
 5367 115 2022-10-20 2025-04-28 241 53 angers.zhu@gmail.com fwang12@ebay.com
Master.scala
in master/src/main/scala/org/apache/celeborn/service/deploy/master
 1315 43 2022-10-08 2025-04-08 145 30 angers.zhu@gmail.com 897900564@qq.com
Worker.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker
 947 21 2022-10-08 2025-04-28 138 36 chengpan@apache.org fwang12@ebay.com
ShuffleClientImpl.java
in client/src/main/java/org/apache/celeborn/client
 1889 51 2022-10-02 2025-04-28 128 36 zky.zhoukeyong@alibaba-inc.com lvshuang.xjs@alibaba-inc.com
LifecycleManager.scala
in client/src/main/scala/org/apache/celeborn/client
 1622 57 2022-10-08 2025-04-28 125 30 angers.zhu@gmail.com fengmingxiao.fmx@alibaba-in...
proto
TransportMessages.proto
in common/src/main/proto
 784 - 2022-01-29 2025-04-01 107 25 fengmingxiao.fmx@alibaba-in... fwang12@ebay.com
1459 6 2023-07-28 2025-04-27 99 24 cfmcgrady@gmail.com akpatnam25@gmail.com
StorageManager.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage
 1094 42 2022-10-08 2025-04-08 90 34 chengpan@apache.org 897900564@qq.com
PushDataHandler.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker
 1404 34 2022-10-08 2025-04-08 86 29 chengpan@apache.org 897900564@qq.com
ControlMessages.scala
in common/src/main/scala/org/apache/celeborn/common/protocol/message
 1212 25 2022-10-02 2025-04-18 79 28 zky.zhoukeyong@alibaba-inc.com jiangyanze.jyz@antgroup.com
Utils.scala
in common/src/main/scala/org/apache/celeborn/common/util
 990 93 2022-10-02 2025-04-24 76 32 zky.zhoukeyong@alibaba-inc.com amandeeps.28@uber.com
AbstractMetaManager.java
in master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta
 532 28 2022-10-08 2025-04-08 54 24 chengpan@apache.org 897900564@qq.com
FetchHandler.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker
 576 22 2022-10-08 2025-04-08 54 21 chengpan@apache.org 897900564@qq.com
Controller.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker
 740 9 2022-10-08 2025-04-08 51 23 chengpan@apache.org 897900564@qq.com
WorkerSource.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker
 168 5 2022-10-08 2025-01-07 47 24 chengpan@apache.org nzhu@pinterest.com
PartitionFilesSorter.java
in worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage
 866 36 2022-10-08 2025-04-08 45 15 chengpan@apache.org 897900564@qq.com
ShuffleClient.java
in client/src/main/java/org/apache/celeborn/client
 211 10 2022-10-02 2025-04-01 43 21 zky.zhoukeyong@alibaba-inc.com fwang12@ebay.com
PbSerDeUtils.scala
in common/src/main/scala/org/apache/celeborn/common/util
 643 38 2022-10-31 2025-04-11 41 21 30563796+nafiyaix@users.nor... sychen@ctrip.com
HttpService.scala
in service/src/main/scala/org/apache/celeborn/server/common
 289 24 2022-10-08 2024-11-28 40 15 chengpan@apache.org fwang12@ebay.com
SparkShuffleManager.java
in client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn
 393 16 2023-06-30 2025-04-01 40 21 angers.zhu@gmail.com fwang12@ebay.com
CommitHandler.scala
in client/src/main/scala/org/apache/celeborn/client/commit
 462 14 2022-12-15 2025-04-24 39 15 lvshuang.tb@gmail.com programgeek@163.com
WorkerInfo.scala
in common/src/main/scala/org/apache/celeborn/common/meta
 279 23 2022-10-02 2025-04-27 35 18 zky.zhoukeyong@alibaba-inc.com akpatnam25@gmail.com
CelebornShuffleReader.scala
in client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn
 400 5 2023-07-04 2025-04-01 35 18 angers.zhu@gmail.com fwang12@ebay.com
ChangePartitionManager.scala
in client/src/main/scala/org/apache/celeborn/client
 350 10 2022-12-05 2024-12-23 33 14 angers.zhu@gmail.com fwang12@ebay.com
AbstractSource.scala
in common/src/main/scala/org/apache/celeborn/common/metrics/source
 619 54 2022-10-02 2025-04-28 33 17 zky.zhoukeyong@alibaba-inc.com nfraison@yahoo.fr
DeviceMonitor.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage
 278 19 2022-10-08 2025-04-10 32 13 chengpan@apache.org programgeek@163.com
CelebornInputStream.java
in client/src/main/java/org/apache/celeborn/client/read
 780 22 2023-07-04 2025-04-08 32 17 angers.zhu@gmail.com 897900564@qq.com
SingleMasterMetaManager.java
in master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta
 136 18 2022-10-08 2025-03-24 31 16 chengpan@apache.org 31424839+leixm@users.norepl...
SparkShuffleManager.java
in client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn
 243 12 2023-06-30 2025-04-01 31 16 angers.zhu@gmail.com fwang12@ebay.com
CommitManager.scala
in client/src/main/scala/org/apache/celeborn/client
 278 19 2022-12-06 2025-04-03 31 14 angers.zhu@gmail.com jiaming.xie7@gmail.com
HashBasedShuffleWriter.java
in client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn
 344 14 2022-10-08 2025-03-31 31 15 chengpan@apache.org saurabhd336@uber.com
MetaHandler.java
in master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha
 278 6 2022-10-08 2025-03-24 30 18 chengpan@apache.org 31424839+leixm@users.norepl...
HAMasterMetaManager.java
in master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha
 397 20 2022-10-08 2025-03-24 30 15 chengpan@apache.org 31424839+leixm@users.norepl...
MemoryManager.java
in worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory
 554 47 2023-04-20 2025-04-02 30 16 ethanfeng@apache.org fengmingxiao.fmx@alibaba-in...
TransportClientFactory.java
in common/src/main/java/org/apache/celeborn/common/network/client
 297 8 2022-10-02 2025-02-27 28 18 zky.zhoukeyong@alibaba-inc.com minyang@linkedin.com
SortBasedShuffleWriter.java
in client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn
 349 16 2022-10-08 2025-03-18 28 12 chengpan@apache.org 1548069580@qq.com　
HARaftServer.java
in master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha
 504 30 2022-10-08 2024-10-17 27 14 chengpan@apache.org fwang12@ebay.com
values.yaml
in charts/celeborn
 158 - 2023-01-11 2025-04-28 26 13 52876270+zwangsheng@users.n... github@chenyicn.net
Flusher.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage
 185 12 2022-10-08 2025-04-08 26 13 chengpan@apache.org 897900564@qq.com
TransportClient.java
in common/src/main/java/org/apache/celeborn/common/network/client
 320 28 2022-10-02 2024-12-13 26 16 zky.zhoukeyong@alibaba-inc.com shuaizhentao.szt@alibaba-in...
NettyRpcEnv.scala
in common/src/main/scala/org/apache/celeborn/common/rpc/netty
 509 39 2022-10-02 2025-04-03 25 15 zky.zhoukeyong@alibaba-inc.com jiaming.xie7@gmail.com
ReducePartitionCommitHandler.scala
in client/src/main/scala/org/apache/celeborn/client/commit
 340 24 2022-12-15 2025-04-03 24 10 lvshuang.tb@gmail.com jiaming.xie7@gmail.com
StatusCode.java
in common/src/main/java/org/apache/celeborn/common/protocol/message
 84 3 2022-10-02 2025-04-18 23 9 zky.zhoukeyong@alibaba-inc.com jiangyanze.jyz@antgroup.com
DfsPartitionReader.java
in client/src/main/java/org/apache/celeborn/client/read
 313 11 2022-10-02 2025-04-08 23 15 zky.zhoukeyong@alibaba-inc.com 897900564@qq.com
TransportResponseHandler.java
in common/src/main/java/org/apache/celeborn/common/network/client
 397 21 2022-10-02 2024-07-25 23 10 zky.zhoukeyong@alibaba-inc.com programgeek@163.com
TransportContext.java
in common/src/main/java/org/apache/celeborn/common/network
 201 22 2022-10-02 2025-02-27 22 13 zky.zhoukeyong@alibaba-inc.com minyang@linkedin.com
WorkerStatusTracker.scala
in client/src/main/scala/org/apache/celeborn/client
 209 9 2023-04-12 2024-12-23 22 9 angers.zhu@gmail.com fwang12@ebay.com
SortBasedPusher.java
in client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn
 399 18 2022-10-08 2024-11-11 22 9 chengpan@apache.org sychen@ctrip.com
DataPusher.java
in client/src/main/java/org/apache/celeborn/client/write
 211 10 2022-10-02 2024-12-23 21 10 zky.zhoukeyong@alibaba-inc.com zhangzhao.08@bytedance.com
proto
Resource.proto
in master/src/main/proto
 227 - 2022-10-08 2025-04-21 21 15 chengpan@apache.org luoyedeyi@163.com
Files With Most Contributors (Top 50)
Based on the number of unique email addresses found in commits.

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
CelebornConf.scala
in common/src/main/scala/org/apache/celeborn/common
 5367 115 2022-10-20 2025-04-28 241 53 angers.zhu@gmail.com fwang12@ebay.com
Worker.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker
 947 21 2022-10-08 2025-04-28 138 36 chengpan@apache.org fwang12@ebay.com
ShuffleClientImpl.java
in client/src/main/java/org/apache/celeborn/client
 1889 51 2022-10-02 2025-04-28 128 36 zky.zhoukeyong@alibaba-inc.com lvshuang.xjs@alibaba-inc.com
StorageManager.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage
 1094 42 2022-10-08 2025-04-08 90 34 chengpan@apache.org 897900564@qq.com
Utils.scala
in common/src/main/scala/org/apache/celeborn/common/util
 990 93 2022-10-02 2025-04-24 76 32 zky.zhoukeyong@alibaba-inc.com amandeeps.28@uber.com
Master.scala
in master/src/main/scala/org/apache/celeborn/service/deploy/master
 1315 43 2022-10-08 2025-04-08 145 30 angers.zhu@gmail.com 897900564@qq.com
LifecycleManager.scala
in client/src/main/scala/org/apache/celeborn/client
 1622 57 2022-10-08 2025-04-28 125 30 angers.zhu@gmail.com fengmingxiao.fmx@alibaba-in...
PushDataHandler.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker
 1404 34 2022-10-08 2025-04-08 86 29 chengpan@apache.org 897900564@qq.com
ControlMessages.scala
in common/src/main/scala/org/apache/celeborn/common/protocol/message
 1212 25 2022-10-02 2025-04-18 79 28 zky.zhoukeyong@alibaba-inc.com jiangyanze.jyz@antgroup.com
proto
TransportMessages.proto
in common/src/main/proto
 784 - 2022-01-29 2025-04-01 107 25 fengmingxiao.fmx@alibaba-in... fwang12@ebay.com
1459 6 2023-07-28 2025-04-27 99 24 cfmcgrady@gmail.com akpatnam25@gmail.com
AbstractMetaManager.java
in master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta
 532 28 2022-10-08 2025-04-08 54 24 chengpan@apache.org 897900564@qq.com
WorkerSource.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker
 168 5 2022-10-08 2025-01-07 47 24 chengpan@apache.org nzhu@pinterest.com
Controller.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker
 740 9 2022-10-08 2025-04-08 51 23 chengpan@apache.org 897900564@qq.com
FetchHandler.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker
 576 22 2022-10-08 2025-04-08 54 21 chengpan@apache.org 897900564@qq.com
ShuffleClient.java
in client/src/main/java/org/apache/celeborn/client
 211 10 2022-10-02 2025-04-01 43 21 zky.zhoukeyong@alibaba-inc.com fwang12@ebay.com
PbSerDeUtils.scala
in common/src/main/scala/org/apache/celeborn/common/util
 643 38 2022-10-31 2025-04-11 41 21 30563796+nafiyaix@users.nor... sychen@ctrip.com
SparkShuffleManager.java
in client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn
 393 16 2023-06-30 2025-04-01 40 21 angers.zhu@gmail.com fwang12@ebay.com
WorkerInfo.scala
in common/src/main/scala/org/apache/celeborn/common/meta
 279 23 2022-10-02 2025-04-27 35 18 zky.zhoukeyong@alibaba-inc.com akpatnam25@gmail.com
CelebornShuffleReader.scala
in client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn
 400 5 2023-07-04 2025-04-01 35 18 angers.zhu@gmail.com fwang12@ebay.com
MetaHandler.java
in master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha
 278 6 2022-10-08 2025-03-24 30 18 chengpan@apache.org 31424839+leixm@users.norepl...
TransportClientFactory.java
in common/src/main/java/org/apache/celeborn/common/network/client
 297 8 2022-10-02 2025-02-27 28 18 zky.zhoukeyong@alibaba-inc.com minyang@linkedin.com
AbstractSource.scala
in common/src/main/scala/org/apache/celeborn/common/metrics/source
 619 54 2022-10-02 2025-04-28 33 17 zky.zhoukeyong@alibaba-inc.com nfraison@yahoo.fr
CelebornInputStream.java
in client/src/main/java/org/apache/celeborn/client/read
 780 22 2023-07-04 2025-04-08 32 17 angers.zhu@gmail.com 897900564@qq.com
SparkShuffleManager.java
in client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn
 243 12 2023-06-30 2025-04-01 31 16 angers.zhu@gmail.com fwang12@ebay.com
SingleMasterMetaManager.java
in master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta
 136 18 2022-10-08 2025-03-24 31 16 chengpan@apache.org 31424839+leixm@users.norepl...
MemoryManager.java
in worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory
 554 47 2023-04-20 2025-04-02 30 16 ethanfeng@apache.org fengmingxiao.fmx@alibaba-in...
TransportClient.java
in common/src/main/java/org/apache/celeborn/common/network/client
 320 28 2022-10-02 2024-12-13 26 16 zky.zhoukeyong@alibaba-inc.com shuaizhentao.szt@alibaba-in...
SlotsAllocator.java
in master/src/main/java/org/apache/celeborn/service/deploy/master
 579 7 2022-10-08 2025-04-27 21 16 chengpan@apache.org akpatnam25@gmail.com
PartitionFilesSorter.java
in worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage
 866 36 2022-10-08 2025-04-08 45 15 chengpan@apache.org 897900564@qq.com
HttpService.scala
in service/src/main/scala/org/apache/celeborn/server/common
 289 24 2022-10-08 2024-11-28 40 15 chengpan@apache.org fwang12@ebay.com
CommitHandler.scala
in client/src/main/scala/org/apache/celeborn/client/commit
 462 14 2022-12-15 2025-04-24 39 15 lvshuang.tb@gmail.com programgeek@163.com
HashBasedShuffleWriter.java
in client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn
 344 14 2022-10-08 2025-03-31 31 15 chengpan@apache.org saurabhd336@uber.com
HAMasterMetaManager.java
in master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha
 397 20 2022-10-08 2025-03-24 30 15 chengpan@apache.org 31424839+leixm@users.norepl...
NettyRpcEnv.scala
in common/src/main/scala/org/apache/celeborn/common/rpc/netty
 509 39 2022-10-02 2025-04-03 25 15 zky.zhoukeyong@alibaba-inc.com jiaming.xie7@gmail.com
DfsPartitionReader.java
in client/src/main/java/org/apache/celeborn/client/read
 313 11 2022-10-02 2025-04-08 23 15 zky.zhoukeyong@alibaba-inc.com 897900564@qq.com
proto
Resource.proto
in master/src/main/proto
 227 - 2022-10-08 2025-04-21 21 15 chengpan@apache.org luoyedeyi@163.com
ChangePartitionManager.scala
in client/src/main/scala/org/apache/celeborn/client
 350 10 2022-12-05 2024-12-23 33 14 angers.zhu@gmail.com fwang12@ebay.com
CommitManager.scala
in client/src/main/scala/org/apache/celeborn/client
 278 19 2022-12-06 2025-04-03 31 14 angers.zhu@gmail.com jiaming.xie7@gmail.com
HARaftServer.java
in master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha
 504 30 2022-10-08 2024-10-17 27 14 chengpan@apache.org fwang12@ebay.com
WorkerPartitionReader.java
in client/src/main/java/org/apache/celeborn/client/read
 254 11 2022-10-02 2025-03-18 21 14 zky.zhoukeyong@alibaba-inc.com saurabhd336@uber.com
DeviceInfo.scala
in common/src/main/scala/org/apache/celeborn/common/meta
 265 21 2022-10-02 2025-03-23 19 14 zky.zhoukeyong@alibaba-inc.com angers.zhu@gmail.com
IMetadataHandler.java
in master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta
 62 - 2022-10-08 2024-11-28 19 14 chengpan@apache.org fwang12@ebay.com
DeviceMonitor.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage
 278 19 2022-10-08 2025-04-10 32 13 chengpan@apache.org programgeek@163.com
values.yaml
in charts/celeborn
 158 - 2023-01-11 2025-04-28 26 13 52876270+zwangsheng@users.n... github@chenyicn.net
Flusher.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage
 185 12 2022-10-08 2025-04-08 26 13 chengpan@apache.org 897900564@qq.com
TransportContext.java
in common/src/main/java/org/apache/celeborn/common/network
 201 22 2022-10-02 2025-02-27 22 13 zky.zhoukeyong@alibaba-inc.com minyang@linkedin.com
SortBasedShuffleWriter.java
in client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn
 349 16 2022-10-08 2025-03-18 28 12 chengpan@apache.org 1548069580@qq.com　
CelebornShuffleReader.scala
in client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn
 219 2 2023-07-04 2025-04-01 19 12 angers.zhu@gmail.com fwang12@ebay.com
MasterClient.java
in common/src/main/java/org/apache/celeborn/common/client
 188 16 2023-06-29 2025-02-20 17 12 angers.zhu@gmail.com shuaizhentao.szt@alibaba-in...
Files With Least Contributors (Top 50)
Based on the number of unique email addresses found in commits.

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
proto
TransportMessagesCpp.proto
in cpp/celeborn/proto
 784 - 2024-12-10 2024-12-10 1 1 jiaming.xie7@gmail.com jiaming.xie7@gmail.com
ApiClient.java
in openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/invoker
 610 54 2024-07-31 2024-09-24 2 1 fwang12@ebay.com fwang12@ebay.com
ApiClient.java
in openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/invoker
 610 54 2024-07-31 2024-09-24 2 1 fwang12@ebay.com fwang12@ebay.com
CelebornColumnType.scala
in client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar
 466 88 2024-12-24 2024-12-24 1 1 fengmingxiao.fmx@alibaba-in... fengmingxiao.fmx@alibaba-in...
CelebornTierConsumerAgent.java
in client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered
 464 20 2025-04-07 2025-04-07 1 1 programgeek@163.com programgeek@163.com
CelebornColumnType.scala
in client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar
 463 88 2024-09-05 2024-09-05 1 1 programgeek@163.com programgeek@163.com
RatisApi.java
in openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master
 459 23 2024-10-11 2024-10-24 4 1 fwang12@ebay.com fwang12@ebay.com
CelebornShuffleManager.java
in client-tez/tez/src/main/java/org/apache/tez/runtime/library/common/shuffle/impl
 427 18 2024-12-06 2024-12-06 1 1 hongguangwei@bytedance.com hongguangwei@bytedance.com
WorkerInfoResponse.java
in openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/model
 401 58 2024-07-31 2024-12-02 3 1 fwang12@ebay.com fwang12@ebay.com
CelebornTierProducerAgent.java
in client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered
 386 14 2025-04-07 2025-04-07 1 1 programgeek@163.com programgeek@163.com
WorkerData.java
in openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/model
 361 52 2024-07-31 2025-02-26 4 1 fwang12@ebay.com fwang12@ebay.com
CelebornCompressionSchemes.scala
in client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar
 356 25 2024-12-24 2024-12-24 1 1 fengmingxiao.fmx@alibaba-in... fengmingxiao.fmx@alibaba-in...
CelebornCompressionSchemes.scala
in client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar
 356 25 2024-09-05 2024-09-05 1 1 programgeek@163.com programgeek@163.com
PartitionMetaHandler.scala
in worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage
 340 32 2025-01-09 2025-04-02 2 1 fengmingxiao.fmx@alibaba-in... fengmingxiao.fmx@alibaba-in...
Exceptions.h
in cpp/celeborn/utils
 330 7 2024-12-04 2025-01-04 2 1 jiaming.xie7@gmail.com jiaming.xie7@gmail.com
CelebornScheduler.java
in client-tez/tez/src/main/java/org/apache/tez/runtime/library/common/shuffle/orderedgrouped
 308 14 2024-12-06 2024-12-06 1 1 hongguangwei@bytedance.com hongguangwei@bytedance.com
WorkerApi.java
in openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master
 301 15 2024-07-31 2025-02-26 5 1 fwang12@ebay.com fwang12@ebay.com
CelebornColumnBuilder.scala
in client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar
 295 17 2024-12-24 2024-12-24 1 1 fengmingxiao.fmx@alibaba-in... fengmingxiao.fmx@alibaba-in...
CelebornColumnBuilder.scala
in client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar
 295 17 2024-09-05 2024-09-05 1 1 programgeek@163.com programgeek@163.com
CelebornSortBasedPusher.java
in client-tez/tez/src/main/java/org/apache/tez/runtime/library/sort
 289 12 2024-12-03 2024-12-03 1 1 hongguangwei@bytedance.com hongguangwei@bytedance.com
CelebornBufferStream.java
in client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/client
 288 16 2025-01-03 2025-01-03 1 1 programgeek@163.com programgeek@163.com
SortBasedDataBuffer.java
in client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/buffer
 273 20 2024-04-09 2024-04-09 1 1 programgeek@163.com programgeek@163.com
CelebornException.h
in cpp/celeborn/utils
 272 8 2024-11-28 2025-01-04 2 1 jiaming.xie7@gmail.com jiaming.xie7@gmail.com
CelebornChannelBufferReader.java
in client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered
 269 17 2025-04-07 2025-04-07 1 1 programgeek@163.com programgeek@163.com
FindSodium.cmake
in cpp/cmake
 265 - 2024-11-26 2024-11-26 1 1 jiaming.xie7@gmail.com jiaming.xie7@gmail.com
CelebornOrderedGroupedKVInput.java
in client-tez/tez/src/main/java/org/apache/tez/runtime/library/input
 263 15 2024-12-06 2024-12-06 1 1 hongguangwei@bytedance.com hongguangwei@bytedance.com
DynMethods.java
in common/src/main/java/org/apache/celeborn/reflect
 262 40 2022-10-29 2024-01-10 2 1 chengpan@apache.org chengpan@apache.org
CelebornUnorderedKVInput.java
in client-tez/tez/src/main/java/org/apache/tez/runtime/library/input
 259 9 2024-12-06 2024-12-13 2 1 hongguangwei@bytedance.com hongguangwei@bytedance.com
CelebornColumnarBatchCodeGenBuild.scala
in client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar
 256 3 2024-12-24 2024-12-24 1 1 fengmingxiao.fmx@alibaba-in... fengmingxiao.fmx@alibaba-in...
CelebornColumnarBatchCodeGenBuild.scala
in client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar
 256 3 2024-09-05 2024-09-05 1 1 programgeek@163.com programgeek@163.com
DynConstructors.java
in common/src/main/java/org/apache/celeborn/reflect
 233 26 2022-10-29 2024-01-10 2 1 chengpan@apache.org chengpan@apache.org
DynFields.java
in common/src/main/java/org/apache/celeborn/reflect
 225 36 2022-10-29 2024-01-10 2 1 chengpan@apache.org chengpan@apache.org
MessageDispatcher.cpp
in cpp/celeborn/network
 223 10 2025-01-22 2025-01-22 1 1 jiaming.xie7@gmail.com jiaming.xie7@gmail.com
RegistrationRpcHandler.java
in common/src/main/java/org/apache/celeborn/common/network/sasl/registration
 218 13 2024-01-23 2024-04-03 2 1 singh.chandni@gmail.com singh.chandni@gmail.com
PartitionLocationData.java
in openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/model
 218 29 2024-07-31 2024-09-24 3 1 fwang12@ebay.com fwang12@ebay.com
RegistrationClientBootstrap.java
in common/src/main/java/org/apache/celeborn/common/network/sasl/registration
 213 7 2024-01-23 2024-04-03 2 1 singh.chandni@gmail.com singh.chandni@gmail.com
WorkersResponse.java
in openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/model
 211 29 2024-07-31 2024-09-24 2 1 fwang12@ebay.com fwang12@ebay.com
CelebornException.cpp
in cpp/celeborn/utils
 211 5 2024-11-28 2025-01-04 2 1 jiaming.xie7@gmail.com jiaming.xie7@gmail.com
CelebornUnorderedKVOutput.java
in client-tez/tez/src/main/java/org/apache/tez/runtime/library/output
 210 8 2024-12-05 2024-12-13 2 1 hongguangwei@bytedance.com hongguangwei@bytedance.com
CelebornColumnStats.scala
in client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar
 205 19 2024-12-24 2024-12-24 1 1 fengmingxiao.fmx@alibaba-in... fengmingxiao.fmx@alibaba-in...
CelebornColumnStats.scala
in client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar
 205 19 2024-09-05 2024-09-05 1 1 programgeek@163.com programgeek@163.com
RemoteShuffleEnvironment.java
in client-flink/common/src/main/java/org/apache/celeborn/plugin/flink
 197 12 2024-12-31 2024-12-31 1 1 programgeek@163.com programgeek@163.com
CelebornOrderedGroupedMergedKVInput.java
in client-tez/tez/src/main/java/org/apache/tez/runtime/library/input
 185 20 2024-12-06 2024-12-06 1 1 hongguangwei@bytedance.com hongguangwei@bytedance.com
CelebornTezShuffleDataFetcher.java
in client-tez/tez/src/main/java/org/apache/tez/runtime/library/common/shuffle/orderedgrouped
 183 11 2024-12-06 2024-12-06 1 1 hongguangwei@bytedance.com hongguangwei@bytedance.com
BaseConf.cpp
in cpp/celeborn/conf
 183 14 2024-12-23 2025-01-04 2 1 jiaming.xie7@gmail.com jiaming.xie7@gmail.com
CelebornShuffleFetcher.java
in client-mr/mr/src/main/java/org/apache/hadoop/mapreduce/task/reduce
 183 7 2023-09-14 2024-07-29 2 1 fengmingxiao.fmx@alibaba-in... fengmingxiao.fmx@alibaba-in...
WorkerApi.java
in openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker
 179 9 2024-07-31 2025-01-02 3 1 fwang12@ebay.com fwang12@ebay.com
CelebornUnorderedPartitionedKVOutput.java
in client-tez/tez/src/main/java/org/apache/tez/runtime/library/output
 177 7 2024-12-05 2024-12-13 2 1 hongguangwei@bytedance.com hongguangwei@bytedance.com
AbstractRemoteShuffleResultPartition.java
in client-flink/common/src/main/java/org/apache/celeborn/plugin/flink
 175 23 2024-12-31 2024-12-31 1 1 programgeek@163.com programgeek@163.com
BaseConf.h
in cpp/celeborn/conf
 173 23 2024-12-23 2025-01-04 2 1 jiaming.xie7@gmail.com jiaming.xie7@gmail.com
Correlations

File Size vs. Number of Changes: 881 points

common/src/main/scala/org/apache/celeborn/common/util/CelebornHadoopUtils.scala x: 113 lines of code y: 11 # changes common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala x: 5367 lines of code y: 241 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala x: 947 lines of code y: 138 # changes charts/celeborn/ci/values.yaml x: 99 lines of code y: 5 # changes charts/celeborn/templates/configmap.yaml x: 46 lines of code y: 16 # changes charts/celeborn/templates/master/service.yaml x: 63 lines of code y: 6 # changes charts/celeborn/templates/master/statefulset.yaml x: 151 lines of code y: 11 # changes charts/celeborn/values.yaml x: 158 lines of code y: 26 # changes charts/celeborn/templates/master/_helpers.tpl x: 81 lines of code y: 2 # changes charts/celeborn/templates/master/priorityclass.yaml x: 23 lines of code y: 4 # changes charts/celeborn/templates/worker/_helpers.tpl x: 103 lines of code y: 2 # changes common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala x: 619 lines of code y: 33 # changes client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java x: 1889 lines of code y: 128 # changes client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala x: 1622 lines of code y: 125 # changes common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala x: 279 lines of code y: 35 # changes master/src/main/java/org/apache/celeborn/service/deploy/master/SlotsAllocator.java x: 579 lines of code y: 21 # changes project/CelebornBuild.scala x: 1459 lines of code y: 99 # changes client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkUtils.java x: 402 lines of code y: 12 # changes client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkUtils.java x: 523 lines of code y: 20 # changes client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala x: 462 lines of code y: 39 # changes common/src/main/scala/org/apache/celeborn/common/identity/DefaultIdentityProvider.scala x: 9 lines of code y: 6 # changes common/src/main/scala/org/apache/celeborn/common/identity/HadoopBasedIdentityProvider.scala x: 10 lines of code y: 2 # changes common/src/main/scala/org/apache/celeborn/common/identity/IdentityProvider.scala x: 16 lines of code y: 8 # changes common/src/main/scala/org/apache/celeborn/common/util/Utils.scala x: 990 lines of code y: 76 # changes service/src/main/java/org/apache/celeborn/server/common/service/config/DynamicConfigServiceFactory.java x: 35 lines of code y: 8 # changes master/src/main/proto/Resource.proto x: 227 lines of code y: 21 # changes master/src/main/scala/org/apache/celeborn/service/deploy/master/http/api/v1/ApplicationResource.scala x: 72 lines of code y: 7 # changes openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/ApplicationApi.java x: 220 lines of code y: 6 # changes openapi/openapi-client/src/main/openapi3/master_rest_v1.yaml x: 1110 lines of code y: 17 # changes openapi/openapi-client/src/main/openapi3/worker_rest_v1.yaml x: 687 lines of code y: 11 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/FlushTask.scala x: 76 lines of code y: 10 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/TierWriter.scala x: 586 lines of code y: 6 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/client/FlinkShuffleClientImpl.java x: 618 lines of code y: 3 # changes common/src/main/java/org/apache/celeborn/common/protocol/message/StatusCode.java x: 84 lines of code y: 23 # changes common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala x: 1212 lines of code y: 79 # changes common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala x: 643 lines of code y: 41 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitor.scala x: 278 lines of code y: 32 # changes client/src/main/java/org/apache/celeborn/client/read/CelebornInputStream.java x: 780 lines of code y: 32 # changes client/src/main/java/org/apache/celeborn/client/read/DfsPartitionReader.java x: 313 lines of code y: 23 # changes common/src/main/java/org/apache/celeborn/common/meta/DiskFileInfo.java x: 121 lines of code y: 6 # changes master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java x: 532 lines of code y: 54 # changes master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala x: 1315 lines of code y: 145 # changes multipart-uploader/multipart-uploader-oss/src/main/java/org/apache/celeborn/OssMultipartUploadHandler.java x: 111 lines of code y: 1 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionDataWriter.java x: 221 lines of code y: 18 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java x: 866 lines of code y: 45 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/TierWriterHelper.java x: 39 lines of code y: 2 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala x: 740 lines of code y: 51 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala x: 576 lines of code y: 54 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala x: 1404 lines of code y: 86 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala x: 185 lines of code y: 26 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala x: 1094 lines of code y: 90 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/AbstractRemoteShuffleInputGate.java x: 132 lines of code y: 2 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/AbstractRemoteShuffleServiceFactory.java x: 82 lines of code y: 3 # changes client-flink/flink-1.16/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGate.java x: 134 lines of code y: 3 # changes client-flink/flink-1.16/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleServiceFactory.java x: 39 lines of code y: 4 # changes client-flink/flink-1.17/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGate.java x: 134 lines of code y: 4 # changes client-flink/flink-1.17/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleServiceFactory.java x: 39 lines of code y: 5 # changes client-flink/flink-1.18/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGate.java x: 137 lines of code y: 4 # changes client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleServiceFactory.java x: 37 lines of code y: 4 # changes client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGate.java x: 135 lines of code y: 1 # changes client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateFactory.java x: 33 lines of code y: 1 # changes client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartition.java x: 47 lines of code y: 1 # changes client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionFactory.java x: 64 lines of code y: 1 # changes client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferManager.java x: 123 lines of code y: 1 # changes client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferReader.java x: 269 lines of code y: 1 # changes client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java x: 464 lines of code y: 1 # changes client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierFactory.java x: 90 lines of code y: 1 # changes client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierMasterAgent.java x: 172 lines of code y: 1 # changes client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierProducerAgent.java x: 386 lines of code y: 1 # changes client/src/main/scala/org/apache/celeborn/client/CommitManager.scala x: 278 lines of code y: 31 # changes client/src/main/scala/org/apache/celeborn/client/commit/MapPartitionCommitHandler.scala x: 192 lines of code y: 20 # changes client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala x: 340 lines of code y: 24 # changes common/src/main/java/org/apache/celeborn/common/network/protocol/SerdeVersion.java x: 12 lines of code y: 1 # changes common/src/main/java/org/apache/celeborn/common/network/protocol/TransportMessage.java x: 128 lines of code y: 18 # changes common/src/main/scala/org/apache/celeborn/common/rpc/netty/NettyRpcEnv.scala x: 509 lines of code y: 25 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/MemoryManager.java x: 554 lines of code y: 30 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/PartitionMetaHandler.scala x: 340 lines of code y: 2 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StoragePolicy.scala x: 170 lines of code y: 3 # changes charts/celeborn/templates/_helpers.tpl x: 106 lines of code y: 6 # changes charts/celeborn/templates/master/podmonitor.yaml x: 37 lines of code y: 3 # changes client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java x: 243 lines of code y: 31 # changes client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala x: 219 lines of code y: 19 # changes client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java x: 393 lines of code y: 40 # changes client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala x: 400 lines of code y: 35 # changes client/src/main/java/org/apache/celeborn/client/ShuffleClient.java x: 211 lines of code y: 43 # changes common/src/main/proto/TransportMessages.proto x: 784 lines of code y: 107 # changes master/src/main/scala/org/apache/celeborn/service/deploy/master/MasterSource.scala x: 31 lines of code y: 20 # changes client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java x: 344 lines of code y: 31 # changes charts/celeborn/files/conf/log4j2.xml x: 57 lines of code y: 1 # changes cpp/celeborn/utils/CelebornUtils.cpp x: 55 lines of code y: 3 # changes cpp/celeborn/utils/CelebornUtils.h x: 71 lines of code y: 6 # changes common/src/main/scala/org/apache/celeborn/common/quota/ResourceConsumption.scala x: 73 lines of code y: 3 # changes common/src/main/scala/org/apache/celeborn/common/quota/StorageQuota.scala x: 20 lines of code y: 1 # changes master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/SingleMasterMetaManager.java x: 136 lines of code y: 31 # changes master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java x: 397 lines of code y: 30 # changes master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MetaHandler.java x: 278 lines of code y: 30 # changes master/src/main/scala/org/apache/celeborn/service/deploy/master/quota/QuotaManager.scala x: 353 lines of code y: 4 # changes service/src/main/java/org/apache/celeborn/server/common/service/config/DynamicConfig.java x: 254 lines of code y: 8 # changes common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala x: 265 lines of code y: 19 # changes client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java x: 349 lines of code y: 28 # changes client/src/main/java/org/apache/celeborn/client/read/LocalPartitionReader.java x: 249 lines of code y: 9 # changes client/src/main/java/org/apache/celeborn/client/read/MetricsCallback.java x: 6 lines of code y: 2 # changes client/src/main/java/org/apache/celeborn/client/read/PartitionReader.java x: 13 lines of code y: 4 # changes client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java x: 254 lines of code y: 21 # changes multipart-uploader/multipart-uploader-s3/src/main/java/org/apache/celeborn/S3MultipartUploadHandler.java x: 160 lines of code y: 1 # changes common/src/main/scala/org/apache/celeborn/common/meta/ShufflePartitionLocationInfo.scala x: 98 lines of code y: 12 # changes common/src/main/scala/org/apache/celeborn/common/util/ThreadUtils.scala x: 298 lines of code y: 14 # changes cpp/celeborn/network/TransportClient.h x: 92 lines of code y: 3 # changes client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/ShuffleInMemorySorter.java x: 102 lines of code y: 3 # changes client-spark/spark-2/src/main/scala/org/apache/spark/celeborn/ExceptionMakerHelper.scala x: 21 lines of code y: 2 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/ChunkStreamManager.java x: 136 lines of code y: 9 # changes client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleFallbackPolicyRunner.scala x: 36 lines of code y: 10 # changes client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleHandle.scala x: 34 lines of code y: 6 # changes client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/ShuffleFetchFailureReportTaskCleanListener.scala x: 9 lines of code y: 1 # changes common/src/main/java/org/apache/celeborn/common/network/TransportContext.java x: 201 lines of code y: 22 # changes common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java x: 297 lines of code y: 28 # changes common/src/main/java/org/apache/celeborn/common/network/util/TransportConf.java x: 148 lines of code y: 18 # changes cli/src/main/scala/org/apache/celeborn/cli/master/MasterOptions.scala x: 80 lines of code y: 8 # changes cli/src/main/scala/org/apache/celeborn/cli/master/MasterSubcommandImpl.scala x: 208 lines of code y: 9 # changes master/src/main/scala/org/apache/celeborn/service/deploy/master/http/api/v1/WorkerResource.scala x: 156 lines of code y: 12 # changes openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/WorkerApi.java x: 301 lines of code y: 5 # changes openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/model/TopologyResponse.java x: 75 lines of code y: 1 # changes openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/model/WorkerData.java x: 361 lines of code y: 4 # changes service/src/main/scala/org/apache/celeborn/server/common/http/api/v1/ApiUtils.scala x: 133 lines of code y: 6 # changes common/src/main/java/org/apache/celeborn/common/client/MasterClient.java x: 188 lines of code y: 17 # changes client/src/main/java/org/apache/celeborn/client/DummyShuffleClient.java x: 175 lines of code y: 2 # changes common/src/main/java/org/apache/celeborn/common/protocol/StorageInfo.java x: 243 lines of code y: 8 # changes client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferManager.java x: 123 lines of code y: 2 # changes client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferReader.java x: 269 lines of code y: 4 # changes common/src/main/scala/org/apache/celeborn/common/rpc/RpcEndpointRef.scala x: 55 lines of code y: 5 # changes common/src/main/scala/org/apache/celeborn/common/rpc/RpcEnv.scala x: 154 lines of code y: 16 # changes cpp/celeborn/network/MessageDispatcher.h x: 62 lines of code y: 2 # changes common/src/main/java/org/apache/celeborn/common/network/util/NettyUtils.java x: 174 lines of code y: 12 # changes master/src/main/scala/org/apache/celeborn/service/deploy/master/http/api/ApiMasterResource.scala x: 117 lines of code y: 7 # changes master/src/main/scala/org/apache/celeborn/service/deploy/master/http/api/v1/MasterResource.scala x: 78 lines of code y: 4 # changes master/src/main/scala/org/apache/celeborn/service/deploy/master/http/api/v1/RatisResource.scala x: 328 lines of code y: 6 # changes service/src/main/scala/org/apache/celeborn/server/common/http/api/ApiBaseResource.scala x: 90 lines of code y: 5 # changes service/src/main/scala/org/apache/celeborn/server/common/http/api/v1/ConfResource.scala x: 111 lines of code y: 3 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/http/api/ApiWorkerResource.scala x: 64 lines of code y: 5 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/http/api/v1/ApplicationResource.scala x: 29 lines of code y: 5 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/http/api/v1/WorkerResource.scala x: 63 lines of code y: 4 # changes cpp/celeborn/network/MessageDispatcher.cpp x: 223 lines of code y: 1 # changes client-mr/mr/src/main/java/org/apache/hadoop/mapreduce/task/reduce/CelebornShuffleConsumer.java x: 149 lines of code y: 5 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionData.java x: 217 lines of code y: 5 # changes cpp/celeborn/protocol/ControlMessages.cpp x: 150 lines of code y: 1 # changes cpp/celeborn/protocol/PartitionLocation.h x: 62 lines of code y: 3 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/utils/FlinkUtils.java x: 53 lines of code y: 9 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala x: 168 lines of code y: 47 # changes cpp/celeborn/conf/BaseConf.h x: 173 lines of code y: 2 # changes cpp/celeborn/conf/CelebornConf.cpp x: 155 lines of code y: 2 # changes cpp/celeborn/memory/ByteBuffer.cpp x: 55 lines of code y: 2 # changes cpp/celeborn/protocol/TransportMessage.cpp x: 30 lines of code y: 2 # changes cpp/celeborn/utils/CelebornException.cpp x: 211 lines of code y: 2 # changes cpp/celeborn/utils/CelebornException.h x: 272 lines of code y: 2 # changes cpp/celeborn/utils/Exceptions.h x: 330 lines of code y: 2 # changes cpp/celeborn/utils/StackTrace.cpp x: 145 lines of code y: 2 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteBufferStreamReader.java x: 131 lines of code y: 10 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateDelegation.java x: 455 lines of code y: 10 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGate.java x: 226 lines of code y: 7 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/client/CelebornBufferStream.java x: 288 lines of code y: 1 # changes client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java x: 464 lines of code y: 4 # changes client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierProducerAgent.java x: 386 lines of code y: 4 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/ReadBufferDispatcher.java x: 134 lines of code y: 8 # changes openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/WorkerApi.java x: 179 lines of code y: 3 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/FlinkTransportClientFactory.java x: 40 lines of code y: 13 # changes common/src/main/java/org/apache/celeborn/common/network/server/TransportServer.java x: 136 lines of code y: 12 # changes common/src/main/java/org/apache/celeborn/common/network/util/NettyMemoryMetrics.java x: 158 lines of code y: 6 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/AbstractRemoteShuffleResultPartition.java x: 175 lines of code y: 1 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleEnvironment.java x: 197 lines of code y: 1 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleMaster.java x: 280 lines of code y: 18 # changes client-flink/flink-1.16/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartition.java x: 43 lines of code y: 3 # changes client-flink/flink-1.17/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartition.java x: 47 lines of code y: 6 # changes client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnAccessor.scala x: 102 lines of code y: 1 # changes client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala x: 295 lines of code y: 1 # changes client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala x: 205 lines of code y: 1 # changes client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala x: 466 lines of code y: 1 # changes client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchBuilder.scala x: 87 lines of code y: 1 # changes client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchCodeGenBuild.scala x: 256 lines of code y: 1 # changes client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressionSchemes.scala x: 356 lines of code y: 1 # changes openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/LoggerApi.java x: 141 lines of code y: 1 # changes common/src/main/scala/org/apache/celeborn/common/rpc/RpcSource.scala x: 12 lines of code y: 3 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/ShuffleResourceTracker.java x: 159 lines of code y: 4 # changes client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala x: 350 lines of code y: 33 # changes client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala x: 121 lines of code y: 10 # changes client/src/main/scala/org/apache/celeborn/client/WorkerStatusTracker.scala x: 209 lines of code y: 22 # changes master/src/main/scala/org/apache/celeborn/service/deploy/master/tags/TagsManager.scala x: 93 lines of code y: 8 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/congestcontrol/CongestionController.java x: 275 lines of code y: 16 # changes client/src/main/java/org/apache/celeborn/client/write/DataPusher.java x: 211 lines of code y: 21 # changes common/src/main/scala/org/apache/celeborn/common/rpc/netty/Dispatcher.scala x: 177 lines of code y: 10 # changes common/src/main/java/org/apache/celeborn/common/network/protocol/MessageWithHeader.java x: 146 lines of code y: 4 # changes service/src/main/scala/org/apache/celeborn/common/metrics/sink/JsonServlet.scala x: 313 lines of code y: 2 # changes client-tez/tez/src/main/java/org/apache/tez/dag/app/CelebornDagAppMaster.java x: 394 lines of code y: 2 # changes client-tez/tez/src/main/java/org/apache/tez/runtime/library/input/CelebornUnorderedKVInput.java x: 259 lines of code y: 2 # changes common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java x: 320 lines of code y: 26 # changes common/src/main/java/org/apache/celeborn/common/util/ExceptionUtils.java x: 50 lines of code y: 8 # changes cpp/celeborn/proto/TransportMessagesCpp.proto x: 784 lines of code y: 1 # changes client-tez/tez/src/main/java/org/apache/tez/runtime/library/input/CelebornOrderedGroupedMergedKVInput.java x: 185 lines of code y: 1 # changes client-tez/tez/src/main/java/org/apache/tez/runtime/library/common/shuffle/impl/CelebornShuffleManager.java x: 427 lines of code y: 1 # changes client-tez/tez/src/main/java/org/apache/tez/runtime/library/common/shuffle/orderedgrouped/CelebornScheduler.java x: 308 lines of code y: 1 # changes openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/model/WorkerInfoResponse.java x: 401 lines of code y: 3 # changes master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/IMetadataHandler.java x: 62 lines of code y: 19 # changes service/src/main/scala/org/apache/celeborn/server/common/HttpService.scala x: 289 lines of code y: 40 # changes client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleFallbackPolicyRunner.scala x: 39 lines of code y: 8 # changes service/src/main/java/org/apache/celeborn/server/common/service/config/SystemConfig.java x: 53 lines of code y: 6 # changes service/src/main/java/org/apache/celeborn/server/common/service/config/DbConfigServiceImpl.java x: 40 lines of code y: 7 # changes service/src/main/java/org/apache/celeborn/server/common/service/store/db/DBSessionFactory.java x: 68 lines of code y: 2 # changes common/src/main/scala/org/apache/celeborn/common/rpc/netty/Inbox.scala x: 285 lines of code y: 5 # changes service/src/main/scala/org/apache/celeborn/server/common/http/authentication/AuthenticationFilter.scala x: 176 lines of code y: 4 # changes client/src/main/scala/org/apache/celeborn/client/ApplicationHeartbeater.scala x: 142 lines of code y: 17 # changes client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SendBufferPool.java x: 83 lines of code y: 7 # changes client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java x: 399 lines of code y: 22 # changes client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java x: 333 lines of code y: 18 # changes openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/model/ThreadStack.java x: 335 lines of code y: 4 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/CreditStreamManager.java x: 324 lines of code y: 13 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/buffer/BufferPacker.java x: 291 lines of code y: 10 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/TransportFrameDecoderWithBufferSupplier.java x: 228 lines of code y: 8 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionDataReader.java x: 448 lines of code y: 3 # changes common/src/main/java/org/apache/celeborn/common/meta/FileInfo.java x: 76 lines of code y: 20 # changes project/plugins.sbt x: 5 lines of code y: 7 # changes openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/model/ContainerInfo.java x: 214 lines of code y: 2 # changes common/src/main/java/org/apache/celeborn/common/util/ShutdownHookManager.java x: 194 lines of code y: 11 # changes service/src/main/java/org/apache/celeborn/server/common/service/config/BaseConfigServiceImpl.java x: 85 lines of code y: 6 # changes openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/DefaultApi.java x: 136 lines of code y: 3 # changes client-mr/mr/src/main/java/org/apache/celeborn/mapreduce/v2/app/MRAppMasterWithCeleborn.java x: 177 lines of code y: 8 # changes master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HARaftServer.java x: 504 lines of code y: 27 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/ReadClientHandler.java x: 136 lines of code y: 15 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/protocol/ReadData.java x: 51 lines of code y: 4 # changes openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/model/MasterCommitData.java x: 164 lines of code y: 3 # changes service/src/main/java/org/apache/celeborn/server/common/service/config/FsConfigServiceImpl.java x: 95 lines of code y: 11 # changes common/src/main/java/org/apache/celeborn/common/network/sasl/SecretRegistryImpl.java x: 29 lines of code y: 6 # changes common/src/main/java/org/apache/celeborn/common/util/JavaUtils.java x: 351 lines of code y: 11 # changes service/src/main/scala/org/apache/celeborn/server/common/http/api/CelebornOpenApiResource.scala x: 88 lines of code y: 6 # changes openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/MasterApi.java x: 96 lines of code y: 2 # changes openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/invoker/ApiClient.java x: 610 lines of code y: 2 # changes openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/model/PartitionLocationData.java x: 218 lines of code y: 3 # changes openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/model/SendWorkerEventRequest.java x: 124 lines of code y: 4 # changes common/src/main/java/org/apache/celeborn/common/protocol/TransportModuleConstants.java x: 13 lines of code y: 5 # changes common/src/main/java/org/apache/celeborn/common/write/InFlightRequestTracker.java x: 159 lines of code y: 17 # changes common/src/main/java/org/apache/celeborn/common/meta/MapFileMeta.java x: 123 lines of code y: 3 # changes common/src/main/java/org/apache/celeborn/common/network/protocol/Message.java x: 195 lines of code y: 13 # changes client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java x: 298 lines of code y: 21 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/ObservedDevice.scala x: 139 lines of code y: 7 # changes common/src/main/java/org/apache/celeborn/common/network/client/TransportClientBootstrap.java x: 4 lines of code y: 3 # changes common/src/main/java/org/apache/celeborn/common/network/client/TransportResponseHandler.java x: 397 lines of code y: 23 # changes master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/StateMachine.java x: 256 lines of code y: 12 # changes client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressionSchemes.scala x: 353 lines of code y: 3 # changes common/src/main/java/org/apache/celeborn/common/util/ShuffleBlockInfoUtils.java x: 128 lines of code y: 5 # changes common/src/main/java/org/apache/celeborn/common/unsafe/Platform.java x: 238 lines of code y: 5 # changes common/src/main/java/org/apache/celeborn/common/network/ssl/SSLFactory.java x: 334 lines of code y: 3 # changes client-mr/mr/src/main/java/org/apache/hadoop/mapred/CelebornSortBasedPusher.java x: 281 lines of code y: 3 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionDelegation.java x: 261 lines of code y: 3 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/buffer/SortBasedDataBuffer.java x: 273 lines of code y: 1 # changes common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigEntry.scala x: 196 lines of code y: 14 # changes dev/merge_pr.py x: 461 lines of code y: 8 # changes web/src/api/models/worker/types/worker.ts x: 24 lines of code y: 3 # changes web/src/composables/pagination.ts x: 77 lines of code y: 4 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerArguments.scala x: 58 lines of code y: 10 # changes common/src/main/java/org/apache/celeborn/common/network/server/TransportChannelHandler.java x: 148 lines of code y: 6 # changes master/src/main/scala/org/apache/celeborn/service/deploy/master/MasterArguments.scala x: 67 lines of code y: 13 # changes common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigBuilder.scala x: 250 lines of code y: 10 # changes client/src/main/java/org/apache/celeborn/client/ReviveManager.java x: 95 lines of code y: 7 # changes common/src/main/java/org/apache/celeborn/reflect/DynConstructors.java x: 233 lines of code y: 2 # changes common/src/main/java/org/apache/celeborn/reflect/DynFields.java x: 225 lines of code y: 2 # changes common/src/main/java/org/apache/celeborn/reflect/DynMethods.java x: 262 lines of code y: 2 # changes client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleHandle.scala x: 34 lines of code y: 5 # changes project/AddMetaInfLicenseFiles.scala x: 230 lines of code y: 3 # changes common/src/main/java/org/apache/celeborn/common/network/protocol/PushData.java x: 84 lines of code y: 5 # changes common/src/main/java/org/apache/celeborn/common/network/protocol/RegionFinish.java x: 68 lines of code y: 5 # changes common/src/main/java/org/apache/celeborn/common/network/protocol/PushMergedData.java x: 98 lines of code y: 4 # changes client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala x: 294 lines of code y: 2 # changes client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala x: 461 lines of code y: 2 # changes common/src/main/java/org/apache/celeborn/common/protocol/PartitionLocation.java x: 271 lines of code y: 10 # changes client/src/main/java/org/apache/celeborn/client/compress/Decompressor.java x: 37 lines of code y: 7 # changes client/src/main/java/org/apache/celeborn/client/compress/Compressor.java x: 28 lines of code y: 8 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/BufferQueue.java x: 115 lines of code y: 2 # changes common/src/main/scala/org/apache/celeborn/common/rpc/netty/Outbox.scala x: 186 lines of code y: 2 # changes
241.0
# changes
  min: 1.0
  average: 5.88
  25th percentile: 1.0
  median: 2.0
  75th percentile: 4.0
  max: 241.0
0 5367.0
lines of code
min: 1.0 | average: 120.67 | 25th percentile: 23.0 | median: 54.0 | 75th percentile: 135.0 | max: 5367.0

Number of Contributors vs. Number of Changes: 881 points

common/src/main/scala/org/apache/celeborn/common/util/CelebornHadoopUtils.scala x: 7 # contributors y: 11 # changes common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala x: 53 # contributors y: 241 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala x: 36 # contributors y: 138 # changes charts/celeborn/ci/values.yaml x: 2 # contributors y: 5 # changes charts/celeborn/templates/configmap.yaml x: 7 # contributors y: 16 # changes charts/celeborn/templates/master/service.yaml x: 3 # contributors y: 6 # changes charts/celeborn/templates/master/statefulset.yaml x: 4 # contributors y: 11 # changes charts/celeborn/values.yaml x: 13 # contributors y: 26 # changes charts/celeborn/templates/master/_helpers.tpl x: 1 # contributors y: 2 # changes charts/celeborn/templates/master/priorityclass.yaml x: 1 # contributors y: 4 # changes common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala x: 17 # contributors y: 33 # changes client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java x: 36 # contributors y: 128 # changes client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala x: 30 # contributors y: 125 # changes common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala x: 18 # contributors y: 35 # changes master/src/main/java/org/apache/celeborn/service/deploy/master/SlotsAllocator.java x: 16 # contributors y: 21 # changes project/CelebornBuild.scala x: 24 # contributors y: 99 # changes client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkUtils.java x: 7 # contributors y: 12 # changes client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkUtils.java x: 11 # contributors y: 20 # changes client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala x: 15 # contributors y: 39 # changes common/src/main/scala/org/apache/celeborn/common/identity/DefaultIdentityProvider.scala x: 6 # contributors y: 6 # changes common/src/main/scala/org/apache/celeborn/common/identity/HadoopBasedIdentityProvider.scala x: 2 # contributors y: 2 # changes common/src/main/scala/org/apache/celeborn/common/identity/IdentityProvider.scala x: 7 # contributors y: 8 # changes common/src/main/scala/org/apache/celeborn/common/util/Utils.scala x: 32 # contributors y: 76 # changes service/src/main/java/org/apache/celeborn/server/common/service/config/DynamicConfigServiceFactory.java x: 5 # contributors y: 8 # changes master/src/main/proto/Resource.proto x: 15 # contributors y: 21 # changes master/src/main/scala/org/apache/celeborn/service/deploy/master/http/api/v1/ApplicationResource.scala x: 2 # contributors y: 7 # changes openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/ApplicationApi.java x: 2 # contributors y: 6 # changes openapi/openapi-client/src/main/openapi3/master_rest_v1.yaml x: 4 # contributors y: 17 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/FlushTask.scala x: 7 # contributors y: 10 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/client/FlinkShuffleClientImpl.java x: 3 # contributors y: 3 # changes common/src/main/java/org/apache/celeborn/common/protocol/message/StatusCode.java x: 9 # contributors y: 23 # changes common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala x: 28 # contributors y: 79 # changes common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala x: 21 # contributors y: 41 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitor.scala x: 13 # contributors y: 32 # changes client/src/main/java/org/apache/celeborn/client/read/CelebornInputStream.java x: 17 # contributors y: 32 # changes client/src/main/java/org/apache/celeborn/client/read/DfsPartitionReader.java x: 15 # contributors y: 23 # changes common/src/main/java/org/apache/celeborn/common/meta/DiskFileInfo.java x: 4 # contributors y: 6 # changes master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java x: 24 # contributors y: 54 # changes master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala x: 30 # contributors y: 145 # changes multipart-uploader/multipart-uploader-oss/src/main/java/org/apache/celeborn/OssMultipartUploadHandler.java x: 1 # contributors y: 1 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionDataWriter.java x: 11 # contributors y: 18 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java x: 15 # contributors y: 45 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala x: 23 # contributors y: 51 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala x: 21 # contributors y: 54 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala x: 29 # contributors y: 86 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala x: 34 # contributors y: 90 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/AbstractRemoteShuffleServiceFactory.java x: 2 # contributors y: 3 # changes client-flink/flink-1.16/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleServiceFactory.java x: 2 # contributors y: 4 # changes client-flink/flink-1.19/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGate.java x: 1 # contributors y: 3 # changes client/src/main/scala/org/apache/celeborn/client/CommitManager.scala x: 14 # contributors y: 31 # changes client/src/main/scala/org/apache/celeborn/client/commit/MapPartitionCommitHandler.scala x: 9 # contributors y: 20 # changes client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala x: 10 # contributors y: 24 # changes common/src/main/scala/org/apache/celeborn/common/rpc/netty/NettyRpcEnv.scala x: 15 # contributors y: 25 # changes common/src/main/scala/org/apache/celeborn/common/serializer/JavaSerializer.scala x: 4 # contributors y: 4 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/MemoryManager.java x: 16 # contributors y: 30 # changes client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java x: 16 # contributors y: 31 # changes client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala x: 12 # contributors y: 19 # changes client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java x: 21 # contributors y: 40 # changes client/src/main/java/org/apache/celeborn/client/ShuffleClient.java x: 21 # contributors y: 43 # changes common/src/main/proto/TransportMessages.proto x: 25 # contributors y: 107 # changes client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java x: 15 # contributors y: 31 # changes cpp/celeborn/utils/CelebornUtils.h x: 1 # contributors y: 6 # changes master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java x: 15 # contributors y: 30 # changes master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MetaHandler.java x: 18 # contributors y: 30 # changes master/src/main/scala/org/apache/celeborn/service/deploy/master/quota/QuotaManager.scala x: 3 # contributors y: 4 # changes service/src/main/java/org/apache/celeborn/server/common/service/config/DynamicConfig.java x: 4 # contributors y: 8 # changes common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala x: 14 # contributors y: 19 # changes client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java x: 12 # contributors y: 28 # changes client/src/main/java/org/apache/celeborn/client/read/LocalPartitionReader.java x: 9 # contributors y: 9 # changes client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java x: 14 # contributors y: 21 # changes common/src/main/scala/org/apache/celeborn/common/meta/ShufflePartitionLocationInfo.scala x: 8 # contributors y: 12 # changes common/src/main/scala/org/apache/celeborn/common/util/ThreadUtils.scala x: 8 # contributors y: 14 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/ChunkStreamManager.java x: 6 # contributors y: 9 # changes client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleFallbackPolicyRunner.scala x: 5 # contributors y: 10 # changes common/src/main/java/org/apache/celeborn/common/network/TransportContext.java x: 13 # contributors y: 22 # changes common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java x: 18 # contributors y: 28 # changes cli/src/main/scala/org/apache/celeborn/cli/master/MasterSubcommandImpl.scala x: 5 # contributors y: 9 # changes master/src/main/scala/org/apache/celeborn/service/deploy/master/http/api/v1/WorkerResource.scala x: 4 # contributors y: 12 # changes openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/WorkerApi.java x: 1 # contributors y: 5 # changes common/src/main/java/org/apache/celeborn/common/client/MasterClient.java x: 12 # contributors y: 17 # changes common/src/main/java/org/apache/celeborn/common/write/PushState.java x: 8 # contributors y: 10 # changes common/src/main/scala/org/apache/celeborn/common/rpc/RpcEndpointRef.scala x: 5 # contributors y: 5 # changes common/src/main/scala/org/apache/celeborn/common/rpc/RpcEnv.scala x: 11 # contributors y: 16 # changes common/src/main/java/org/apache/celeborn/common/network/util/NettyUtils.java x: 10 # contributors y: 12 # changes master/src/main/scala/org/apache/celeborn/service/deploy/master/http/api/ApiMasterResource.scala x: 4 # contributors y: 7 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/http/api/ApiWorkerResource.scala x: 3 # contributors y: 5 # changes client-mr/mr/src/main/java/org/apache/hadoop/mapreduce/task/reduce/CelebornShuffleConsumer.java x: 4 # contributors y: 5 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/utils/FlinkUtils.java x: 4 # contributors y: 9 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala x: 24 # contributors y: 47 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGate.java x: 7 # contributors y: 7 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/FlinkTransportClientFactory.java x: 10 # contributors y: 13 # changes common/src/main/java/org/apache/celeborn/common/network/server/TransportServer.java x: 11 # contributors y: 12 # changes common/src/main/java/org/apache/celeborn/common/network/util/NettyMemoryMetrics.java x: 5 # contributors y: 6 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/AbstractRemoteShuffleResultPartitionFactory.java x: 3 # contributors y: 8 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleMaster.java x: 7 # contributors y: 18 # changes client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala x: 14 # contributors y: 33 # changes client/src/main/scala/org/apache/celeborn/client/WorkerStatusTracker.scala x: 9 # contributors y: 22 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/congestcontrol/CongestionController.java x: 8 # contributors y: 16 # changes client/src/main/java/org/apache/celeborn/client/write/DataPusher.java x: 10 # contributors y: 21 # changes common/src/main/scala/org/apache/celeborn/common/rpc/netty/Dispatcher.scala x: 9 # contributors y: 10 # changes common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java x: 16 # contributors y: 26 # changes service/src/main/scala/org/apache/celeborn/server/common/HttpService.scala x: 15 # contributors y: 40 # changes client/src/main/scala/org/apache/celeborn/client/ApplicationHeartbeater.scala x: 10 # contributors y: 17 # changes client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SendBufferPool.java x: 5 # contributors y: 7 # changes client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java x: 10 # contributors y: 18 # changes worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/CreditStreamManager.java x: 8 # contributors y: 13 # changes service/src/main/java/org/apache/celeborn/server/common/service/config/ConfigService.java x: 6 # contributors y: 10 # changes master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HARaftServer.java x: 14 # contributors y: 27 # changes client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/ReadClientHandler.java x: 7 # contributors y: 15 # changes service/src/main/java/org/apache/celeborn/server/common/service/config/FsConfigServiceImpl.java x: 5 # contributors y: 11 # changes service/src/main/scala/org/apache/celeborn/server/common/http/HttpServer.scala x: 6 # contributors y: 11 # changes common/src/main/java/org/apache/celeborn/common/write/InFlightRequestTracker.java x: 8 # contributors y: 17 # changes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/ObservedDevice.scala x: 6 # contributors y: 7 # changes master/src/main/scala/org/apache/celeborn/service/deploy/master/clustermeta/ha/MasterNode.scala x: 6 # contributors y: 8 # changes common/src/main/java/org/apache/celeborn/common/network/client/TransportResponseHandler.java x: 10 # contributors y: 23 # changes master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAHelper.java x: 9 # contributors y: 12 # changes client/src/main/java/org/apache/celeborn/client/write/DataPushQueue.java x: 6 # contributors y: 12 # changes web/src/views/master/components/MasterDetailContent.vue x: 2 # contributors y: 1 # changes master/src/main/scala/org/apache/celeborn/service/deploy/master/MasterArguments.scala x: 6 # contributors y: 13 # changes
241.0
# changes
  min: 1.0
  average: 5.88
  25th percentile: 1.0
  median: 2.0
  75th percentile: 4.0
  max: 241.0
0 53.0
# contributors
min: 1.0 | average: 3.13 | 25th percentile: 1.0 | median: 1.0 | 75th percentile: 3.0 | max: 53.0

Number of Contributors vs. File Size: 881 points

common/src/main/scala/org/apache/celeborn/common/util/CelebornHadoopUtils.scala x: 7 # contributors y: 113 lines of code common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala x: 53 # contributors y: 5367 lines of code worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala x: 36 # contributors y: 947 lines of code charts/celeborn/ci/values.yaml x: 2 # contributors y: 99 lines of code charts/celeborn/templates/configmap.yaml x: 7 # contributors y: 46 lines of code charts/celeborn/templates/master/service.yaml x: 3 # contributors y: 63 lines of code charts/celeborn/templates/master/statefulset.yaml x: 4 # contributors y: 151 lines of code charts/celeborn/values.yaml x: 13 # contributors y: 158 lines of code charts/celeborn/templates/master/_helpers.tpl x: 1 # contributors y: 81 lines of code charts/celeborn/templates/master/priorityclass.yaml x: 1 # contributors y: 23 lines of code charts/celeborn/templates/worker/_helpers.tpl x: 1 # contributors y: 103 lines of code common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala x: 17 # contributors y: 619 lines of code client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java x: 36 # contributors y: 1889 lines of code client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala x: 30 # contributors y: 1622 lines of code common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala x: 18 # contributors y: 279 lines of code master/src/main/java/org/apache/celeborn/service/deploy/master/SlotsAllocator.java x: 16 # contributors y: 579 lines of code project/CelebornBuild.scala x: 24 # contributors y: 1459 lines of code client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkUtils.java x: 7 # contributors y: 402 lines of code client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkUtils.java x: 11 # contributors y: 523 lines of code client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala x: 15 # contributors y: 462 lines of code common/src/main/scala/org/apache/celeborn/common/identity/DefaultIdentityProvider.scala x: 6 # contributors y: 9 lines of code common/src/main/scala/org/apache/celeborn/common/identity/HadoopBasedIdentityProvider.scala x: 2 # contributors y: 10 lines of code common/src/main/scala/org/apache/celeborn/common/identity/IdentityProvider.scala x: 7 # contributors y: 16 lines of code common/src/main/scala/org/apache/celeborn/common/util/Utils.scala x: 32 # contributors y: 990 lines of code service/src/main/java/org/apache/celeborn/server/common/service/config/DynamicConfigServiceFactory.java x: 5 # contributors y: 35 lines of code master/src/main/proto/Resource.proto x: 15 # contributors y: 227 lines of code master/src/main/scala/org/apache/celeborn/service/deploy/master/http/api/v1/ApplicationResource.scala x: 2 # contributors y: 72 lines of code openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/ApplicationApi.java x: 2 # contributors y: 220 lines of code openapi/openapi-client/src/main/openapi3/master_rest_v1.yaml x: 4 # contributors y: 1110 lines of code openapi/openapi-client/src/main/openapi3/worker_rest_v1.yaml x: 4 # contributors y: 687 lines of code worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/FlushTask.scala x: 7 # contributors y: 76 lines of code worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/TierWriter.scala x: 3 # contributors y: 586 lines of code client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/client/FlinkShuffleClientImpl.java x: 3 # contributors y: 618 lines of code common/src/main/java/org/apache/celeborn/common/protocol/message/StatusCode.java x: 9 # contributors y: 84 lines of code common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala x: 28 # contributors y: 1212 lines of code common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala x: 21 # contributors y: 643 lines of code worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitor.scala x: 13 # contributors y: 278 lines of code client/src/main/java/org/apache/celeborn/client/read/CelebornInputStream.java x: 17 # contributors y: 780 lines of code client/src/main/java/org/apache/celeborn/client/read/DfsPartitionReader.java x: 15 # contributors y: 313 lines of code common/src/main/java/org/apache/celeborn/common/meta/DiskFileInfo.java x: 4 # contributors y: 121 lines of code master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java x: 24 # contributors y: 532 lines of code master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala x: 30 # contributors y: 1315 lines of code multipart-uploader/multipart-uploader-oss/src/main/java/org/apache/celeborn/OssMultipartUploadHandler.java x: 1 # contributors y: 111 lines of code worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionDataWriter.java x: 11 # contributors y: 221 lines of code worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java x: 15 # contributors y: 866 lines of code worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/TierWriterHelper.java x: 2 # contributors y: 39 lines of code worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala x: 23 # contributors y: 740 lines of code worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala x: 21 # contributors y: 576 lines of code worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala x: 29 # contributors y: 1404 lines of code worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala x: 13 # contributors y: 185 lines of code worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala x: 34 # contributors y: 1094 lines of code client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/AbstractRemoteShuffleInputGate.java x: 1 # contributors y: 132 lines of code client-flink/flink-1.16/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGate.java x: 2 # contributors y: 134 lines of code client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartition.java x: 1 # contributors y: 47 lines of code client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferReader.java x: 1 # contributors y: 269 lines of code client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java x: 1 # contributors y: 464 lines of code client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierMasterAgent.java x: 1 # contributors y: 172 lines of code client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierProducerAgent.java x: 1 # contributors y: 386 lines of code client/src/main/scala/org/apache/celeborn/client/CommitManager.scala x: 14 # contributors y: 278 lines of code client/src/main/scala/org/apache/celeborn/client/commit/MapPartitionCommitHandler.scala x: 9 # contributors y: 192 lines of code client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala x: 10 # contributors y: 340 lines of code common/src/main/java/org/apache/celeborn/common/network/protocol/SerdeVersion.java x: 1 # contributors y: 12 lines of code common/src/main/java/org/apache/celeborn/common/network/protocol/TransportMessage.java x: 11 # contributors y: 128 lines of code common/src/main/scala/org/apache/celeborn/common/rpc/netty/NettyRpcEnv.scala x: 15 # contributors y: 509 lines of code common/src/main/scala/org/apache/celeborn/common/serializer/JavaSerializer.scala x: 4 # contributors y: 132 lines of code worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/MemoryManager.java x: 16 # contributors y: 554 lines of code worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/PartitionMetaHandler.scala x: 1 # contributors y: 340 lines of code worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StoragePolicy.scala x: 2 # contributors y: 170 lines of code client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java x: 16 # contributors y: 243 lines of code client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala x: 12 # contributors y: 219 lines of code client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java x: 21 # contributors y: 393 lines of code client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala x: 18 # contributors y: 400 lines of code client/src/main/java/org/apache/celeborn/client/ShuffleClient.java x: 21 # contributors y: 211 lines of code common/src/main/proto/TransportMessages.proto x: 25 # contributors y: 784 lines of code master/src/main/scala/org/apache/celeborn/service/deploy/master/MasterSource.scala x: 9 # contributors y: 31 lines of code client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java x: 15 # contributors y: 344 lines of code common/src/main/scala/org/apache/celeborn/common/quota/ResourceConsumption.scala x: 3 # contributors y: 73 lines of code master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/SingleMasterMetaManager.java x: 16 # contributors y: 136 lines of code master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java x: 15 # contributors y: 397 lines of code master/src/main/scala/org/apache/celeborn/service/deploy/master/quota/QuotaManager.scala x: 3 # contributors y: 353 lines of code service/src/main/java/org/apache/celeborn/server/common/service/config/DynamicConfig.java x: 4 # contributors y: 254 lines of code common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala x: 14 # contributors y: 265 lines of code client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java x: 12 # contributors y: 349 lines of code client/src/main/java/org/apache/celeborn/client/read/LocalPartitionReader.java x: 9 # contributors y: 249 lines of code client/src/main/java/org/apache/celeborn/client/read/PartitionReader.java x: 4 # contributors y: 13 lines of code multipart-uploader/multipart-uploader-s3/src/main/java/org/apache/celeborn/S3MultipartUploadHandler.java x: 1 # contributors y: 160 lines of code common/src/main/scala/org/apache/celeborn/common/meta/ShufflePartitionLocationInfo.scala x: 8 # contributors y: 98 lines of code common/src/main/scala/org/apache/celeborn/common/util/ThreadUtils.scala x: 8 # contributors y: 298 lines of code worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/ChunkStreamManager.java x: 6 # contributors y: 136 lines of code client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/CelebornShuffleDataIO.java x: 3 # contributors y: 38 lines of code client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleHandle.scala x: 4 # contributors y: 34 lines of code common/src/main/java/org/apache/celeborn/common/network/TransportContext.java x: 13 # contributors y: 201 lines of code common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java x: 18 # contributors y: 297 lines of code common/src/main/java/org/apache/celeborn/common/network/util/TransportConf.java x: 11 # contributors y: 148 lines of code cli/src/main/scala/org/apache/celeborn/cli/master/MasterOptions.scala x: 5 # contributors y: 80 lines of code cli/src/main/scala/org/apache/celeborn/cli/master/MasterSubcommandImpl.scala x: 5 # contributors y: 208 lines of code openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/WorkerApi.java x: 1 # contributors y: 301 lines of code openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/model/WorkerData.java x: 1 # contributors y: 361 lines of code common/src/main/java/org/apache/celeborn/common/client/MasterClient.java x: 12 # contributors y: 188 lines of code common/src/main/java/org/apache/celeborn/common/protocol/StorageInfo.java x: 4 # contributors y: 243 lines of code common/src/main/java/org/apache/celeborn/common/write/PushState.java x: 8 # contributors y: 68 lines of code client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferManager.java x: 2 # contributors y: 123 lines of code client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferReader.java x: 3 # contributors y: 269 lines of code common/src/main/scala/org/apache/celeborn/common/rpc/RpcEndpointRef.scala x: 5 # contributors y: 55 lines of code common/src/main/java/org/apache/celeborn/common/network/util/NettyUtils.java x: 10 # contributors y: 174 lines of code master/src/main/scala/org/apache/celeborn/service/deploy/master/http/api/v1/RatisResource.scala x: 2 # contributors y: 328 lines of code cpp/celeborn/network/MessageDispatcher.cpp x: 1 # contributors y: 223 lines of code client-tez/tez/src/main/java/org/apache/celeborn/client/CelebornTezReader.java x: 2 # contributors y: 62 lines of code worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionData.java x: 4 # contributors y: 217 lines of code client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/utils/FlinkUtils.java x: 4 # contributors y: 53 lines of code worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala x: 24 # contributors y: 168 lines of code cpp/celeborn/utils/CelebornException.cpp x: 1 # contributors y: 211 lines of code cpp/celeborn/utils/Exceptions.h x: 1 # contributors y: 330 lines of code client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteBufferStreamReader.java x: 8 # contributors y: 131 lines of code client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateDelegation.java x: 7 # contributors y: 455 lines of code client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGate.java x: 7 # contributors y: 226 lines of code client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/client/CelebornBufferStream.java x: 1 # contributors y: 288 lines of code client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java x: 3 # contributors y: 464 lines of code client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierProducerAgent.java x: 3 # contributors y: 386 lines of code worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/ReadBufferDispatcher.java x: 7 # contributors y: 134 lines of code client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/FlinkTransportClientFactory.java x: 10 # contributors y: 40 lines of code common/src/main/java/org/apache/celeborn/common/network/util/NettyMemoryMetrics.java x: 5 # contributors y: 158 lines of code client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/AbstractRemoteShuffleInputGateFactory.java x: 4 # contributors y: 71 lines of code client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/AbstractRemoteShuffleResultPartitionFactory.java x: 3 # contributors y: 133 lines of code client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleMaster.java x: 7 # contributors y: 280 lines of code client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala x: 1 # contributors y: 466 lines of code common/src/main/scala/org/apache/celeborn/common/rpc/RpcSource.scala x: 3 # contributors y: 12 lines of code client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala x: 14 # contributors y: 350 lines of code master/src/main/scala/org/apache/celeborn/service/deploy/master/tags/TagsManager.scala x: 3 # contributors y: 93 lines of code worker/src/main/java/org/apache/celeborn/service/deploy/worker/congestcontrol/CongestionController.java x: 8 # contributors y: 275 lines of code client/src/main/java/org/apache/celeborn/client/write/DataPusher.java x: 10 # contributors y: 211 lines of code common/src/main/scala/org/apache/celeborn/common/meta/WorkerPartitionLocationInfo.scala x: 7 # contributors y: 161 lines of code common/src/main/scala/org/apache/celeborn/common/rpc/netty/Dispatcher.scala x: 9 # contributors y: 177 lines of code service/src/main/scala/org/apache/celeborn/common/metrics/sink/JsonServlet.scala x: 2 # contributors y: 313 lines of code client-tez/tez/src/main/java/org/apache/tez/dag/app/CelebornDagAppMaster.java x: 2 # contributors y: 394 lines of code common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java x: 16 # contributors y: 320 lines of code cpp/celeborn/proto/TransportMessagesCpp.proto x: 1 # contributors y: 784 lines of code client-tez/tez/src/main/java/org/apache/tez/runtime/library/common/shuffle/impl/CelebornShuffleManager.java x: 1 # contributors y: 427 lines of code master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/IMetadataHandler.java x: 14 # contributors y: 62 lines of code service/src/main/scala/org/apache/celeborn/server/common/HttpService.scala x: 15 # contributors y: 289 lines of code worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerStatusManager.scala x: 5 # contributors y: 126 lines of code worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/segment/SegmentMapPartitionDataReader.java x: 2 # contributors y: 252 lines of code common/src/main/scala/org/apache/celeborn/common/rpc/netty/Inbox.scala x: 5 # contributors y: 285 lines of code client/src/main/scala/org/apache/celeborn/client/ApplicationHeartbeater.scala x: 10 # contributors y: 142 lines of code client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java x: 9 # contributors y: 399 lines of code client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java x: 10 # contributors y: 333 lines of code worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/CreditStreamManager.java x: 8 # contributors y: 324 lines of code client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/TransportFrameDecoderWithBufferSupplier.java x: 5 # contributors y: 228 lines of code client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/utils/BufferUtils.java x: 5 # contributors y: 105 lines of code common/src/main/java/org/apache/celeborn/common/util/ShutdownHookManager.java x: 7 # contributors y: 194 lines of code service/src/main/java/org/apache/celeborn/server/common/service/config/BaseConfigServiceImpl.java x: 4 # contributors y: 85 lines of code service/src/main/java/org/apache/celeborn/server/common/service/config/ConfigService.java x: 6 # contributors y: 31 lines of code client-mr/mr/src/main/java/org/apache/celeborn/mapreduce/v2/app/MRAppMasterWithCeleborn.java x: 4 # contributors y: 177 lines of code master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HARaftServer.java x: 14 # contributors y: 504 lines of code common/src/main/java/org/apache/celeborn/common/util/JavaUtils.java x: 7 # contributors y: 351 lines of code service/src/main/scala/org/apache/celeborn/server/common/http/HttpServer.scala x: 6 # contributors y: 152 lines of code openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/invoker/ApiClient.java x: 1 # contributors y: 610 lines of code common/src/main/java/org/apache/celeborn/common/write/InFlightRequestTracker.java x: 8 # contributors y: 159 lines of code common/src/main/java/org/apache/celeborn/common/meta/MapFileMeta.java x: 3 # contributors y: 123 lines of code common/src/main/java/org/apache/celeborn/common/network/protocol/Message.java x: 8 # contributors y: 195 lines of code client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java x: 10 # contributors y: 298 lines of code master/src/main/scala/org/apache/celeborn/service/deploy/master/clustermeta/ha/MasterNode.scala x: 6 # contributors y: 82 lines of code client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/buffer/TransferBufferPool.java x: 3 # contributors y: 156 lines of code common/src/main/java/org/apache/celeborn/common/network/client/TransportResponseHandler.java x: 10 # contributors y: 397 lines of code master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAHelper.java x: 9 # contributors y: 98 lines of code master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/StateMachine.java x: 9 # contributors y: 256 lines of code common/src/main/java/org/apache/celeborn/common/unsafe/Platform.java x: 5 # contributors y: 238 lines of code client/src/main/java/org/apache/celeborn/client/write/DataPushQueue.java x: 6 # contributors y: 106 lines of code client-mr/mr/src/main/java/org/apache/hadoop/mapred/CelebornSortBasedPusher.java x: 3 # contributors y: 281 lines of code common/src/main/scala/org/apache/celeborn/common/metrics/source/ThreadPoolSource.scala x: 2 # contributors y: 151 lines of code common/src/main/java/org/apache/celeborn/reflect/DynConstructors.java x: 1 # contributors y: 233 lines of code client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala x: 2 # contributors y: 294 lines of code client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala x: 2 # contributors y: 205 lines of code client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala x: 2 # contributors y: 461 lines of code client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchCodeGenBuild.scala x: 2 # contributors y: 256 lines of code common/src/main/java/org/apache/celeborn/common/protocol/PartitionLocation.java x: 8 # contributors y: 271 lines of code
5367.0
lines of code
  min: 1.0
  average: 120.67
  25th percentile: 23.0
  median: 54.0
  75th percentile: 135.0
  max: 5367.0
0 53.0
# contributors
min: 1.0 | average: 3.13 | 25th percentile: 1.0 | median: 1.0 | 75th percentile: 3.0 | max: 53.0