An overview of contributor trends.
Contributed in past 6 months (a rookie = the first contribution in past year)
Past 30 days (14):
Past 31 to 90 days (10):
Past 91 to 180 days (14):
Last contributed more than 6 months ago
| Commits (3m) |
Commit Days |
8
|
12
|
16
|
10
|
12
|
20
|
10
|
13
|
12
|
16
|
11
|
11
|
10
|
7
|
5
|
5
|
2
|
4
|
2
|
4
|
2
|
-
|
-
|
-
|
-
|
|
| fengmingxiao.fmx@alibaba-inc.com | 10 | 59 |
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
|
|
|
|
|
|
|
|
-
|
|
-
|
-
|
-
|
-
|
-
|
| lvshuang.tb@gmail.com | 14 | 49 |
|
|
|
|
|
|
|
|
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| xiyu.zk@alibaba-inc.com | 4 | 25 |
|
-
|
|
-
|
-
|
|
-
|
-
|
-
|
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| zky.zhoukeyong@alibaba-inc.com | 46 | 72 |
|
|
|
-
|
-
|
-
|
-
|
-
|
|
|
|
|
|
|
|
-
|
-
|
-
|
|
|
|
-
|
-
|
-
|
-
|
| cfmcgrady@gmail.com | 32 | 25 |
|
|
|
-
|
|
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| 2213335496@qq.com | 7 | 6 |
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| waitinfuture@gmail.com | 1 | 1 |
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| caojiaqing@bilibili.com | 3 | 3 |
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| angers.zhu@gmail.com | 77 | 164 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| apatnam@linkedin.com | 1 | 1 |
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| 1178404354@qq.com | 4 | 8 |
-
|
|
-
|
-
|
-
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| chengpan@apache.org | 44 | 77 |
-
|
|
|
|
|
|
-
|
|
|
|
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| lyh-36@163.com | 9 | 7 |
-
|
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| peter.wsj@alibaba-inc.com | 1 | 1 |
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| zhongqiang.czq@alibaba-inc.com | 10 | 20 |
-
|
|
|
|
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| cchung100m@cs.ccu.edu.tw | 1 | 1 |
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| liangdingwen.ldw@alipay.com | 1 | 1 |
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| sychen@ctrip.com | 2 | 1 |
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| ethanfeng@apache.org | 8 | 59 |
-
|
-
|
|
|
|
|
|
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| liyihe@bigo.sg | 1 | 1 |
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| 52876270+zwangsheng@users.noreply.github.com | 2 | 27 |
-
|
-
|
|
|
|
|
|
|
|
|
|
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| ulyssesyou18@gmail.com | 1 | 1 |
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| 99078115+skytin1004@users.noreply.github.com | 1 | 1 |
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| ckj@apache.org | 1 | 4 |
-
|
-
|
-
|
|
-
|
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| wangweirao16@gmail.com | - | 1 |
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| anh131@126.com | - | 9 |
-
|
-
|
-
|
-
|
|
-
|
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| cxzl25@users.noreply.github.com | - | 2 |
-
|
-
|
-
|
-
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| zhouky@apache.org | - | 27 |
-
|
-
|
-
|
-
|
|
|
|
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| 52647492+xunxunmimi5577@users.noreply.github.com | - | 2 |
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| akpatnam25@gmail.com | - | 1 |
-
|
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| fwang12@ebay.com | - | 2 |
-
|
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| 89496918+cvedetect@users.noreply.github.com | - | 1 |
-
|
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| turbofei@foxmail.com | - | 1 |
-
|
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| lmlianne@outlook.com | - | 1 |
-
|
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| tcodehuber@gmail.com | - | 1 |
-
|
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| jn_hdd@163.com | - | 1 |
-
|
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| 86960423+every-breaking-wave@users.noreply.github.com | - | 2 |
-
|
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| 55676558+liugs0213@users.noreply.github.com | - | 2 |
-
|
-
|
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| 96606293+zhongqiangczq@users.noreply.github.com | - | 13 |
-
|
-
|
-
|
-
|
-
|
-
|
|
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| 30563796+nafiyaix@users.noreply.github.com | - | 44 |
-
|
-
|
-
|
-
|
-
|
-
|
-
|
|
|
|
|
|
|
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| 82567833+zy-jordan@users.noreply.github.com | - | 3 |
-
|
-
|
-
|
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| xianyao.jiang@gmail.com | - | 1 |
-
|
-
|
-
|
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| 48054931+szywilliam@users.noreply.github.com | - | 2 |
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| lvshuang.xjs@alibaba-inc.com | - | 4 |
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| gabrielleebuaa@gmail.com | - | 3 |
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| zouxxyy@qq.com | - | 1 |
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| 490081539@qq.com | - | 4 |
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| ethan.aquarius.fmx@gmail.com | - | 5 |
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| 643348094@qq.com | - | 2 |
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| dxheming@163.com | - | 3 |
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
|
-
|
-
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| work4dong@163.com | - | 1 |
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| 39462475+flyangz@users.noreply.github.com | - | 1 |
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| 942011334@qq.com | - | 1 |
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| lichao@kuaishou.com | - | 2 |
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| fyl_8@sina.com | - | 1 |
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| pan3793@gmail.com | - | 1 |
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| haiming@lccomputing.com | - | 3 |
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| 105328124+leoyy0316@users.noreply.github.com | - | 1 |
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| badger@gitter.im | - | 1 |
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| 45991044+wangshengjie123@users.noreply.github.com | - | 4 |
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
|
|
|
|
-
|
-
|
-
|
-
|
| tonydoen@users.noreply.github.com | - | 1 |
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
14 contributors (93 commits):
| # | Contributor |
First Commit |
Latest Commit |
Commits Count |
File Updates (per extension) |
|---|---|---|---|---|---|
| 1. | zky.zhoukeyong@alibaba-inc.com | 2021-12-28 | 2023-08-07 | 28 (30%) | java (44), md (41), scala (32), yml (9), svg (9) |
| 2. | angers.zhu@gmail.com | 2022-03-03 | 2023-07-27 | 21 (22%) | scala (33), java (28), md (9), proto (3), yml (2) |
| 3. | cfmcgrady@gmail.com | 2023-01-05 | 2023-08-05 | 15 (16%) | java (17), scala (12), (3), xml (2), template (2) |
| 4. | fengmingxiao.fmx@alibaba-inc.com | 2022-01-26 | 2023-08-08 | 7 (7%) | java (18), scala (9), proto (2), md (1), json (1) |
| 5. | chengpan@apache.org | 2022-08-13 | 2023-07-24 | 4 (4%) | scala (13), java (11), md (2), proto (1) |
| 6. | 1178404354@qq.com | 2023-02-10 | 2023-07-25 | 4 (4%) | java (3), md (1) |
| 7. | caojiaqing@bilibili.com | 2023-07-11 | 2023-08-01 | 3 (3%) | scala (5), java (1), md (1) |
| 8. | lvshuang.tb@gmail.com | 2022-10-20 | 2023-08-08 | 2 (2%) | java (5), scala (1) |
| 9. | xiyu.zk@alibaba-inc.com | 2022-09-05 | 2023-08-08 | 2 (2%) | md (2), yml (1) |
| 10. | lyh-36@163.com | 2023-05-17 | 2023-07-19 | 2 (2%) | java (16), scala (6), md (5) |
| 11. | 2213335496@qq.com | 2023-06-02 | 2023-08-03 | 2 (2%) | java (2) |
| 12. | waitinfuture@gmail.com | 2023-08-02 | 2023-08-02 | 1 (1%) | md (4), yml (1) |
| 13. | apatnam@linkedin.com | 2023-07-26 | 2023-07-26 | 1 (1%) | sh (1) |
| 14. | peter.wsj@alibaba-inc.com | 2023-07-14 | 2023-07-14 | 1 (1%) | java (1) |
A contributor dependency is detected if two contributors have changed the same files in the past 30 days.
The number on lines shows the number of same files that both persons changed in past 30 days.
| Contributor 1 | Contributor 2 | # shared files | |
|---|---|---|---|
| 1. | zky.zhoukeyong@alibaba-inc.com | chengpan@apache.org |
21 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala client/src/test/java/org/apache/celeborn/client/ShuffleClientBaseSuiteJ.java worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/HeartbeatTest.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/client/ShuffleClientSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala docs/configuration/network.md common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 2. | zky.zhoukeyong@alibaba-inc.com | angers.zhu@gmail.com |
15 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala mkdocs.yml common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala docs/configuration/worker.md client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java docs/configuration/client.md common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 3. | chengpan@apache.org | angers.zhu@gmail.com |
12 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java docs/configuration/client.md common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 4. | fengmingxiao.fmx@alibaba-inc.com | angers.zhu@gmail.com |
11 shared files
worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java docs/configuration/worker.md master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 5. | zky.zhoukeyong@alibaba-inc.com | cfmcgrady@gmail.com |
10 shared files
client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriterSuiteJ.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-spark/common/src/test/java/org/apache/spark/shuffle/celeborn/SortBasedPusherSuiteJ.java client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java client/src/main/java/org/apache/celeborn/client/write/DataPusher.java docs/README.md |
| 6. | cfmcgrady@gmail.com | angers.zhu@gmail.com |
10 shared files
service/src/main/scala/org/apache/celeborn/server/common/HttpService.scala service/src/main/scala/org/apache/celeborn/server/common/Service.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/java/org/apache/celeborn/common/network/server/TransportServer.java worker/src/test/scala/org/apache/celeborn/service/deploy/worker/storage/WorkerSuite.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java worker/src/test/scala/org/apache/celeborn/service/deploy/MiniClusterFeature.scala service/src/main/scala/org/apache/celeborn/server/common/http/HttpServer.scala |
| 7. | fengmingxiao.fmx@alibaba-inc.com | zky.zhoukeyong@alibaba-inc.com |
8 shared files
worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala docs/configuration/worker.md master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 8. | chengpan@apache.org | fengmingxiao.fmx@alibaba-inc.com |
7 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 9. | angers.zhu@gmail.com | lyh-36@163.com |
5 shared files
docs/monitoring.md client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala docs/configuration/client.md common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 10. | zky.zhoukeyong@alibaba-inc.com | lyh-36@163.com |
5 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java docs/configuration/client.md client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 11. | chengpan@apache.org | cfmcgrady@gmail.com |
4 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java |
| 12. | angers.zhu@gmail.com | caojiaqing@bilibili.com |
4 shared files
docs/configuration/worker.md client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 13. | zky.zhoukeyong@alibaba-inc.com | waitinfuture@gmail.com |
3 shared files
mkdocs.yml docs/developers/integrate.md docs/developers/workerexclusion.md |
| 14. | chengpan@apache.org | caojiaqing@bilibili.com |
3 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 15. | caojiaqing@bilibili.com | fengmingxiao.fmx@alibaba-inc.com |
3 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala docs/configuration/worker.md common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 16. | lyh-36@163.com | cfmcgrady@gmail.com |
3 shared files
common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java |
| 17. | zky.zhoukeyong@alibaba-inc.com | caojiaqing@bilibili.com |
3 shared files
docs/configuration/worker.md client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 18. | lyh-36@163.com | chengpan@apache.org |
3 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java docs/configuration/client.md common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 19. | lyh-36@163.com | caojiaqing@bilibili.com |
3 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 20. | lvshuang.tb@gmail.com | chengpan@apache.org |
2 shared files
worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala |
| 21. | lvshuang.tb@gmail.com | fengmingxiao.fmx@alibaba-inc.com |
2 shared files
worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala |
| 22. | caojiaqing@bilibili.com | cfmcgrady@gmail.com |
2 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java |
| 23. | fengmingxiao.fmx@alibaba-inc.com | lyh-36@163.com |
2 shared files
tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 24. | angers.zhu@gmail.com | waitinfuture@gmail.com |
1 shared file
mkdocs.yml |
| 25. | angers.zhu@gmail.com | xiyu.zk@alibaba-inc.com |
1 shared file
mkdocs.yml |
| 26. | zky.zhoukeyong@alibaba-inc.com | xiyu.zk@alibaba-inc.com |
1 shared file
mkdocs.yml |
| 27. | waitinfuture@gmail.com | xiyu.zk@alibaba-inc.com |
1 shared file
mkdocs.yml |
| 28. | caojiaqing@bilibili.com | lvshuang.tb@gmail.com |
1 shared file
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala |
| 29. | fengmingxiao.fmx@alibaba-inc.com | cfmcgrady@gmail.com |
1 shared file
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala |
| 30. | cfmcgrady@gmail.com | lvshuang.tb@gmail.com |
1 shared file
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala |
| 31. | lyh-36@163.com | lvshuang.tb@gmail.com |
1 shared file
worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapDataPartitionReader.java |
| 32. | cfmcgrady@gmail.com | peter.wsj@alibaba-inc.com |
1 shared file
client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java |
| 33. | peter.wsj@alibaba-inc.com | zky.zhoukeyong@alibaba-inc.com |
1 shared file
client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java |
| 34. | peter.wsj@alibaba-inc.com | angers.zhu@gmail.com |
1 shared file
client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java |
| 35. | peter.wsj@alibaba-inc.com | chengpan@apache.org |
1 shared file
client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java |
| 36. | zky.zhoukeyong@alibaba-inc.com | 1178404354@qq.com |
1 shared file
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java |
| 37. | cfmcgrady@gmail.com | 1178404354@qq.com |
1 shared file
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java |
| 38. | angers.zhu@gmail.com | 1178404354@qq.com |
1 shared file
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java |
| 39. | lyh-36@163.com | 1178404354@qq.com |
1 shared file
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java |
| 40. | chengpan@apache.org | 1178404354@qq.com |
1 shared file
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java |
| 41. | caojiaqing@bilibili.com | 1178404354@qq.com |
1 shared file
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java |
| Contributor | # connections | # commits | |
|---|---|---|---|
| 1. | zky.zhoukeyong@alibaba-inc.com | 10 | 28 |
| 2. | angers.zhu@gmail.com | 10 | 21 |
| 3. | cfmcgrady@gmail.com | 9 | 15 |
| 4. | chengpan@apache.org | 9 | 4 |
| 5. | caojiaqing@bilibili.com | 8 | 3 |
| 6. | lyh-36@163.com | 8 | 2 |
| 7. | fengmingxiao.fmx@alibaba-inc.com | 7 | 7 |
| 8. | 1178404354@qq.com | 6 | 4 |
| 9. | lvshuang.tb@gmail.com | 5 | 2 |
| 10. | peter.wsj@alibaba-inc.com | 4 | 1 |
| 11. | xiyu.zk@alibaba-inc.com | 3 | 2 |
| 12. | waitinfuture@gmail.com | 3 | 1 |
| 13. | 2213335496@qq.com | 0 | 2 |
| 14. | apatnam@linkedin.com | 0 | 1 |
C-median: 7.5
A half of the contributors has more than 7.5 connections, and a half has less than this number.
C-mean: 6.8
An average number of connections a contributor has with other contributors.
C-index: 6.0
There are 6.0 contributors with 6.0 or more connections.
24 contributors (281 commits):
| # | Contributor |
First Commit |
Latest Commit |
Commits Count |
File Updates (per extension) |
|---|---|---|---|---|---|
| 1. | angers.zhu@gmail.com | 2022-03-03 | 2023-07-27 | 77 (27%) | scala (241), java (204), md (69), proto (10), patch (5) |
| 2. | zky.zhoukeyong@alibaba-inc.com | 2021-12-28 | 2023-08-07 | 46 (16%) | java (87), scala (86), md (48), yml (9), svg (9) |
| 3. | chengpan@apache.org | 2022-08-13 | 2023-07-24 | 44 (15%) | scala (116), java (57), xml (19), md (16), sh (10) |
| 4. | cfmcgrady@gmail.com | 2023-01-05 | 2023-08-05 | 32 (11%) | java (56), scala (55), xml (10), md (8), (3) |
| 5. | lvshuang.tb@gmail.com | 2022-10-20 | 2023-08-08 | 14 (4%) | java (35), scala (11), md (1), xml (1), template (1) |
| 6. | fengmingxiao.fmx@alibaba-inc.com | 2022-01-26 | 2023-08-08 | 10 (3%) | java (27), scala (23), md (12), proto (3), png (3) |
| 7. | zhongqiang.czq@alibaba-inc.com | 2023-02-04 | 2023-07-05 | 10 (3%) | java (16), scala (13), md (5), (3), proto (2) |
| 8. | lyh-36@163.com | 2023-05-17 | 2023-07-19 | 9 (3%) | java (23), scala (21), md (7), json (1) |
| 9. | ethanfeng@apache.org | 2022-11-15 | 2023-06-13 | 8 (2%) | java (33), scala (7), md (6), patch (4), template (1) |
| 10. | 2213335496@qq.com | 2023-06-02 | 2023-08-03 | 7 (2%) | yaml (11), xml (4), java (2), scala (2), yml (1) |
| 11. | xiyu.zk@alibaba-inc.com | 2022-09-05 | 2023-08-08 | 4 (1%) | java (4), md (3), scala (3), yml (1) |
| 12. | 1178404354@qq.com | 2023-02-10 | 2023-07-25 | 4 (1%) | java (3), md (1) |
| 13. | caojiaqing@bilibili.com | 2023-07-11 | 2023-08-01 | 3 (1%) | scala (5), java (1), md (1) |
| 14. | 52876270+zwangsheng@users.noreply.github.com | 2022-07-07 | 2023-06-01 | 2 (<1%) | yaml (8), md (1) |
| 15. | sychen@ctrip.com | 2023-06-19 | 2023-06-19 | 2 (<1%) | scala (23), xml (1) |
| 16. | ckj@apache.org | 2023-01-18 | 2023-05-18 | 1 (<1%) | java (4), xml (1) |
| 17. | waitinfuture@gmail.com | 2023-08-02 | 2023-08-02 | 1 (<1%) | md (4), yml (1) |
| 18. | apatnam@linkedin.com | 2023-07-26 | 2023-07-26 | 1 (<1%) | sh (1) |
| 19. | peter.wsj@alibaba-inc.com | 2023-07-14 | 2023-07-14 | 1 (<1%) | java (1) |
| 20. | cchung100m@cs.ccu.edu.tw | 2023-06-29 | 2023-06-29 | 1 (<1%) | java (1) |
| 21. | liangdingwen.ldw@alipay.com | 2023-06-28 | 2023-06-28 | 1 (<1%) | scala (1) |
| 22. | liyihe@bigo.sg | 2023-06-02 | 2023-06-02 | 1 (<1%) | md (1) |
| 23. | ulyssesyou18@gmail.com | 2023-05-31 | 2023-05-31 | 1 (<1%) | patch (2) |
| 24. | 99078115+skytin1004@users.noreply.github.com | 2023-05-21 | 2023-05-21 | 1 (<1%) | md (1) |
A contributor dependency is detected if two contributors have changed the same files in the past 90 days.
The number on lines shows the number of same files that both persons changed in past 90 days.
| Contributor 1 | Contributor 2 | # shared files | |
|---|---|---|---|
| 1. | angers.zhu@gmail.com | chengpan@apache.org |
82 shared files
common/src/test/scala/org/apache/celeborn/common/CelebornConfSuite.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/HugeDataTest.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkUtils.java charts/celeborn/values.yaml master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java service/src/main/scala/org/apache/celeborn/server/common/HttpService.scala client/src/test/java/org/apache/celeborn/client/ShuffleClientBaseSuiteJ.java docs/celeborn_ratis_shell.md master/pom.xml client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala docs/deploy.md tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/client/ShuffleClientSuite.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitor.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RssPipelineSortSuite.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/PushDataTimeoutTest.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorterSuiteJ.java client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala docs/migration.md client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java docs/configuration/network.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RssNonPipelineSortSuite.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RssHashCheckDiskSuite.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala worker/src/test/scala/org/apache/celeborn/service/deploy/HeartbeatFeature.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RetryReviveTest.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala README.md master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java conf/celeborn-defaults.conf.template client/src/main/scala/org/apache/celeborn/client/ApplicationHeartbeater.scala common/src/test/java/org/apache/celeborn/common/haclient/RssHARetryClientSuiteJ.java docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/SparkTestBase.scala docs/configuration/ha.md worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/main/java/org/apache/celeborn/common/write/PushState.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RetryCommitFilesTest.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java master/src/main/scala/org/apache/celeborn/service/deploy/master/MasterSource.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/ObservedDevice.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkUtils.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigEntry.scala tests/kubernetes-it/docker/helm/values.yaml common/src/test/scala/org/apache/celeborn/ConfigurationSuite.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/test/scala/org/apache/celeborn/common/util/UtilsSuite.scala docs/configuration/metrics.md client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/RssShuffleWriterSuiteJ.java toolkit/reg.sh common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala worker/src/test/scala/org/apache/celeborn/service/deploy/MiniClusterFeature.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigProvider.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 2. | zky.zhoukeyong@alibaba-inc.com | angers.zhu@gmail.com |
76 shared files
common/src/test/scala/org/apache/celeborn/common/CelebornConfSuite.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java client/src/main/scala/org/apache/celeborn/client/ShuffleClientHelper.scala client/src/test/java/org/apache/celeborn/client/ShuffleClientBaseSuiteJ.java client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportResponseHandler.java tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/client/ShuffleClientSuite.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriterSuiteJ.java master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGate.java client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala docs/migration.md client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java client/src/test/java/org/apache/celeborn/client/write/DataPushQueueSuitJ.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleMaster.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java client/src/main/java/org/apache/celeborn/client/write/DataPusher.java client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala docs/configuration/network.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/java/org/apache/celeborn/common/protocol/message/StatusCode.java common/src/main/java/org/apache/celeborn/common/write/SlowStartPushStrategy.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateDelegation.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RetryReviveTest.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala client/src/main/scala/org/apache/celeborn/client/WorkerStatusTracker.scala common/src/main/java/org/apache/celeborn/common/write/SimplePushStrategy.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java docs/configuration/client.md docs/configuration/master.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteBufferStreamReader.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriterSuiteJ.java worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala mkdocs.yml client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/main/java/org/apache/celeborn/common/write/InFlightRequestTracker.java client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java client/src/main/java/org/apache/celeborn/client/write/DataPushQueue.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorRackAwareSuiteJ.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client/src/main/java/org/apache/celeborn/client/read/RssInputStream.java client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriterSuiteJ.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriterSuiteJ.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/test/scala/org/apache/celeborn/common/util/UtilsSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MasterStateMachineSuiteJ.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java docs/configuration/worker.md common/src/test/java/org/apache/celeborn/common/write/SlowStartPushStrategyTest.java client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriterSuiteJ.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 3. | angers.zhu@gmail.com | cfmcgrady@gmail.com |
63 shared files
service/src/main/scala/org/apache/celeborn/server/common/HttpService.scala client/src/test/java/org/apache/celeborn/client/ShuffleClientBaseSuiteJ.java client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala master/pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportResponseHandler.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java assets/grafana/rss-dashboard.json tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/PushDataTimeoutTest.scala docs/migration.md client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java worker/src/test/scala/org/apache/celeborn/service/deploy/worker/storage/WorkerSuite.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java client/src/main/java/org/apache/celeborn/client/write/DataPusher.java client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala docs/configuration/columnar-shuffle.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/CelebornShuffleWriterSuiteBase.java common/src/main/java/org/apache/celeborn/common/protocol/message/StatusCode.java docs/monitoring.md common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java master/src/main/scala/org/apache/celeborn/service/deploy/master/network/CelebornRackResolver.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala client/src/main/scala/org/apache/celeborn/client/WorkerStatusTracker.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriterSuiteJ.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala client/src/main/scala/org/apache/celeborn/client/CommitManager.scala METRICS.md client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/main/java/org/apache/celeborn/common/write/PushState.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java common/src/main/java/org/apache/celeborn/common/protocol/PartitionLocation.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java .gitignore client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriterSuiteJ.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala service/src/main/scala/org/apache/celeborn/server/common/Service.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/test/scala/org/apache/celeborn/common/util/UtilsSuite.scala master/src/main/java/org/apache/celeborn/service/deploy/master/SlotsAllocator.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/CelebornShuffleWriterSuiteBase.java client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala common/src/main/java/org/apache/celeborn/common/network/server/TransportServer.java worker/src/test/scala/org/apache/celeborn/service/deploy/MiniClusterFeature.scala client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriterSuiteJ.java service/src/main/scala/org/apache/celeborn/server/common/http/HttpServer.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 4. | chengpan@apache.org | zky.zhoukeyong@alibaba-inc.com |
52 shared files
client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SendBufferPool.java client-flink/flink-1.15/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java common/src/test/scala/org/apache/celeborn/common/CelebornConfSuite.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java client/src/test/java/org/apache/celeborn/client/ShuffleClientBaseSuiteJ.java client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/client/ShuffleClientSuite.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala docs/migration.md client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java docs/configuration/network.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java client-flink/flink-1.17/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RetryReviveTest.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/RssShuffleReader.scala client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/RssShuffleReader.scala worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/test/scala/org/apache/celeborn/common/util/UtilsSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/HeartbeatTest.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGateSuiteJ.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 5. | cfmcgrady@gmail.com | zky.zhoukeyong@alibaba-inc.com |
49 shared files
common/src/test/scala/org/apache/celeborn/common/util/PbSerDeUtilsTest.scala client/src/test/java/org/apache/celeborn/client/ShuffleClientBaseSuiteJ.java client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportResponseHandler.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java client-spark/common/src/test/java/org/apache/spark/shuffle/celeborn/SortBasedPusherSuiteJ.java docs/migration.md client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java client/src/main/java/org/apache/celeborn/client/write/DataPusher.java docs/README.md client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/java/org/apache/celeborn/common/protocol/message/StatusCode.java common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala client/src/main/scala/org/apache/celeborn/client/commit/MapPartitionCommitHandler.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala client/src/main/scala/org/apache/celeborn/client/WorkerStatusTracker.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriterSuiteJ.java client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriterSuiteJ.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/test/scala/org/apache/celeborn/common/util/UtilsSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGateSuiteJ.java client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriterSuiteJ.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 6. | chengpan@apache.org | cfmcgrady@gmail.com |
39 shared files
service/src/main/scala/org/apache/celeborn/server/common/HttpService.scala client/src/test/java/org/apache/celeborn/client/ShuffleClientBaseSuiteJ.java pom.xml master/pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/PushDataTimeoutTest.scala docs/migration.md client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/main/java/org/apache/celeborn/common/write/PushState.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/MemoryManager.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/test/scala/org/apache/celeborn/common/util/UtilsSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGateSuiteJ.java worker/src/test/scala/org/apache/celeborn/service/deploy/MiniClusterFeature.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 7. | fengmingxiao.fmx@alibaba-inc.com | angers.zhu@gmail.com |
36 shared files
common/src/test/scala/org/apache/celeborn/common/CelebornConfSuite.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java docs/deploy.md tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java docs/configuration/network.md worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala common/src/main/scala/org/apache/celeborn/common/util/CelebornHadoopUtils.scala assets/grafana/celeborn-dashboard.json worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala README.md master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java docs/configuration/client.md docs/configuration/master.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java METRICS.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala common/src/main/java/org/apache/celeborn/common/network/protocol/TransportMessage.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/test/scala/org/apache/celeborn/common/util/UtilsSuite.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java docs/configuration/worker.md client/src/main/java/org/apache/celeborn/client/read/DfsPartitionReader.java common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 8. | fengmingxiao.fmx@alibaba-inc.com | chengpan@apache.org |
26 shared files
common/src/test/scala/org/apache/celeborn/common/CelebornConfSuite.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java docs/deploy.md tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala docs/configuration/network.md worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala README.md master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MetaHandler.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/test/scala/org/apache/celeborn/common/util/UtilsSuite.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 9. | angers.zhu@gmail.com | lyh-36@163.com |
26 shared files
common/src/main/java/org/apache/celeborn/common/network/util/NettyUtils.java docs/celeborn_ratis_shell.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitor.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java assets/grafana/rss-dashboard.json worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/java/org/apache/celeborn/common/write/SlowStartPushStrategy.java docs/configuration/index.md docs/monitoring.md common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HARaftServer.java common/src/main/java/org/apache/celeborn/common/network/TransportContext.java client/src/main/scala/org/apache/celeborn/client/WorkerStatusTracker.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/ObservedDevice.scala common/src/main/java/org/apache/celeborn/common/client/MasterClient.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java common/src/main/java/org/apache/celeborn/common/util/ShutdownHookManager.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 10. | zky.zhoukeyong@alibaba-inc.com | fengmingxiao.fmx@alibaba-inc.com |
24 shared files
common/src/test/scala/org/apache/celeborn/common/CelebornConfSuite.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java docs/configuration/network.md worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java docs/configuration/client.md docs/configuration/master.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/test/scala/org/apache/celeborn/common/util/UtilsSuite.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java docs/configuration/worker.md common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 11. | zhongqiang.czq@alibaba-inc.com | angers.zhu@gmail.com |
24 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorterSuiteJ.java docs/migration.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala worker/src/test/scala/org/apache/celeborn/service/deploy/HeartbeatFeature.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala common/src/main/java/org/apache/celeborn/common/network/TransportContext.java README.md client/src/main/scala/org/apache/celeborn/client/ApplicationHeartbeater.scala common/src/main/java/org/apache/celeborn/common/network/util/TransportConf.java docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/WordCountTest.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/network/RequestTimeoutIntegrationSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala common/src/test/java/org/apache/celeborn/common/network/TransportClientFactorySuiteJ.java docs/configuration/worker.md worker/src/test/scala/org/apache/celeborn/service/deploy/MiniClusterFeature.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 12. | lvshuang.tb@gmail.com | angers.zhu@gmail.com |
23 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGate.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleMaster.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateDelegation.java worker/src/test/scala/org/apache/celeborn/service/deploy/HeartbeatFeature.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HARaftServer.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/CelebornBufferStream.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteBufferStreamReader.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAHelper.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/utils/FlinkUtils.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResource.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java docs/configuration/worker.md client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 13. | chengpan@apache.org | lyh-36@163.com |
22 shared files
worker/src/test/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitorSuite.scala docs/celeborn_ratis_shell.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitor.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/metrics/MetricLabels.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala common/src/main/java/org/apache/celeborn/common/network/util/NettyMemoryMetrics.java docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/ObservedDevice.scala common/src/test/scala/org/apache/celeborn/common/metrics/source/CelebornSourceSuite.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/congestcontrol/CongestionController.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 14. | chengpan@apache.org | zhongqiang.czq@alibaba-inc.com |
21 shared files
pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorterSuiteJ.java docs/migration.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala worker/src/test/scala/org/apache/celeborn/service/deploy/HeartbeatFeature.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala README.md client/src/main/scala/org/apache/celeborn/client/ApplicationHeartbeater.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/MemoryManager.java build/make-distribution.sh tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/HeartbeatTest.scala worker/src/test/scala/org/apache/celeborn/service/deploy/MiniClusterFeature.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 15. | chengpan@apache.org | lvshuang.tb@gmail.com |
18 shared files
client-flink/flink-1.15/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java client-flink/flink-1.17/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java worker/src/test/scala/org/apache/celeborn/service/deploy/HeartbeatFeature.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java charts/celeborn/templates/configmap.yaml client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 16. | zky.zhoukeyong@alibaba-inc.com | lvshuang.tb@gmail.com |
17 shared files
client-flink/flink-1.15/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGate.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleMaster.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java client-flink/flink-1.17/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateDelegation.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteBufferStreamReader.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java docs/configuration/worker.md client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 17. | ethanfeng@apache.org | angers.zhu@gmail.com |
17 shared files
common/src/main/java/org/apache/celeborn/common/network/util/NettyUtils.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleMaster.java common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HARaftServer.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java README.md docs/configuration/client.md client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/utils/FlinkUtils.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java docs/configuration/worker.md common/src/main/java/org/apache/celeborn/common/network/server/TransportServer.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 18. | lyh-36@163.com | cfmcgrady@gmail.com |
15 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java assets/grafana/rss-dashboard.json worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/test/java/org/apache/celeborn/common/protocol/PartitionLocationSuiteJ.java docs/monitoring.md client/src/main/scala/org/apache/celeborn/client/WorkerStatusTracker.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 19. | chengpan@apache.org | sychen@ctrip.com |
14 shared files
pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/MasterArguments.scala client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/RssShuffleReader.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigEntry.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/util/FunctionConverter.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala |
| 20. | zhongqiang.czq@alibaba-inc.com | zky.zhoukeyong@alibaba-inc.com |
14 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java docs/migration.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/HeartbeatTest.scala docs/configuration/worker.md common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 21. | lyh-36@163.com | zky.zhoukeyong@alibaba-inc.com |
14 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/java/org/apache/celeborn/common/write/SlowStartPushStrategy.java client/src/main/scala/org/apache/celeborn/client/WorkerStatusTracker.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 22. | sychen@ctrip.com | angers.zhu@gmail.com |
13 shared files
client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigBuilder.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/WordCountTest.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigEntry.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala |
| 23. | cfmcgrady@gmail.com | zhongqiang.czq@alibaba-inc.com |
13 shared files
pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java docs/migration.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/MemoryManager.java common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala worker/src/test/scala/org/apache/celeborn/service/deploy/MiniClusterFeature.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 24. | ethanfeng@apache.org | zky.zhoukeyong@alibaba-inc.com |
13 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleMaster.java common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java docs/configuration/client.md client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java docs/configuration/worker.md client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 25. | ethanfeng@apache.org | chengpan@apache.org |
13 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java common/src/main/java/org/apache/celeborn/common/network/util/NettyMemoryMetrics.java README.md docs/configuration/client.md client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/MemoryManager.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 26. | ethanfeng@apache.org | cfmcgrady@gmail.com |
13 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java docs/configuration/client.md client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/MemoryManager.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java common/src/main/java/org/apache/celeborn/common/network/server/TransportServer.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 27. | fengmingxiao.fmx@alibaba-inc.com | cfmcgrady@gmail.com |
13 shared files
master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala METRICS.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala common/src/test/scala/org/apache/celeborn/common/util/UtilsSuite.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 28. | zhongqiang.czq@alibaba-inc.com | fengmingxiao.fmx@alibaba-inc.com |
12 shared files
common/src/main/java/org/apache/celeborn/common/meta/FileInfo.java tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala README.md docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java common/src/main/java/org/apache/celeborn/common/network/protocol/Message.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala docs/configuration/worker.md common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 29. | sychen@ctrip.com | zky.zhoukeyong@alibaba-inc.com |
11 shared files
client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/RssShuffleReader.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala |
| 30. | lvshuang.tb@gmail.com | zhongqiang.czq@alibaba-inc.com |
11 shared files
pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala worker/src/test/scala/org/apache/celeborn/service/deploy/HeartbeatFeature.scala common/src/main/java/org/apache/celeborn/common/network/protocol/Heartbeat.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala common/src/main/java/org/apache/celeborn/common/network/util/TransportFrameDecoder.java docs/configuration/worker.md common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 31. | fengmingxiao.fmx@alibaba-inc.com | lvshuang.tb@gmail.com |
11 shared files
tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java docs/configuration/worker.md client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 32. | ethanfeng@apache.org | lyh-36@163.com |
10 shared files
common/src/main/java/org/apache/celeborn/common/network/util/NettyUtils.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HARaftServer.java common/src/main/java/org/apache/celeborn/common/network/util/NettyMemoryMetrics.java docs/configuration/client.md client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 33. | sychen@ctrip.com | cfmcgrady@gmail.com |
9 shared files
client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala pom.xml client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala common/src/main/scala/org/apache/celeborn/common/meta/ShufflePartitionLocationInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala |
| 34. | zhongqiang.czq@alibaba-inc.com | lyh-36@163.com |
9 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/java/org/apache/celeborn/common/network/TransportContext.java docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java common/src/main/java/org/apache/celeborn/common/network/server/TransportChannelHandler.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 35. | cfmcgrady@gmail.com | lvshuang.tb@gmail.com |
7 shared files
pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 36. | lvshuang.tb@gmail.com | lyh-36@163.com |
7 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/buffer/SortBuffer.java tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapDataPartitionReader.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HARaftServer.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 37. | zhongqiang.czq@alibaba-inc.com | ethanfeng@apache.org |
7 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala README.md docs/configuration/client.md worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/MemoryManager.java docs/configuration/worker.md common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 38. | lvshuang.tb@gmail.com | ethanfeng@apache.org |
7 shared files
client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleMaster.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HARaftServer.java conf/log4j2.xml.template client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/utils/FlinkUtils.java docs/configuration/worker.md client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 39. | angers.zhu@gmail.com | xiyu.zk@alibaba-inc.com |
6 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java docs/configuration/client.md mkdocs.yml client/src/main/java/org/apache/celeborn/client/read/RssInputStream.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 40. | zky.zhoukeyong@alibaba-inc.com | xiyu.zk@alibaba-inc.com |
6 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java docs/configuration/client.md mkdocs.yml client/src/main/java/org/apache/celeborn/client/read/RssInputStream.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 41. | sychen@ctrip.com | fengmingxiao.fmx@alibaba-inc.com |
6 shared files
common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala |
| 42. | ethanfeng@apache.org | fengmingxiao.fmx@alibaba-inc.com |
6 shared files
common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala README.md docs/configuration/client.md docs/configuration/worker.md client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 43. | sychen@ctrip.com | zhongqiang.czq@alibaba-inc.com |
5 shared files
pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/WordCountTest.scala |
| 44. | fengmingxiao.fmx@alibaba-inc.com | lyh-36@163.com |
5 shared files
tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 45. | angers.zhu@gmail.com | caojiaqing@bilibili.com |
5 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala docs/configuration/worker.md common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 46. | chengpan@apache.org | caojiaqing@bilibili.com |
5 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 47. | cfmcgrady@gmail.com | caojiaqing@bilibili.com |
5 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 48. | 52876270+zwangsheng@users.noreply.github.com | 2213335496@qq.com |
4 shared files
charts/celeborn/values.yaml charts/celeborn/templates/master-statefulset.yaml charts/celeborn/templates/configmap.yaml charts/celeborn/templates/worker-statefulset.yaml |
| 49. | 2213335496@qq.com | chengpan@apache.org |
4 shared files
charts/celeborn/values.yaml pom.xml charts/celeborn/templates/configmap.yaml tests/kubernetes-it/docker/helm/values.yaml |
| 50. | zhongqiang.czq@alibaba-inc.com | caojiaqing@bilibili.com |
4 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala docs/configuration/worker.md common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 51. | lyh-36@163.com | caojiaqing@bilibili.com |
4 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 52. | zky.zhoukeyong@alibaba-inc.com | caojiaqing@bilibili.com |
4 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala docs/configuration/worker.md common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 53. | chengpan@apache.org | xiyu.zk@alibaba-inc.com |
4 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java docs/configuration/client.md common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 54. | cfmcgrady@gmail.com | xiyu.zk@alibaba-inc.com |
4 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java docs/configuration/client.md common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 55. | 52876270+zwangsheng@users.noreply.github.com | chengpan@apache.org |
3 shared files
charts/celeborn/values.yaml charts/celeborn/templates/configmap.yaml docs/deploy_on_k8s.md |
| 56. | 2213335496@qq.com | angers.zhu@gmail.com |
3 shared files
charts/celeborn/values.yaml tests/kubernetes-it/docker/helm/values.yaml master/src/main/java/org/apache/celeborn/service/deploy/master/SlotsAllocator.java |
| 57. | sychen@ctrip.com | lvshuang.tb@gmail.com |
3 shared files
pom.xml master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala |
| 58. | zhongqiang.czq@alibaba-inc.com | xiyu.zk@alibaba-inc.com |
3 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java docs/configuration/client.md common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 59. | ethanfeng@apache.org | xiyu.zk@alibaba-inc.com |
3 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java docs/configuration/client.md common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 60. | ethanfeng@apache.org | caojiaqing@bilibili.com |
3 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java docs/configuration/worker.md common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 61. | lyh-36@163.com | xiyu.zk@alibaba-inc.com |
3 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java docs/configuration/client.md common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 62. | sychen@ctrip.com | lyh-36@163.com |
3 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala |
| 63. | zky.zhoukeyong@alibaba-inc.com | waitinfuture@gmail.com |
3 shared files
mkdocs.yml docs/developers/workerexclusion.md docs/developers/integrate.md |
| 64. | caojiaqing@bilibili.com | fengmingxiao.fmx@alibaba-inc.com |
3 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala docs/configuration/worker.md common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 65. | caojiaqing@bilibili.com | lvshuang.tb@gmail.com |
3 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala docs/configuration/worker.md common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 66. | cfmcgrady@gmail.com | 2213335496@qq.com |
2 shared files
pom.xml master/src/main/java/org/apache/celeborn/service/deploy/master/SlotsAllocator.java |
| 67. | 2213335496@qq.com | lvshuang.tb@gmail.com |
2 shared files
pom.xml charts/celeborn/templates/configmap.yaml |
| 68. | lvshuang.tb@gmail.com | ckj@apache.org |
2 shared files
pom.xml master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAHelper.java |
| 69. | zhongqiang.czq@alibaba-inc.com | 1178404354@qq.com |
2 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java README.md |
| 70. | angers.zhu@gmail.com | 1178404354@qq.com |
2 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java README.md |
| 71. | ethanfeng@apache.org | 1178404354@qq.com |
2 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java README.md |
| 72. | zky.zhoukeyong@alibaba-inc.com | 1178404354@qq.com |
2 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client/src/main/java/org/apache/celeborn/client/ReviveManager.java |
| 73. | chengpan@apache.org | 1178404354@qq.com |
2 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java README.md |
| 74. | xiyu.zk@alibaba-inc.com | caojiaqing@bilibili.com |
2 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 75. | ethanfeng@apache.org | sychen@ctrip.com |
2 shared files
common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala |
| 76. | fengmingxiao.fmx@alibaba-inc.com | xiyu.zk@alibaba-inc.com |
2 shared files
docs/configuration/client.md common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 77. | ckj@apache.org | angers.zhu@gmail.com |
2 shared files
master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAHelper.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MasterStateMachineSuiteJ.java |
| 78. | 52876270+zwangsheng@users.noreply.github.com | angers.zhu@gmail.com |
1 shared file
charts/celeborn/values.yaml |
| 79. | lyh-36@163.com | liyihe@bigo.sg |
1 shared file
docs/celeborn_ratis_shell.md |
| 80. | chengpan@apache.org | liyihe@bigo.sg |
1 shared file
docs/celeborn_ratis_shell.md |
| 81. | angers.zhu@gmail.com | liyihe@bigo.sg |
1 shared file
docs/celeborn_ratis_shell.md |
| 82. | cfmcgrady@gmail.com | ckj@apache.org |
1 shared file
pom.xml |
| 83. | chengpan@apache.org | ckj@apache.org |
1 shared file
pom.xml |
| 84. | sychen@ctrip.com | 2213335496@qq.com |
1 shared file
pom.xml |
| 85. | sychen@ctrip.com | ckj@apache.org |
1 shared file
pom.xml |
| 86. | 2213335496@qq.com | zhongqiang.czq@alibaba-inc.com |
1 shared file
pom.xml |
| 87. | 2213335496@qq.com | ckj@apache.org |
1 shared file
pom.xml |
| 88. | zhongqiang.czq@alibaba-inc.com | ckj@apache.org |
1 shared file
pom.xml |
| 89. | lyh-36@163.com | 1178404354@qq.com |
1 shared file
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java |
| 90. | cfmcgrady@gmail.com | 1178404354@qq.com |
1 shared file
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java |
| 91. | xiyu.zk@alibaba-inc.com | 1178404354@qq.com |
1 shared file
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java |
| 92. | caojiaqing@bilibili.com | 1178404354@qq.com |
1 shared file
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java |
| 93. | sychen@ctrip.com | caojiaqing@bilibili.com |
1 shared file
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala |
| 94. | 1178404354@qq.com | fengmingxiao.fmx@alibaba-inc.com |
1 shared file
README.md |
| 95. | 1178404354@qq.com | 99078115+skytin1004@users.noreply.github.com |
1 shared file
README.md |
| 96. | fengmingxiao.fmx@alibaba-inc.com | 99078115+skytin1004@users.noreply.github.com |
1 shared file
README.md |
| 97. | zhongqiang.czq@alibaba-inc.com | 99078115+skytin1004@users.noreply.github.com |
1 shared file
README.md |
| 98. | angers.zhu@gmail.com | 99078115+skytin1004@users.noreply.github.com |
1 shared file
README.md |
| 99. | chengpan@apache.org | 99078115+skytin1004@users.noreply.github.com |
1 shared file
README.md |
| 100. | ethanfeng@apache.org | 99078115+skytin1004@users.noreply.github.com |
1 shared file
README.md |
| Contributor | # connections | # commits | |
|---|---|---|---|
| 1. | angers.zhu@gmail.com | 20 | 77 |
| 2. | chengpan@apache.org | 20 | 44 |
| 3. | zky.zhoukeyong@alibaba-inc.com | 17 | 46 |
| 4. | cfmcgrady@gmail.com | 16 | 32 |
| 5. | zhongqiang.czq@alibaba-inc.com | 16 | 10 |
| 6. | lyh-36@163.com | 16 | 9 |
| 7. | lvshuang.tb@gmail.com | 14 | 14 |
| 8. | fengmingxiao.fmx@alibaba-inc.com | 14 | 10 |
| 9. | ethanfeng@apache.org | 14 | 8 |
| 10. | sychen@ctrip.com | 13 | 2 |
| 11. | xiyu.zk@alibaba-inc.com | 12 | 4 |
| 12. | caojiaqing@bilibili.com | 12 | 3 |
| 13. | 1178404354@qq.com | 11 | 4 |
| 14. | ckj@apache.org | 9 | 1 |
| 15. | 2213335496@qq.com | 8 | 7 |
| 16. | liangdingwen.ldw@alipay.com | 6 | 1 |
| 17. | 99078115+skytin1004@users.noreply.github.com | 6 | 1 |
| 18. | 52876270+zwangsheng@users.noreply.github.com | 4 | 2 |
| 19. | peter.wsj@alibaba-inc.com | 4 | 1 |
| 20. | cchung100m@cs.ccu.edu.tw | 4 | 1 |
| 21. | waitinfuture@gmail.com | 3 | 1 |
| 22. | liyihe@bigo.sg | 3 | 1 |
| 23. | apatnam@linkedin.com | 2 | 1 |
| 24. | ulyssesyou18@gmail.com | 0 | 1 |
C-median: 12.0
A half of the contributors has more than 12.0 connections, and a half has less than this number.
C-mean: 10.6
An average number of connections a contributor has with other contributors.
C-index: 11.0
There are 11.0 contributors with 11.0 or more connections.
38 contributors (514 commits):
| # | Contributor |
First Commit |
Latest Commit |
Commits Count |
|---|---|---|---|---|
| 1. | angers.zhu@gmail.com | 2022-03-03 | 2023-07-27 | 144 (28%) |
| 2. | ethanfeng@apache.org | 2022-11-15 | 2023-06-13 | 62 (12%) |
| 3. | chengpan@apache.org | 2022-08-13 | 2023-07-24 | 48 (9%) |
| 4. | lvshuang.tb@gmail.com | 2022-10-20 | 2023-08-08 | 48 (9%) |
| 5. | zky.zhoukeyong@alibaba-inc.com | 2021-12-28 | 2023-08-07 | 46 (8%) |
| 6. | cfmcgrady@gmail.com | 2023-01-05 | 2023-08-05 | 34 (6%) |
| 7. | zhongqiang.czq@alibaba-inc.com | 2023-02-04 | 2023-07-05 | 26 (5%) |
| 8. | zhouky@apache.org | 2022-11-26 | 2023-04-07 | 22 (4%) |
| 9. | 1178404354@qq.com | 2023-02-10 | 2023-07-25 | 11 (2%) |
| 10. | fengmingxiao.fmx@alibaba-inc.com | 2022-01-26 | 2023-08-08 | 10 (1%) |
| 11. | lyh-36@163.com | 2023-05-17 | 2023-07-19 | 9 (1%) |
| 12. | 2213335496@qq.com | 2023-06-02 | 2023-08-03 | 7 (1%) |
| 13. | 52876270+zwangsheng@users.noreply.github.com | 2022-07-07 | 2023-06-01 | 6 (1%) |
| 14. | xiyu.zk@alibaba-inc.com | 2022-09-05 | 2023-08-08 | 6 (1%) |
| 15. | anh131@126.com | 2022-12-01 | 2023-04-14 | 4 (<1%) |
| 16. | caojiaqing@bilibili.com | 2023-07-11 | 2023-08-01 | 3 (<1%) |
| 17. | fwang12@ebay.com | 2023-03-26 | 2023-03-27 | 3 (<1%) |
| 18. | ckj@apache.org | 2023-01-18 | 2023-05-18 | 2 (<1%) |
| 19. | sychen@ctrip.com | 2023-06-19 | 2023-06-19 | 2 (<1%) |
| 20. | cxzl25@users.noreply.github.com | 2023-03-24 | 2023-04-14 | 2 (<1%) |
| 21. | 86960423+every-breaking-wave@users.noreply.github.com | 2023-03-11 | 2023-03-13 | 2 (<1%) |
| 22. | 52647492+xunxunmimi5577@users.noreply.github.com | 2022-09-18 | 2023-04-03 | 1 (<1%) |
| 23. | 55676558+liugs0213@users.noreply.github.com | 2022-08-22 | 2023-02-27 | 1 (<1%) |
| 24. | waitinfuture@gmail.com | 2023-08-02 | 2023-08-02 | 1 (<1%) |
| 25. | apatnam@linkedin.com | 2023-07-26 | 2023-07-26 | 1 (<1%) |
| 26. | peter.wsj@alibaba-inc.com | 2023-07-14 | 2023-07-14 | 1 (<1%) |
| 27. | cchung100m@cs.ccu.edu.tw | 2023-06-29 | 2023-06-29 | 1 (<1%) |
| 28. | liangdingwen.ldw@alipay.com | 2023-06-28 | 2023-06-28 | 1 (<1%) |
| 29. | liyihe@bigo.sg | 2023-06-02 | 2023-06-02 | 1 (<1%) |
| 30. | ulyssesyou18@gmail.com | 2023-05-31 | 2023-05-31 | 1 (<1%) |
| 31. | 99078115+skytin1004@users.noreply.github.com | 2023-05-21 | 2023-05-21 | 1 (<1%) |
| 32. | wangweirao16@gmail.com | 2023-04-28 | 2023-04-28 | 1 (<1%) |
| 33. | akpatnam25@gmail.com | 2023-03-30 | 2023-03-30 | 1 (<1%) |
| 34. | 89496918+cvedetect@users.noreply.github.com | 2023-03-27 | 2023-03-27 | 1 (<1%) |
| 35. | turbofei@foxmail.com | 2023-03-25 | 2023-03-25 | 1 (<1%) |
| 36. | lmlianne@outlook.com | 2023-03-23 | 2023-03-23 | 1 (<1%) |
| 37. | tcodehuber@gmail.com | 2023-03-18 | 2023-03-18 | 1 (<1%) |
| 38. | jn_hdd@163.com | 2023-03-17 | 2023-03-17 | 1 (<1%) |
A contributor dependency is detected if two contributors have changed the same files in the past 180 days.
The number on lines shows the number of same files that both persons changed in past 180 days.
| Contributor 1 | Contributor 2 | # shared files | |
|---|---|---|---|
| 1. | angers.zhu@gmail.com | chengpan@apache.org |
97 shared files
common/src/test/scala/org/apache/celeborn/common/CelebornConfSuite.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/HugeDataTest.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkUtils.java charts/celeborn/values.yaml master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java service/src/main/scala/org/apache/celeborn/server/common/HttpService.scala client/src/test/java/org/apache/celeborn/client/ShuffleClientBaseSuiteJ.java sbin/restart-worker.sh docs/celeborn_ratis_shell.md pom.xml master/pom.xml client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala docs/deploy.md tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/client/ShuffleClientSuite.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitor.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RssPipelineSortSuite.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/metrics/MetricLabels.scala common/src/main/scala/org/apache/celeborn/common/rpc/netty/NettyRpcEnv.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/PushDataTimeoutTest.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorterSuiteJ.java client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala docs/migration.md client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java docs/configuration/network.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java bin/celeborn-class docs/monitoring.md tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RssNonPipelineSortSuite.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RssHashCheckDiskSuite.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala worker/src/test/scala/org/apache/celeborn/service/deploy/HeartbeatFeature.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/ChannelsLimiter.java bin/celeborn-ratis client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RetryReviveTest.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala README.md master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MetaHandler.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java conf/celeborn-defaults.conf.template client/src/main/scala/org/apache/celeborn/client/ApplicationHeartbeater.scala common/src/test/java/org/apache/celeborn/common/haclient/RssHARetryClientSuiteJ.java docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/SparkTestBase.scala docs/configuration/ha.md sbin/start-master.sh worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala mkdocs.yml common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/main/java/org/apache/celeborn/common/write/PushState.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RetryCommitFilesTest.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java master/src/main/scala/org/apache/celeborn/service/deploy/master/MasterSource.scala sbin/start-worker.sh client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/ObservedDevice.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/MemoryManager.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkUtils.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigEntry.scala tests/kubernetes-it/docker/helm/values.yaml common/src/test/scala/org/apache/celeborn/ConfigurationSuite.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/test/scala/org/apache/celeborn/common/util/UtilsSuite.scala docs/configuration/metrics.md client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/RssShuffleWriterSuiteJ.java toolkit/reg.sh common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala worker/src/test/scala/org/apache/celeborn/service/deploy/MiniClusterFeature.scala docs/upgrade.md client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigProvider.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 2. | zky.zhoukeyong@alibaba-inc.com | angers.zhu@gmail.com |
76 shared files
common/src/test/scala/org/apache/celeborn/common/CelebornConfSuite.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java client/src/main/scala/org/apache/celeborn/client/ShuffleClientHelper.scala client/src/test/java/org/apache/celeborn/client/ShuffleClientBaseSuiteJ.java client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportResponseHandler.java tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/client/ShuffleClientSuite.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriterSuiteJ.java master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGate.java client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala docs/migration.md client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java client/src/test/java/org/apache/celeborn/client/write/DataPushQueueSuitJ.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleMaster.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java client/src/main/java/org/apache/celeborn/client/write/DataPusher.java client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala docs/configuration/network.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/java/org/apache/celeborn/common/protocol/message/StatusCode.java common/src/main/java/org/apache/celeborn/common/write/SlowStartPushStrategy.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateDelegation.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RetryReviveTest.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala client/src/main/scala/org/apache/celeborn/client/WorkerStatusTracker.scala common/src/main/java/org/apache/celeborn/common/write/SimplePushStrategy.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java docs/configuration/client.md docs/configuration/master.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteBufferStreamReader.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriterSuiteJ.java worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala mkdocs.yml client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/main/java/org/apache/celeborn/common/write/InFlightRequestTracker.java client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java client/src/main/java/org/apache/celeborn/client/write/DataPushQueue.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorRackAwareSuiteJ.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client/src/main/java/org/apache/celeborn/client/read/RssInputStream.java client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriterSuiteJ.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriterSuiteJ.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/test/scala/org/apache/celeborn/common/util/UtilsSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MasterStateMachineSuiteJ.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java docs/configuration/worker.md common/src/test/java/org/apache/celeborn/common/write/SlowStartPushStrategyTest.java client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriterSuiteJ.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 3. | angers.zhu@gmail.com | cfmcgrady@gmail.com |
69 shared files
service/src/main/scala/org/apache/celeborn/server/common/HttpService.scala client/src/test/java/org/apache/celeborn/client/ShuffleClientBaseSuiteJ.java client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala pom.xml master/pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportResponseHandler.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java assets/grafana/rss-dashboard.json tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/PushDataTimeoutTest.scala docs/migration.md client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java worker/src/test/scala/org/apache/celeborn/service/deploy/worker/storage/WorkerSuite.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java client/src/main/java/org/apache/celeborn/client/write/DataPusher.java common/src/main/scala/org/apache/celeborn/common/meta/WorkerPartitionLocationInfo.scala client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala docs/configuration/columnar-shuffle.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/CelebornShuffleWriterSuiteBase.java common/src/main/java/org/apache/celeborn/common/protocol/message/StatusCode.java docs/monitoring.md common/src/test/scala/org/apache/celeborn/common/meta/WorkerPartitionLocationInfoSuite.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java master/src/main/scala/org/apache/celeborn/service/deploy/master/network/CelebornRackResolver.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala client/src/main/scala/org/apache/celeborn/client/WorkerStatusTracker.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/meta/ShufflePartitionLocationInfo.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala client/src/main/scala/org/apache/celeborn/client/CommitManager.scala METRICS.md client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/main/java/org/apache/celeborn/common/write/PushState.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java common/src/main/java/org/apache/celeborn/common/protocol/PartitionLocation.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java .gitignore worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/MemoryManager.java client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriterSuiteJ.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala service/src/main/scala/org/apache/celeborn/server/common/Service.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/test/scala/org/apache/celeborn/common/util/UtilsSuite.scala master/src/main/java/org/apache/celeborn/service/deploy/master/SlotsAllocator.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/CelebornShuffleWriterSuiteBase.java client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala common/src/main/java/org/apache/celeborn/common/network/server/TransportServer.java worker/src/test/scala/org/apache/celeborn/service/deploy/MiniClusterFeature.scala client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriterSuiteJ.java service/src/main/scala/org/apache/celeborn/server/common/http/HttpServer.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 4. | angers.zhu@gmail.com | zhouky@apache.org |
60 shared files
tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/HugeDataTest.scala service/src/main/scala/org/apache/celeborn/server/common/HttpService.scala pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RssPipelineSortSuite.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriterSuiteJ.java master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java assets/grafana/rss-dashboard.json tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/PushDataTimeoutTest.scala client/src/test/java/org/apache/celeborn/client/write/DataPushQueueSuitJ.java client/src/main/java/org/apache/celeborn/client/write/DataPusher.java common/src/main/scala/org/apache/celeborn/common/meta/WorkerPartitionLocationInfo.scala client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/SkewJoinSuite.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RssNonPipelineSortSuite.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RssHashCheckDiskSuite.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RetryReviveTest.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigBuilder.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java docs/configuration/client.md docs/configuration/master.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/SparkTestBase.scala common/src/main/scala/org/apache/celeborn/common/meta/ShufflePartitionLocationInfo.scala client/src/main/scala/org/apache/celeborn/client/CommitManager.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/main/java/org/apache/celeborn/common/write/InFlightRequestTracker.java common/src/main/java/org/apache/celeborn/common/write/PushState.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala client/src/main/java/org/apache/celeborn/client/write/DataPushQueue.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RetryCommitFilesTest.scala client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/RssShuffleWriterSuiteJ.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/ShuffleFallbackSuite.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala common/src/test/java/org/apache/celeborn/common/network/TransportClientFactorySuiteJ.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java master/src/main/java/org/apache/celeborn/service/deploy/master/SlotsAllocator.java common/src/main/java/org/apache/celeborn/common/network/server/memory/MemoryManager.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MasterStateMachineSuiteJ.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java docs/configuration/worker.md client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/RssShuffleWriterSuiteJ.java client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala common/src/main/java/org/apache/celeborn/common/network/server/TransportServer.java common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 5. | chengpan@apache.org | zky.zhoukeyong@alibaba-inc.com |
54 shared files
client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SendBufferPool.java client-flink/flink-1.15/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java common/src/test/scala/org/apache/celeborn/common/CelebornConfSuite.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java client/src/test/java/org/apache/celeborn/client/ShuffleClientBaseSuiteJ.java client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/client/ShuffleClientSuite.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala docs/migration.md client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java docs/README.md docs/configuration/network.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java client-flink/flink-1.17/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RetryReviveTest.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/RssShuffleReader.scala client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/RssShuffleReader.scala worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala mkdocs.yml client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/test/scala/org/apache/celeborn/common/util/UtilsSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/HeartbeatTest.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGateSuiteJ.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 6. | lvshuang.tb@gmail.com | ethanfeng@apache.org |
54 shared files
client-flink/flink-1.15/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java common/src/main/java/org/apache/celeborn/common/network/protocol/TransportableError.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/buffer/SortBuffer.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapDataPartitionReader.java client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGate.java client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleMasterTest.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleMaster.java common/src/main/java/org/apache/celeborn/common/network/server/memory/BufferRecycler.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/FlinkTransportClientFactory.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java client-flink/flink-1.17/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateDelegation.java client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteBufferStreamReader.java common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HARaftServer.java client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGate.java client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionDelegation.java conf/log4j2.xml.template client-flink/flink-1.17/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartition.java docs/configuration/client.md worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapDataPartition.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteBufferStreamReader.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/RssBufferStream.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/utils/FlinkUtils.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client-flink/flink-1.15/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartition.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala common/src/main/java/org/apache/celeborn/common/network/server/memory/ReadBufferDispatcher.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/ReadClientHandler.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/TransportFrameDecoderWithBufferSupplier.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResource.java common/src/main/java/org/apache/celeborn/common/network/server/MapDataPartitionReader.java docs/configuration/worker.md client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleDescriptor.java common/src/main/java/org/apache/celeborn/common/network/server/DataPartitionReader.java common/src/main/java/org/apache/celeborn/common/network/server/BufferStreamManager.java common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartition.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 7. | ethanfeng@apache.org | angers.zhu@gmail.com |
54 shared files
master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java common/src/main/java/org/apache/celeborn/common/network/util/NettyUtils.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala docs/deploy.md client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriterSuiteJ.java assets/grafana/rss-dashboard.json client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGate.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorterSuiteJ.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleMaster.java docs/configuration/network.md worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateDelegation.java docs/monitoring.md common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HARaftServer.java sbin/start-all.sh worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/ChannelsLimiter.java client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala common/src/main/java/org/apache/celeborn/common/network/TransportContext.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java README.md common/src/main/java/org/apache/celeborn/common/network/util/TransportConf.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/CreditStreamManagerSuiteJ.java docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteBufferStreamReader.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/utils/FlinkUtils.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/MemoryManager.java tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/WordCountTest.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/network/RequestTimeoutIntegrationSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala common/src/test/java/org/apache/celeborn/common/network/TransportClientFactorySuiteJ.java common/src/main/java/org/apache/celeborn/common/network/server/memory/MemoryManager.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResource.java docs/configuration/worker.md common/src/main/java/org/apache/celeborn/common/network/server/TransportServer.java common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/ChunkFetchIntegrationSuiteJ.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 8. | cfmcgrady@gmail.com | zky.zhoukeyong@alibaba-inc.com |
49 shared files
common/src/test/scala/org/apache/celeborn/common/util/PbSerDeUtilsTest.scala client/src/test/java/org/apache/celeborn/client/ShuffleClientBaseSuiteJ.java client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportResponseHandler.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java client-spark/common/src/test/java/org/apache/spark/shuffle/celeborn/SortBasedPusherSuiteJ.java docs/migration.md client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java client/src/main/java/org/apache/celeborn/client/write/DataPusher.java docs/README.md client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/java/org/apache/celeborn/common/protocol/message/StatusCode.java common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala client/src/main/scala/org/apache/celeborn/client/commit/MapPartitionCommitHandler.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala client/src/main/scala/org/apache/celeborn/client/WorkerStatusTracker.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriterSuiteJ.java client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriterSuiteJ.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/test/scala/org/apache/celeborn/common/util/UtilsSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGateSuiteJ.java client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriterSuiteJ.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 9. | angers.zhu@gmail.com | lvshuang.tb@gmail.com |
49 shared files
master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/client/ShuffleClientSuite.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGate.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleMaster.java client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateDelegation.java client/src/test/scala/org/apache/celeborn/client/WorkerStatusTrackerSuite.scala worker/src/test/scala/org/apache/celeborn/service/deploy/HeartbeatFeature.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HARaftServer.java client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/CelebornBufferStream.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala client/src/main/scala/org/apache/celeborn/client/WorkerStatusTracker.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java client/src/main/scala/org/apache/celeborn/client/ApplicationHeartbeater.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteBufferStreamReader.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAHelper.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java common/src/main/scala/org/apache/celeborn/common/meta/ShufflePartitionLocationInfo.scala client/src/main/scala/org/apache/celeborn/client/CommitManager.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/utils/FlinkUtils.java common/src/main/java/org/apache/celeborn/common/protocol/PartitionLocation.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java common/src/main/java/org/apache/celeborn/common/util/ExceptionUtils.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResource.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java docs/configuration/worker.md client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 10. | chengpan@apache.org | ethanfeng@apache.org |
47 shared files
client-flink/flink-1.15/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java client-flink/flink-1.17/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleServiceFactorySuitJ.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala docs/deploy.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorterSuiteJ.java client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleServiceFactorySuitJ.java docs/configuration/network.md tests/flink-it/pom.xml worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java client-flink/flink-1.17/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java docs/monitoring.md common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/ChannelsLimiter.java client-flink/flink-1.17/pom.xml client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java common/src/main/java/org/apache/celeborn/common/network/util/NettyMemoryMetrics.java README.md docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java common/src/main/java/org/apache/celeborn/common/util/JavaUtils.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/MemoryManager.java client-flink/flink-1.15/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleServiceFactorySuitJ.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGateSuiteJ.java .github/workflows/maven.yml common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client-flink/flink-1.15/pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/congestcontrol/CongestionController.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 11. | chengpan@apache.org | zhouky@apache.org |
45 shared files
worker/src/test/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitorSuite.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/HugeDataTest.scala service/src/main/scala/org/apache/celeborn/server/common/HttpService.scala pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RssHashSuite.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RssPipelineSortSuite.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/PushDataTimeoutTest.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RssNonPipelineSortSuite.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RssHashCheckDiskSuite.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RetryReviveTest.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/SparkTestBase.scala common/src/main/java/org/apache/celeborn/common/util/JavaUtils.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/main/java/org/apache/celeborn/common/write/PushState.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RetryCommitFilesTest.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java .rat-excludes worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/java/org/apache/celeborn/common/meta/FileManagedBuffers.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java .github/workflows/maven.yml client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/RssShuffleWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 12. | zhongqiang.czq@alibaba-inc.com | angers.zhu@gmail.com |
43 shared files
sbin/celeborn-daemon.sh pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriterSuiteJ.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorterSuiteJ.java docs/migration.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala worker/src/test/scala/org/apache/celeborn/service/deploy/HeartbeatFeature.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala common/src/main/java/org/apache/celeborn/common/network/TransportContext.java README.md conf/celeborn-defaults.conf.template client/src/main/scala/org/apache/celeborn/client/ApplicationHeartbeater.scala common/src/main/java/org/apache/celeborn/common/network/util/TransportConf.java docs/configuration/client.md docs/configuration/master.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java sbin/start-master.sh worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java sbin/start-worker.sh master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/MemoryManager.java tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/WordCountTest.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/network/RequestTimeoutIntegrationSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java common/src/test/java/org/apache/celeborn/common/network/TransportClientFactorySuiteJ.java docs/configuration/metrics.md docs/configuration/worker.md client/src/test/java/org/apache/celeborn/client/ShuffleClientImplSuiteJ.java NOTICE-binary worker/src/test/scala/org/apache/celeborn/service/deploy/MiniClusterFeature.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 13. | chengpan@apache.org | cfmcgrady@gmail.com |
42 shared files
service/src/main/scala/org/apache/celeborn/server/common/HttpService.scala client/src/test/java/org/apache/celeborn/client/ShuffleClientBaseSuiteJ.java pom.xml master/pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/PushDataTimeoutTest.scala docs/migration.md client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java docs/README.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala docs/monitoring.md common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/main/java/org/apache/celeborn/common/write/PushState.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/MemoryManager.java .rat-excludes client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/test/scala/org/apache/celeborn/common/util/UtilsSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGateSuiteJ.java worker/src/test/scala/org/apache/celeborn/service/deploy/MiniClusterFeature.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 14. | zky.zhoukeyong@alibaba-inc.com | zhouky@apache.org |
41 shared files
common/src/test/scala/org/apache/celeborn/common/util/PbSerDeUtilsTest.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriterSuiteJ.java master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java client/src/test/java/org/apache/celeborn/client/write/DataPushQueueSuitJ.java client/src/main/java/org/apache/celeborn/client/write/DataPusher.java client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java client/src/main/scala/org/apache/celeborn/client/commit/MapPartitionCommitHandler.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RetryReviveTest.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java docs/configuration/client.md docs/configuration/master.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/main/java/org/apache/celeborn/common/write/InFlightRequestTracker.java client/src/main/java/org/apache/celeborn/client/write/DataPushQueue.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MasterStateMachineSuiteJ.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java docs/configuration/worker.md client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 15. | lvshuang.tb@gmail.com | zhouky@apache.org |
40 shared files
pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/ShuffleTaskInfo.java client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/ShuffleTaskInfoSuitJ.java common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java client/src/main/scala/org/apache/celeborn/client/commit/MapPartitionCommitHandler.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriter.java client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGate.java common/src/test/java/org/apache/celeborn/common/network/server/BufferStreamManagerSuiteJ.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/meta/ShufflePartitionLocationInfo.scala client/src/main/scala/org/apache/celeborn/client/CommitManager.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/ShuffleResourceDescriptor.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala common/src/main/java/org/apache/celeborn/common/network/server/memory/ReadBufferDispatcher.java client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleMaster.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/TransportFrameDecoderWithBufferSupplier.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGate.java docs/configuration/worker.md client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGateSuiteJ.java client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala common/src/main/java/org/apache/celeborn/common/network/server/DataPartitionReader.java common/src/main/java/org/apache/celeborn/common/network/server/BufferStreamManager.java common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 16. | zky.zhoukeyong@alibaba-inc.com | lvshuang.tb@gmail.com |
39 shared files
client-flink/flink-1.15/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/client/ShuffleClientSuite.scala client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGate.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleMaster.java client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java client-flink/flink-1.17/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateDelegation.java client/src/main/scala/org/apache/celeborn/client/commit/MapPartitionCommitHandler.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala client/src/main/scala/org/apache/celeborn/client/WorkerStatusTracker.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteBufferStreamReader.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java docs/configuration/worker.md client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 17. | ethanfeng@apache.org | zhouky@apache.org |
38 shared files
client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateFactory.java common/src/main/java/org/apache/celeborn/common/meta/FileInfo.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriterSuiteJ.java assets/grafana/rss-dashboard.json worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGate.java common/src/test/java/org/apache/celeborn/common/network/RpcIntegrationSuiteJ.java docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java common/src/main/java/org/apache/celeborn/common/util/JavaUtils.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala common/src/test/java/org/apache/celeborn/common/network/TransportClientFactorySuiteJ.java common/src/main/java/org/apache/celeborn/common/network/server/memory/MemoryManager.java common/src/main/java/org/apache/celeborn/common/network/server/memory/ReadBufferDispatcher.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/TransportFrameDecoderWithBufferSupplier.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java .github/workflows/maven.yml docs/configuration/worker.md common/src/main/java/org/apache/celeborn/common/network/server/DataPartitionReader.java common/src/main/java/org/apache/celeborn/common/network/server/TransportServer.java common/src/main/java/org/apache/celeborn/common/network/server/BufferStreamManager.java common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 18. | fengmingxiao.fmx@alibaba-inc.com | angers.zhu@gmail.com |
37 shared files
common/src/test/scala/org/apache/celeborn/common/CelebornConfSuite.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java docs/deploy.md tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java docs/configuration/network.md worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala common/src/main/scala/org/apache/celeborn/common/util/CelebornHadoopUtils.scala assets/grafana/celeborn-dashboard.json worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala README.md master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MetaHandler.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java docs/configuration/client.md docs/configuration/master.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java METRICS.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala common/src/main/java/org/apache/celeborn/common/network/protocol/TransportMessage.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/test/scala/org/apache/celeborn/common/util/UtilsSuite.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java docs/configuration/worker.md client/src/main/java/org/apache/celeborn/client/read/DfsPartitionReader.java common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 19. | cfmcgrady@gmail.com | zhouky@apache.org |
36 shared files
common/src/test/scala/org/apache/celeborn/common/util/PbSerDeUtilsTest.scala service/src/main/scala/org/apache/celeborn/server/common/HttpService.scala pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java assets/grafana/rss-dashboard.json tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/PushDataTimeoutTest.scala client/src/main/java/org/apache/celeborn/client/write/DataPusher.java common/src/main/scala/org/apache/celeborn/common/meta/WorkerPartitionLocationInfo.scala client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala client/src/main/scala/org/apache/celeborn/client/commit/MapPartitionCommitHandler.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/meta/ShufflePartitionLocationInfo.scala client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/main/java/org/apache/celeborn/common/write/PushState.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java .rat-excludes common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java master/src/main/java/org/apache/celeborn/service/deploy/master/SlotsAllocator.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala common/src/main/java/org/apache/celeborn/common/network/server/TransportServer.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 20. | chengpan@apache.org | lvshuang.tb@gmail.com |
35 shared files
client-flink/flink-1.15/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/client/ShuffleClientSuite.scala client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client-flink/flink-1.14/pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java client-flink/flink-1.17/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java worker/src/test/scala/org/apache/celeborn/service/deploy/HeartbeatFeature.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java client/src/main/scala/org/apache/celeborn/client/ApplicationHeartbeater.scala docs/configuration/client.md charts/celeborn/templates/configmap.yaml client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 21. | zky.zhoukeyong@alibaba-inc.com | ethanfeng@apache.org |
34 shared files
client-flink/flink-1.15/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriterSuiteJ.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGate.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleMaster.java docs/configuration/network.md worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java client-flink/flink-1.17/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateDelegation.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteBufferStreamReader.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGateSuiteJ.java docs/configuration/worker.md common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 22. | ethanfeng@apache.org | zhongqiang.czq@alibaba-inc.com |
34 shared files
client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateFactory.java common/src/main/java/org/apache/celeborn/common/meta/FileInfo.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionFactory.java client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriterSuiteJ.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorterSuiteJ.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/config/PluginConf.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala common/src/main/java/org/apache/celeborn/common/network/TransportContext.java README.md common/src/main/java/org/apache/celeborn/common/network/util/TransportConf.java docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java common/src/main/java/org/apache/celeborn/common/network/protocol/Message.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/MessageDecoderExt.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/MemoryManager.java tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/WordCountTest.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/network/RequestTimeoutIntegrationSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala common/src/test/java/org/apache/celeborn/common/network/TransportClientFactorySuiteJ.java docs/configuration/worker.md client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/PluginConfSuiteJ.java client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartition.java client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleServiceFactory.java common/src/main/proto/TransportMessages.proto worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/buffer/BufferPacker.java |
| 23. | chengpan@apache.org | zhongqiang.czq@alibaba-inc.com |
34 shared files
pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorterSuiteJ.java docs/migration.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala worker/src/test/scala/org/apache/celeborn/service/deploy/HeartbeatFeature.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala README.md conf/celeborn-defaults.conf.template client/src/main/scala/org/apache/celeborn/client/ApplicationHeartbeater.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java sbin/start-master.sh worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java sbin/start-worker.sh master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/MemoryManager.java common/src/test/scala/org/apache/celeborn/common/metrics/source/CelebornSourceSuite.scala build/make-distribution.sh client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java docs/configuration/metrics.md tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/HeartbeatTest.scala worker/src/test/scala/org/apache/celeborn/service/deploy/MiniClusterFeature.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 24. | angers.zhu@gmail.com | fwang12@ebay.com |
32 shared files
master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportResponseHandler.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/rpc/netty/NettyRpcEnv.scala worker/src/test/scala/org/apache/celeborn/service/deploy/worker/storage/WorkerSuite.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerPartitionLocationInfo.scala client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala common/src/main/java/org/apache/celeborn/common/write/SlowStartPushStrategy.java common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala client/src/main/scala/org/apache/celeborn/client/CommitManager.scala common/src/main/java/org/apache/celeborn/common/write/InFlightRequestTracker.java common/src/main/java/org/apache/celeborn/common/write/PushState.java client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/ObservedDevice.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigEntry.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MasterStateMachineSuiteJ.java client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 25. | ethanfeng@apache.org | cfmcgrady@gmail.com |
29 shared files
client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/ShuffleResourceTracker.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java assets/grafana/rss-dashboard.json client-flink/flink-1.15-shaded/pom.xml docs/monitoring.md common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/MemoryManager.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client-flink/flink-1.17-shaded/pom.xml client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGateSuiteJ.java client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/ShuffleResourceTrackerTest.java common/src/main/java/org/apache/celeborn/common/network/server/TransportServer.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 26. | lvshuang.tb@gmail.com | cfmcgrady@gmail.com |
29 shared files
client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala common/src/test/scala/org/apache/celeborn/common/meta/ShufflePartitionLocationInfoSuite.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client-flink/flink-1.14-shaded/pom.xml client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/test/java/org/apache/celeborn/common/protocol/PartitionLocationSuiteJ.java common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala client/src/main/scala/org/apache/celeborn/client/commit/MapPartitionCommitHandler.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala client/src/main/scala/org/apache/celeborn/client/WorkerStatusTracker.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/meta/ShufflePartitionLocationInfo.scala client/src/main/scala/org/apache/celeborn/client/CommitManager.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java common/src/main/java/org/apache/celeborn/common/protocol/PartitionLocation.java common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 27. | fwang12@ebay.com | zhouky@apache.org |
28 shared files
common/src/test/scala/org/apache/celeborn/common/util/PbSerDeUtilsTest.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/ShuffleTaskInfo.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/meta/WorkerPartitionLocationInfo.scala client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala client/src/main/scala/org/apache/celeborn/client/commit/MapPartitionCommitHandler.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java common/src/main/java/org/apache/celeborn/common/util/JavaUtils.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala common/src/main/java/org/apache/celeborn/common/write/InFlightRequestTracker.java common/src/main/java/org/apache/celeborn/common/write/PushState.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MasterStateMachineSuiteJ.java common/src/main/java/org/apache/celeborn/common/network/server/ChunkStreamManager.java client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleMaster.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala common/src/main/java/org/apache/celeborn/common/network/server/BufferStreamManager.java common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 28. | angers.zhu@gmail.com | lyh-36@163.com |
28 shared files
common/src/main/java/org/apache/celeborn/common/network/util/NettyUtils.java docs/celeborn_ratis_shell.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitor.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java assets/grafana/rss-dashboard.json common/src/main/scala/org/apache/celeborn/common/metrics/MetricLabels.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/java/org/apache/celeborn/common/write/SlowStartPushStrategy.java docs/configuration/index.md docs/monitoring.md common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HARaftServer.java common/src/main/java/org/apache/celeborn/common/network/TransportContext.java client/src/main/scala/org/apache/celeborn/client/WorkerStatusTracker.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/ObservedDevice.scala common/src/main/java/org/apache/celeborn/common/client/MasterClient.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java common/src/main/java/org/apache/celeborn/common/util/ShutdownHookManager.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 29. | zky.zhoukeyong@alibaba-inc.com | fwang12@ebay.com |
27 shared files
common/src/test/scala/org/apache/celeborn/common/util/PbSerDeUtilsTest.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportResponseHandler.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala common/src/main/java/org/apache/celeborn/common/write/SlowStartPushStrategy.java common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala client/src/main/scala/org/apache/celeborn/client/commit/MapPartitionCommitHandler.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala client/src/main/scala/org/apache/celeborn/client/CommitManager.scala common/src/main/java/org/apache/celeborn/common/write/InFlightRequestTracker.java client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MasterStateMachineSuiteJ.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 30. | fwang12@ebay.com | lvshuang.tb@gmail.com |
27 shared files
master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/ShuffleTaskInfo.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/FlinkTransportClientFactory.java common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala client/src/main/scala/org/apache/celeborn/client/commit/MapPartitionCommitHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/network/TransportFrameDecoderWithBufferSupplierSuiteJ.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleMaster.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/ReadClientHandler.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala common/src/main/java/org/apache/celeborn/common/network/server/BufferStreamManager.java common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 31. | fengmingxiao.fmx@alibaba-inc.com | chengpan@apache.org |
26 shared files
common/src/test/scala/org/apache/celeborn/common/CelebornConfSuite.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java docs/deploy.md tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala docs/configuration/network.md worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala README.md master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MetaHandler.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/test/scala/org/apache/celeborn/common/util/UtilsSuite.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 32. | lvshuang.tb@gmail.com | zhongqiang.czq@alibaba-inc.com |
26 shared files
pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriter.java worker/src/test/scala/org/apache/celeborn/service/deploy/HeartbeatFeature.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala common/src/main/java/org/apache/celeborn/common/network/protocol/Heartbeat.java client/src/main/scala/org/apache/celeborn/client/ApplicationHeartbeater.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala common/src/main/java/org/apache/celeborn/common/network/util/TransportFrameDecoder.java common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGate.java docs/configuration/worker.md client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGateSuiteJ.java client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartition.java common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 33. | zky.zhoukeyong@alibaba-inc.com | fengmingxiao.fmx@alibaba-inc.com |
24 shared files
common/src/test/scala/org/apache/celeborn/common/CelebornConfSuite.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java docs/configuration/network.md worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java docs/configuration/client.md docs/configuration/master.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/test/scala/org/apache/celeborn/common/util/UtilsSuite.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java docs/configuration/worker.md common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 34. | fwang12@ebay.com | chengpan@apache.org |
24 shared files
master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/rpc/netty/NettyRpcEnv.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala common/src/main/scala/org/apache/celeborn/common/rpc/netty/Dispatcher.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java common/src/main/java/org/apache/celeborn/common/util/JavaUtils.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala common/src/main/java/org/apache/celeborn/common/write/PushState.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/ObservedDevice.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigEntry.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/congestcontrol/CongestionController.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 35. | chengpan@apache.org | lyh-36@163.com |
23 shared files
worker/src/test/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitorSuite.scala docs/celeborn_ratis_shell.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitor.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/metrics/MetricLabels.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala docs/monitoring.md common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala common/src/main/java/org/apache/celeborn/common/network/util/NettyMemoryMetrics.java docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/ObservedDevice.scala common/src/test/scala/org/apache/celeborn/common/metrics/source/CelebornSourceSuite.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/congestcontrol/CongestionController.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 36. | cfmcgrady@gmail.com | fwang12@ebay.com |
22 shared files
common/src/test/scala/org/apache/celeborn/common/util/PbSerDeUtilsTest.scala client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportResponseHandler.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/test/scala/org/apache/celeborn/service/deploy/worker/storage/WorkerSuite.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerPartitionLocationInfo.scala client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala client/src/main/scala/org/apache/celeborn/client/commit/MapPartitionCommitHandler.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala client/src/main/scala/org/apache/celeborn/client/CommitManager.scala common/src/main/java/org/apache/celeborn/common/write/PushState.java client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 37. | ethanfeng@apache.org | fengmingxiao.fmx@alibaba-inc.com |
22 shared files
master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java common/src/main/java/org/apache/celeborn/common/meta/FileInfo.java docs/deploy.md docs/configuration/network.md worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala README.md docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java common/src/main/java/org/apache/celeborn/common/network/protocol/Message.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala common/src/main/java/org/apache/celeborn/common/network/protocol/OpenStreamWithCredit.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala docs/configuration/worker.md common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 38. | zhongqiang.czq@alibaba-inc.com | zhouky@apache.org |
22 shared files
client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateFactory.java common/src/main/java/org/apache/celeborn/common/meta/FileInfo.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriterSuiteJ.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriter.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala docs/configuration/client.md docs/configuration/master.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala common/src/test/java/org/apache/celeborn/common/network/TransportClientFactorySuiteJ.java client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGate.java docs/configuration/worker.md client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGateSuiteJ.java common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 39. | zhongqiang.czq@alibaba-inc.com | zky.zhoukeyong@alibaba-inc.com |
22 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriterSuiteJ.java docs/migration.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala docs/configuration/client.md docs/configuration/master.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/HeartbeatTest.scala docs/configuration/worker.md common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 40. | ethanfeng@apache.org | lyh-36@163.com |
21 shared files
common/src/main/java/org/apache/celeborn/common/network/util/NettyUtils.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/buffer/SortBuffer.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapDataPartitionReader.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java assets/grafana/rss-dashboard.json docs/monitoring.md master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HARaftServer.java common/src/main/java/org/apache/celeborn/common/network/TransportContext.java common/src/main/java/org/apache/celeborn/common/network/util/NettyMemoryMetrics.java docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java docs/configuration/quota.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/congestcontrol/CongestionController.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 41. | lvshuang.tb@gmail.com | fengmingxiao.fmx@alibaba-inc.com |
20 shared files
master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java docs/configuration/worker.md common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 42. | zhouky@apache.org | fengmingxiao.fmx@alibaba-inc.com |
20 shared files
common/src/main/java/org/apache/celeborn/common/meta/FileInfo.java master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala master/src/main/proto/Resource.proto master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java docs/configuration/client.md docs/configuration/master.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java docs/configuration/worker.md common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 43. | ethanfeng@apache.org | fwang12@ebay.com |
19 shared files
master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/FlinkTransportClientFactory.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java common/src/main/java/org/apache/celeborn/common/util/JavaUtils.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/ReadClientHandler.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java common/src/main/java/org/apache/celeborn/common/network/server/BufferStreamManager.java common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/congestcontrol/CongestionController.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 44. | cfmcgrady@gmail.com | zhongqiang.czq@alibaba-inc.com |
19 shared files
pom.xml charts/celeborn/templates/master-statefulset.yaml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java docs/migration.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/MemoryManager.java common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java worker/src/test/scala/org/apache/celeborn/service/deploy/MiniClusterFeature.scala common/src/main/proto/TransportMessages.proto worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 45. | sychen@ctrip.com | angers.zhu@gmail.com |
16 shared files
client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala pom.xml client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigBuilder.scala common/src/main/scala/org/apache/celeborn/common/meta/ShufflePartitionLocationInfo.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/WordCountTest.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigEntry.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/metrics/MetricsSystem.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala |
| 46. | zhongqiang.czq@alibaba-inc.com | fengmingxiao.fmx@alibaba-inc.com |
15 shared files
common/src/main/java/org/apache/celeborn/common/meta/FileInfo.java tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala README.md docs/configuration/client.md docs/configuration/master.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java common/src/main/java/org/apache/celeborn/common/network/protocol/Message.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala docs/configuration/worker.md common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 47. | lvshuang.tb@gmail.com | lyh-36@163.com |
15 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/buffer/SortBuffer.java tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapDataPartitionReader.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/test/java/org/apache/celeborn/common/protocol/PartitionLocationSuiteJ.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HARaftServer.java client/src/main/scala/org/apache/celeborn/client/WorkerStatusTracker.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 48. | lyh-36@163.com | cfmcgrady@gmail.com |
15 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java assets/grafana/rss-dashboard.json worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/test/java/org/apache/celeborn/common/protocol/PartitionLocationSuiteJ.java docs/monitoring.md client/src/main/scala/org/apache/celeborn/client/WorkerStatusTracker.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 49. | chengpan@apache.org | sychen@ctrip.com |
14 shared files
pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/MasterArguments.scala client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/RssShuffleReader.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigEntry.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/util/FunctionConverter.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala |
| 50. | lyh-36@163.com | zky.zhoukeyong@alibaba-inc.com |
14 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/java/org/apache/celeborn/common/write/SlowStartPushStrategy.java client/src/main/scala/org/apache/celeborn/client/WorkerStatusTracker.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 51. | lyh-36@163.com | zhouky@apache.org |
13 shared files
worker/src/test/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitorSuite.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java assets/grafana/rss-dashboard.json worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 52. | fengmingxiao.fmx@alibaba-inc.com | cfmcgrady@gmail.com |
13 shared files
master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala METRICS.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala common/src/test/scala/org/apache/celeborn/common/util/UtilsSuite.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 53. | fwang12@ebay.com | fengmingxiao.fmx@alibaba-inc.com |
12 shared files
master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 54. | fwang12@ebay.com | lyh-36@163.com |
12 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/java/org/apache/celeborn/common/write/SlowStartPushStrategy.java common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/ObservedDevice.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/congestcontrol/CongestionController.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 55. | zhongqiang.czq@alibaba-inc.com | lyh-36@163.com |
12 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala common/src/main/java/org/apache/celeborn/common/network/TransportContext.java docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java common/src/main/java/org/apache/celeborn/common/network/server/TransportChannelHandler.java common/src/test/scala/org/apache/celeborn/common/metrics/source/CelebornSourceSuite.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 56. | angers.zhu@gmail.com | cxzl25@users.noreply.github.com |
11 shared files
client/src/test/java/org/apache/celeborn/client/ShuffleClientBaseSuiteJ.java docs/deploy.md tests/spark-it/src/test/scala/org/apache/celeborn/tests/client/ShuffleClientSuite.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java docs/configuration/index.md README.md worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/RssShuffleWriterSuiteJ.java client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/RssShuffleWriterSuiteJ.java worker/src/test/scala/org/apache/celeborn/service/deploy/MiniClusterFeature.scala |
| 57. | lvshuang.tb@gmail.com | sychen@ctrip.com |
11 shared files
client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala pom.xml client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala common/src/main/scala/org/apache/celeborn/common/meta/ShufflePartitionLocationInfo.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala |
| 58. | sychen@ctrip.com | zky.zhoukeyong@alibaba-inc.com |
11 shared files
client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/RssShuffleReader.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala |
| 59. | sychen@ctrip.com | zhouky@apache.org |
11 shared files
pom.xml client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigBuilder.scala common/src/main/scala/org/apache/celeborn/common/meta/ShufflePartitionLocationInfo.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala |
| 60. | cfmcgrady@gmail.com | sychen@ctrip.com |
10 shared files
master/src/main/scala/org/apache/celeborn/service/deploy/master/clustermeta/ha/MasterNode.scala client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala pom.xml client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala common/src/main/scala/org/apache/celeborn/common/meta/ShufflePartitionLocationInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala |
| 61. | fwang12@ebay.com | sychen@ctrip.com |
10 shared files
client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigEntry.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala |
| 62. | fwang12@ebay.com | zhongqiang.czq@alibaba-inc.com |
10 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 63. | chengpan@apache.org | cxzl25@users.noreply.github.com |
9 shared files
client/src/test/java/org/apache/celeborn/client/ShuffleClientBaseSuiteJ.java docs/deploy.md tests/spark-it/src/test/scala/org/apache/celeborn/tests/client/ShuffleClientSuite.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java README.md worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/RssShuffleWriterSuiteJ.java worker/src/test/scala/org/apache/celeborn/service/deploy/MiniClusterFeature.scala |
| 64. | 1178404354@qq.com | angers.zhu@gmail.com |
9 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala README.md master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MetaHandler.java docs/configuration/client.md client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 65. | 1178404354@qq.com | chengpan@apache.org |
9 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala README.md master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MetaHandler.java docs/configuration/client.md client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 66. | sychen@ctrip.com | ethanfeng@apache.org |
8 shared files
pom.xml common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/WordCountTest.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala |
| 67. | angers.zhu@gmail.com | xiyu.zk@alibaba-inc.com |
8 shared files
pom.xml client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java docs/configuration/client.md mkdocs.yml client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java client/src/main/java/org/apache/celeborn/client/read/RssInputStream.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 68. | 1178404354@qq.com | zhouky@apache.org |
8 shared files
client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/ShuffleTaskInfo.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/ShuffleTaskInfoSuitJ.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala docs/configuration/client.md common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 69. | angers.zhu@gmail.com | turbofei@foxmail.com |
7 shared files
master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java service/src/main/scala/org/apache/celeborn/server/common/HttpService.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala common/src/main/java/org/apache/celeborn/common/haclient/RssHARetryClient.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala client/src/main/java/org/apache/celeborn/client/compress/Decompressor.java client/src/main/java/org/apache/celeborn/client/compress/Compressor.java |
| 70. | chengpan@apache.org | xiyu.zk@alibaba-inc.com |
7 shared files
pom.xml client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java docs/configuration/client.md mkdocs.yml client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 71. | sychen@ctrip.com | zhongqiang.czq@alibaba-inc.com |
7 shared files
pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/WordCountTest.scala |
| 72. | anh131@126.com | chengpan@apache.org |
7 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/congestcontrol/TestCongestionController.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/Source.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/congestcontrol/CongestionController.java |
| 73. | lvshuang.tb@gmail.com | 1178404354@qq.com |
7 shared files
client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/ShuffleTaskInfo.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/ShuffleTaskInfoSuitJ.java docs/configuration/client.md client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 74. | 1178404354@qq.com | zhongqiang.czq@alibaba-inc.com |
7 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala README.md docs/configuration/client.md client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 75. | 1178404354@qq.com | zky.zhoukeyong@alibaba-inc.com |
7 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala docs/configuration/client.md client/src/main/java/org/apache/celeborn/client/ReviveManager.java client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 76. | zky.zhoukeyong@alibaba-inc.com | xiyu.zk@alibaba-inc.com |
7 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java docs/configuration/client.md mkdocs.yml client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java client/src/main/java/org/apache/celeborn/client/read/RssInputStream.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 77. | cfmcgrady@gmail.com | xiyu.zk@alibaba-inc.com |
6 shared files
pom.xml client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java docs/configuration/client.md client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 78. | anh131@126.com | angers.zhu@gmail.com |
6 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/congestcontrol/TimeSlidingHub.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/congestcontrol/BufferStatusHub.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala |
| 79. | fwang12@ebay.com | 1178404354@qq.com |
6 shared files
client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/ShuffleTaskInfo.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 80. | angers.zhu@gmail.com | caojiaqing@bilibili.com |
6 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala docs/configuration/worker.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 81. | 1178404354@qq.com | fengmingxiao.fmx@alibaba-inc.com |
6 shared files
common/src/main/scala/org/apache/celeborn/common/util/Utils.scala README.md master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MetaHandler.java docs/configuration/client.md client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 82. | sychen@ctrip.com | fengmingxiao.fmx@alibaba-inc.com |
6 shared files
common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala |
| 83. | turbofei@foxmail.com | chengpan@apache.org |
5 shared files
master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java service/src/main/scala/org/apache/celeborn/server/common/HttpService.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerArguments.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala |
| 84. | zky.zhoukeyong@alibaba-inc.com | cxzl25@users.noreply.github.com |
5 shared files
client/src/test/java/org/apache/celeborn/client/ShuffleClientBaseSuiteJ.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/client/ShuffleClientSuite.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala |
| 85. | zhouky@apache.org | xiyu.zk@alibaba-inc.com |
5 shared files
pom.xml client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java docs/configuration/client.md client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 86. | anh131@126.com | lyh-36@163.com |
5 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/congestcontrol/CongestionController.java |
| 87. | fengmingxiao.fmx@alibaba-inc.com | lyh-36@163.com |
5 shared files
tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 88. | 1178404354@qq.com | ethanfeng@apache.org |
5 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala README.md docs/configuration/client.md common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 89. | 1178404354@qq.com | lyh-36@163.com |
5 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala docs/configuration/client.md common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 90. | 1178404354@qq.com | cfmcgrady@gmail.com |
5 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala docs/configuration/client.md common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 91. | ethanfeng@apache.org | caojiaqing@bilibili.com |
5 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala docs/configuration/worker.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 92. | zhongqiang.czq@alibaba-inc.com | caojiaqing@bilibili.com |
5 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala docs/configuration/worker.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 93. | lvshuang.tb@gmail.com | caojiaqing@bilibili.com |
5 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala docs/configuration/worker.md common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 94. | zhouky@apache.org | caojiaqing@bilibili.com |
5 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala docs/configuration/worker.md common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 95. | chengpan@apache.org | caojiaqing@bilibili.com |
5 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 96. | cfmcgrady@gmail.com | caojiaqing@bilibili.com |
5 shared files
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala |
| 97. | 55676558+liugs0213@users.noreply.github.com | 52876270+zwangsheng@users.noreply.github.com |
4 shared files
charts/celeborn/values.yaml charts/celeborn/templates/master-statefulset.yaml charts/celeborn/templates/configmap.yaml charts/celeborn/templates/worker-statefulset.yaml |
| 98. | 55676558+liugs0213@users.noreply.github.com | 2213335496@qq.com |
4 shared files
charts/celeborn/values.yaml charts/celeborn/templates/master-statefulset.yaml charts/celeborn/templates/configmap.yaml charts/celeborn/templates/worker-statefulset.yaml |
| 99. | 52876270+zwangsheng@users.noreply.github.com | 2213335496@qq.com |
4 shared files
charts/celeborn/values.yaml charts/celeborn/templates/master-statefulset.yaml charts/celeborn/templates/configmap.yaml charts/celeborn/templates/worker-statefulset.yaml |
| 100. | 2213335496@qq.com | chengpan@apache.org |
4 shared files
charts/celeborn/values.yaml pom.xml charts/celeborn/templates/configmap.yaml tests/kubernetes-it/docker/helm/values.yaml |
| Contributor | # connections | # commits | |
|---|---|---|---|
| 1. | angers.zhu@gmail.com | 33 | 144 |
| 2. | chengpan@apache.org | 32 | 48 |
| 3. | zhongqiang.czq@alibaba-inc.com | 27 | 26 |
| 4. | ethanfeng@apache.org | 26 | 62 |
| 5. | lvshuang.tb@gmail.com | 26 | 48 |
| 6. | zky.zhoukeyong@alibaba-inc.com | 26 | 46 |
| 7. | cfmcgrady@gmail.com | 26 | 34 |
| 8. | zhouky@apache.org | 25 | 22 |
| 9. | lyh-36@163.com | 23 | 9 |
| 10. | fengmingxiao.fmx@alibaba-inc.com | 22 | 10 |
| 11. | fwang12@ebay.com | 22 | 3 |
| 12. | sychen@ctrip.com | 22 | 2 |
| 13. | xiyu.zk@alibaba-inc.com | 20 | 6 |
| 14. | 1178404354@qq.com | 19 | 11 |
| 15. | caojiaqing@bilibili.com | 16 | 3 |
| 16. | tcodehuber@gmail.com | 16 | 1 |
| 17. | ckj@apache.org | 15 | 2 |
| 18. | cxzl25@users.noreply.github.com | 15 | 2 |
| 19. | turbofei@foxmail.com | 15 | 1 |
| 20. | anh131@126.com | 14 | 4 |
| 21. | 2213335496@qq.com | 13 | 7 |
| 22. | liangdingwen.ldw@alipay.com | 12 | 1 |
| 23. | lmlianne@outlook.com | 12 | 1 |
| 24. | 89496918+cvedetect@users.noreply.github.com | 11 | 1 |
| 25. | 52876270+zwangsheng@users.noreply.github.com | 9 | 6 |
| 26. | 52647492+xunxunmimi5577@users.noreply.github.com | 9 | 1 |
| 27. | 55676558+liugs0213@users.noreply.github.com | 7 | 1 |
| 28. | cchung100m@cs.ccu.edu.tw | 7 | 1 |
| 29. | 99078115+skytin1004@users.noreply.github.com | 7 | 1 |
| 30. | waitinfuture@gmail.com | 4 | 1 |
| 31. | peter.wsj@alibaba-inc.com | 4 | 1 |
| 32. | liyihe@bigo.sg | 3 | 1 |
| 33. | akpatnam25@gmail.com | 3 | 1 |
| 34. | jn_hdd@163.com | 3 | 1 |
| 35. | apatnam@linkedin.com | 2 | 1 |
| 36. | 86960423+every-breaking-wave@users.noreply.github.com | 1 | 2 |
| 37. | wangweirao16@gmail.com | 1 | 1 |
| 38. | ulyssesyou18@gmail.com | 0 | 1 |
C-median: 15.0
A half of the contributors has more than 15.0 connections, and a half has less than this number.
C-mean: 14.8
An average number of connections a contributor has with other contributors.
C-index: 15.0
There are 15.0 contributors with 15.0 or more connections.
55 contributors (1,038 commits):
| # | Contributor |
First Commit |
Latest Commit |
Commits Count |
|---|---|---|---|---|
| 1. | angers.zhu@gmail.com | 2022-03-03 | 2023-07-27 | 275 (26%) |
| 2. | chengpan@apache.org | 2022-08-13 | 2023-07-24 | 140 (13%) |
| 3. | zky.zhoukeyong@alibaba-inc.com | 2021-12-28 | 2023-08-07 | 98 (9%) |
| 4. | ethanfeng@apache.org | 2022-11-15 | 2023-06-13 | 88 (8%) |
| 5. | lvshuang.tb@gmail.com | 2022-10-20 | 2023-08-08 | 60 (5%) |
| 6. | 30563796+nafiyaix@users.noreply.github.com | 2022-05-30 | 2023-01-28 | 48 (4%) |
| 7. | fengmingxiao.fmx@alibaba-inc.com | 2022-01-26 | 2023-08-08 | 43 (4%) |
| 8. | cfmcgrady@gmail.com | 2023-01-05 | 2023-08-05 | 35 (3%) |
| 9. | zhouky@apache.org | 2022-11-26 | 2023-04-07 | 34 (3%) |
| 10. | 52876270+zwangsheng@users.noreply.github.com | 2022-07-07 | 2023-06-01 | 29 (2%) |
| 11. | xiyu.zk@alibaba-inc.com | 2022-09-05 | 2023-08-08 | 29 (2%) |
| 12. | zhongqiang.czq@alibaba-inc.com | 2023-02-04 | 2023-07-05 | 27 (2%) |
| 13. | 96606293+zhongqiangczq@users.noreply.github.com | 2022-11-16 | 2023-02-02 | 20 (1%) |
| 14. | anh131@126.com | 2022-12-01 | 2023-04-14 | 14 (1%) |
| 15. | 1178404354@qq.com | 2023-02-10 | 2023-07-25 | 11 (1%) |
| 16. | lyh-36@163.com | 2023-05-17 | 2023-07-19 | 9 (<1%) |
| 17. | ethan.aquarius.fmx@gmail.com | 2022-10-22 | 2022-11-09 | 8 (<1%) |
| 18. | 2213335496@qq.com | 2023-06-02 | 2023-08-03 | 7 (<1%) |
| 19. | lvshuang.xjs@alibaba-inc.com | 2022-11-16 | 2022-12-07 | 5 (<1%) |
| 20. | 490081539@qq.com | 2022-11-01 | 2022-11-11 | 5 (<1%) |
| 21. | ckj@apache.org | 2023-01-18 | 2023-05-18 | 4 (<1%) |
| 22. | caojiaqing@bilibili.com | 2023-07-11 | 2023-08-01 | 3 (<1%) |
| 23. | fwang12@ebay.com | 2023-03-26 | 2023-03-27 | 3 (<1%) |
| 24. | 82567833+zy-jordan@users.noreply.github.com | 2023-01-10 | 2023-01-20 | 3 (<1%) |
| 25. | gabrielleebuaa@gmail.com | 2022-11-15 | 2022-11-20 | 3 (<1%) |
| 26. | sychen@ctrip.com | 2023-06-19 | 2023-06-19 | 2 (<1%) |
| 27. | cxzl25@users.noreply.github.com | 2023-03-24 | 2023-04-14 | 2 (<1%) |
| 28. | 52647492+xunxunmimi5577@users.noreply.github.com | 2022-09-18 | 2023-04-03 | 2 (<1%) |
| 29. | 86960423+every-breaking-wave@users.noreply.github.com | 2023-03-11 | 2023-03-13 | 2 (<1%) |
| 30. | 55676558+liugs0213@users.noreply.github.com | 2022-08-22 | 2023-02-27 | 2 (<1%) |
| 31. | 48054931+szywilliam@users.noreply.github.com | 2022-11-23 | 2022-12-14 | 2 (<1%) |
| 32. | 643348094@qq.com | 2022-10-19 | 2022-11-01 | 2 (<1%) |
| 33. | dxheming@163.com | 2022-06-27 | 2022-10-11 | 1 (<1%) |
| 34. | lichao@kuaishou.com | 2022-03-08 | 2022-08-22 | 1 (<1%) |
| 35. | waitinfuture@gmail.com | 2023-08-02 | 2023-08-02 | 1 (<1%) |
| 36. | apatnam@linkedin.com | 2023-07-26 | 2023-07-26 | 1 (<1%) |
| 37. | peter.wsj@alibaba-inc.com | 2023-07-14 | 2023-07-14 | 1 (<1%) |
| 38. | cchung100m@cs.ccu.edu.tw | 2023-06-29 | 2023-06-29 | 1 (<1%) |
| 39. | liangdingwen.ldw@alipay.com | 2023-06-28 | 2023-06-28 | 1 (<1%) |
| 40. | liyihe@bigo.sg | 2023-06-02 | 2023-06-02 | 1 (<1%) |
| 41. | ulyssesyou18@gmail.com | 2023-05-31 | 2023-05-31 | 1 (<1%) |
| 42. | 99078115+skytin1004@users.noreply.github.com | 2023-05-21 | 2023-05-21 | 1 (<1%) |
| 43. | wangweirao16@gmail.com | 2023-04-28 | 2023-04-28 | 1 (<1%) |
| 44. | akpatnam25@gmail.com | 2023-03-30 | 2023-03-30 | 1 (<1%) |
| 45. | 89496918+cvedetect@users.noreply.github.com | 2023-03-27 | 2023-03-27 | 1 (<1%) |
| 46. | turbofei@foxmail.com | 2023-03-25 | 2023-03-25 | 1 (<1%) |
| 47. | lmlianne@outlook.com | 2023-03-23 | 2023-03-23 | 1 (<1%) |
| 48. | tcodehuber@gmail.com | 2023-03-18 | 2023-03-18 | 1 (<1%) |
| 49. | jn_hdd@163.com | 2023-03-17 | 2023-03-17 | 1 (<1%) |
| 50. | xianyao.jiang@gmail.com | 2023-01-03 | 2023-01-03 | 1 (<1%) |
| 51. | zouxxyy@qq.com | 2022-11-15 | 2022-11-15 | 1 (<1%) |
| 52. | work4dong@163.com | 2022-09-22 | 2022-09-22 | 1 (<1%) |
| 53. | 39462475+flyangz@users.noreply.github.com | 2022-09-02 | 2022-09-02 | 1 (<1%) |
| 54. | 942011334@qq.com | 2022-09-01 | 2022-09-01 | 1 (<1%) |
| 55. | fyl_8@sina.com | 2022-08-09 | 2022-08-09 | 1 (<1%) |
A contributor dependency is detected if two contributors have changed the same files in the past 365 days.
The number on lines shows the number of same files that both persons changed in past 365 days.
| Contributor 1 | Contributor 2 | # shared files | |
|---|---|---|---|
| 1. | chengpan@apache.org | angers.zhu@gmail.com |
260 shared files
common/src/main/java/com/aliyun/emr/rss/common/utils/ShutdownHookManager.java client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/RssShuffleFallbackPolicyRunner.scala common/src/main/java/com/aliyun/emr/rss/common/network/protocol/OpenStream.java CONFIGURATION_GUIDE.md tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/HugeDataTest.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkUtils.java charts/celeborn/values.yaml service/src/main/scala/org/apache/celeborn/server/common/HttpService.scala common/src/main/scala/com/aliyun/emr/rss/common/protocol/message/ControlMessages.scala server-master/src/test/scala/com/aliyun/emr/rss/service/deploy/master/MasterSuite.scala client/src/test/java/org/apache/celeborn/client/ShuffleClientBaseSuiteJ.java common/src/main/java/com/aliyun/emr/rss/common/network/protocol/RpcRequest.java docs/celeborn_ratis_shell.md master/pom.xml client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala docs/deploy.md worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ClusterReadWriteSuite.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala client-spark/spark-3/src/test/scala/org/apache/spark/shuffle/celeborn/RssShuffleManagerSuite.scala client/src/main/java/com/aliyun/emr/rss/client/compress/RssLz4Compressor.java server-master/src/main/proto/Resource.proto common/src/main/scala/com/aliyun/emr/rss/common/RssConf.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala common/src/main/scala/org/apache/celeborn/common/RssConf.scala client/src/main/java/com/aliyun/emr/rss/client/read/Replica.java common/src/main/scala/org/apache/celeborn/common/metrics/MetricLabels.scala client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/FetchHandler.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/PushDataTimeoutTest.scala client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java server-master/src/main/scala/com/aliyun/emr/rss/service/deploy/master/Master.scala common/src/main/java/com/aliyun/emr/rss/common/network/protocol/RpcResponse.java common/src/main/scala/com/aliyun/emr/rss/common/rpc/RpcEnv.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java common/src/test/scala/org/apache/celeborn/common/RssConfSuite.scala client/src/main/java/org/apache/celeborn/client/write/DataPusher.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala client-spark/shuffle-manager-2/src/test/java/org/apache/spark/shuffle/rss/RssShuffleWriterSuiteJ.java server-worker/src/test/scala/com/aliyun/emr/rss/service/deploy/SparkTestBase.scala common/src/main/java/com/aliyun/emr/rss/common/network/util/TransportFrameDecoder.java client/src/main/java/com/aliyun/emr/rss/client/compress/RssLz4Decompressor.java bin/celeborn-class common/src/main/java/com/aliyun/emr/rss/common/network/protocol/PushMergedData.java docs/configuration/index.md common/src/main/java/com/aliyun/emr/rss/common/network/protocol/RpcFailure.java docs/monitoring.md server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/Controller.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RssNonPipelineSortSuite.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RssHashCheckDiskSuite.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala client/src/main/java/com/aliyun/emr/rss/client/compress/RssLz4Trait.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/IMetadataHandler.java server-worker/src/main/java/com/aliyun/emr/rss/service/deploy/worker/storage/FileWriter.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HARaftServer.java common/src/main/scala/org/apache/celeborn/common/rpc/RpcEndpointRef.scala bin/celeborn-ratis master/src/main/scala/org/apache/celeborn/service/deploy/master/MasterArguments.scala client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RetryReviveTest.scala server-worker/src/main/java/com/aliyun/emr/rss/service/deploy/worker/WorkingPartition.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala common/src/main/scala/com/aliyun/emr/rss/common/meta/PartitionLocationInfo.scala README.md master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MetaHandler.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java common/src/main/scala/org/apache/celeborn/common/metrics/source/JVMCPUSource.scala client/src/test/java/org/apache/celeborn/client/compress/CodecSuite.java common/src/test/java/org/apache/celeborn/common/haclient/RssHARetryClientSuiteJ.java client-spark/shuffle-manager-2/src/main/scala/org/apache/spark/shuffle/rss/RssShuffleFallbackPolicyRunner.scala service/src/main/scala/org/apache/celeborn/server/common/http/HttpRequestHandler.scala client/src/main/java/com/aliyun/emr/rss/client/ShuffleClient.java client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/RssShuffleReader.scala docs/configuration/ha.md sbin/start-master.sh client/src/main/java/org/apache/celeborn/client/write/PushState.java worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala common/src/main/scala/com/aliyun/emr/rss/common/meta/WorkerInfo.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/main/java/org/apache/celeborn/common/write/PushState.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/RssShuffleWriterSuiteJ.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java master/src/main/scala/org/apache/celeborn/service/deploy/master/MasterSource.scala common/src/main/java/com/aliyun/emr/rss/common/utils/PBSerDeUtils.java sbin/start-worker.sh client/src/main/java/com/aliyun/emr/rss/client/read/RetryingChunkClient.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/ObservedDevice.scala client/src/main/scala/com/aliyun/emr/rss/client/write/LifecycleManager.scala .gitignore worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerArguments.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigEntry.scala common/src/main/scala/com/aliyun/emr/rss/common/metrics/MetricsSystem.scala tests/kubernetes-it/docker/helm/values.yaml common/src/test/scala/org/apache/celeborn/ConfigurationSuite.scala server-worker/src/main/java/com/aliyun/emr/rss/service/deploy/worker/storage/PartitionFilesSorter.java ... |
| 2. | angers.zhu@gmail.com | zky.zhoukeyong@alibaba-inc.com |
177 shared files
common/src/main/java/org/apache/celeborn/common/network/server/StreamManager.java CONFIGURATION_GUIDE.md server-worker/src/main/java/com/aliyun/emr/rss/service/deploy/worker/FileWriter.java common/src/main/java/org/apache/celeborn/common/protocol/PartitionType.java common/src/main/java/com/aliyun/emr/rss/common/network/server/FileInfo.java common/src/main/scala/com/aliyun/emr/rss/common/protocol/message/ControlMessages.scala client/src/test/java/org/apache/celeborn/client/ShuffleClientBaseSuiteJ.java server-worker/src/test/java/com/aliyun/emr/rss/service/deploy/worker/PartitionFilesSorterSuiteJ.java common/src/main/java/org/apache/celeborn/common/network/util/NettyUtils.java client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala server-master/src/main/proto/Resource.proto common/src/main/scala/com/aliyun/emr/rss/common/RssConf.scala common/src/main/scala/org/apache/celeborn/common/metrics/MetricsConfig.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala common/src/main/scala/org/apache/celeborn/common/RssConf.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriterSuiteJ.java assets/grafana/rss-dashboard.json client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/FetchHandler.scala client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java server-master/src/main/scala/com/aliyun/emr/rss/service/deploy/master/Master.scala client/src/test/java/org/apache/celeborn/client/write/DataPushQueueSuitJ.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleMaster.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java common/src/test/scala/org/apache/celeborn/common/RssConfSuite.scala client/src/main/java/org/apache/celeborn/client/write/DataPusher.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/java/org/apache/celeborn/common/write/SlowStartPushStrategy.java common/src/main/java/com/aliyun/emr/rss/common/network/util/TransportFrameDecoder.java common/src/main/java/com/aliyun/emr/rss/common/network/server/FileManagedBuffers.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateDelegation.java server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/Controller.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala common/src/main/scala/org/apache/celeborn/common/rpc/RpcEndpointRef.scala client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala common/src/main/scala/org/apache/celeborn/common/serializer/JavaSerializer.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RetryReviveTest.scala client/src/main/java/org/apache/celeborn/client/read/Replica.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala README.md common/src/main/scala/org/apache/celeborn/common/quota/Quota.scala common/src/main/java/org/apache/celeborn/common/protocol/RpcNameConstants.java client/src/main/scala/org/apache/celeborn/client/WorkerStatusTracker.scala common/src/main/java/org/apache/celeborn/common/write/SimplePushStrategy.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java common/src/main/scala/org/apache/celeborn/common/metrics/source/JVMCPUSource.scala client/src/test/java/org/apache/celeborn/client/compress/CodecSuite.java common/src/test/java/org/apache/celeborn/common/haclient/RssHARetryClientSuiteJ.java client-spark/shuffle-manager-2/src/main/scala/org/apache/spark/shuffle/rss/RssShuffleFallbackPolicyRunner.scala client/src/main/java/org/apache/celeborn/client/read/PartitionReader.java client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/RssShuffleReader.scala client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriterSuiteJ.java sbin/start-master.sh client/src/main/java/org/apache/celeborn/client/write/PushState.java worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala common/src/main/scala/com/aliyun/emr/rss/common/meta/WorkerInfo.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/main/java/org/apache/celeborn/common/write/InFlightRequestTracker.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java common/src/main/java/org/apache/celeborn/common/network/protocol/TransportMessage.java sbin/start-worker.sh master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorRackAwareSuiteJ.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java common/src/main/java/org/apache/celeborn/common/network/server/OneForOneStreamManager.java client/src/main/scala/com/aliyun/emr/rss/client/write/LifecycleManager.scala server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/LocalStorageManager.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigEntry.scala server-worker/src/main/java/com/aliyun/emr/rss/service/deploy/worker/storage/PartitionFilesSorter.java common/src/main/java/org/apache/celeborn/common/util/ShutdownHookManager.java common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/pom.xml client-spark/shuffle-manager-3/src/main/scala/org/apache/spark/shuffle/rss/RssShuffleReader.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MasterStateMachineSuiteJ.java common/src/main/scala/com/aliyun/emr/rss/common/rpc/netty/NettyRpcEnv.scala client/src/main/java/org/apache/celeborn/client/read/RetryingChunkClient.java server-worker/src/test/scala/com/aliyun/emr/rss/service/deploy/cluster/ClusterReadWriteTest.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java common/src/main/scala/org/apache/celeborn/common/metrics/MetricsSystem.scala client/src/main/java/org/apache/celeborn/client/read/DfsPartitionReader.java common/src/main/java/org/apache/celeborn/common/network/server/TransportServer.java client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/metrics/source/JVMSource.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala server-worker/src/test/java/com/aliyun/emr/rss/service/deploy/worker/FileWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/rpc/RpcEnv.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java client/src/main/java/org/apache/celeborn/client/compress/Compressor.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/test/scala/org/apache/celeborn/common/CelebornConfSuite.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java client/src/main/scala/org/apache/celeborn/client/ShuffleClientHelper.scala sbin/restart-worker.sh client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala ... |
| 3. | chengpan@apache.org | zky.zhoukeyong@alibaba-inc.com |
172 shared files
CONFIGURATION_GUIDE.md common/src/main/scala/com/aliyun/emr/rss/common/protocol/message/ControlMessages.scala client/src/test/java/org/apache/celeborn/client/ShuffleClientBaseSuiteJ.java client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala docs/index.md docker/helm/templates/configmap.yaml server-master/src/main/proto/Resource.proto common/src/main/scala/com/aliyun/emr/rss/common/RssConf.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala common/src/main/scala/org/apache/celeborn/common/RssConf.scala client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java common/src/main/java/com/aliyun/emr/rss/common/network/server/MemoryTracker.java client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/FetchHandler.scala client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornShuffleReader.scala client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java common/src/test/java/org/apache/celeborn/common/network/RequestTimeoutIntegrationSuiteJ.java server-master/src/main/scala/com/aliyun/emr/rss/service/deploy/master/Master.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java common/src/test/scala/org/apache/celeborn/common/RssConfSuite.scala client/src/main/java/org/apache/celeborn/client/write/DataPusher.java docs/README.md server-master/src/main/scala/com/aliyun/emr/rss/service/deploy/master/MasterSource.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/test/scala/com/aliyun/emr/rss/common/meta/WorkerInfoSuite.scala common/src/main/scala/com/aliyun/emr/rss/common/serializer/JavaSerializer.scala common/src/main/java/com/aliyun/emr/rss/common/network/util/TransportFrameDecoder.java common/src/main/scala/org/apache/celeborn/common/rpc/netty/Dispatcher.scala server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/Controller.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala common/src/main/scala/org/apache/celeborn/common/rpc/RpcEndpointRef.scala common/src/test/scala/org/apache/celeborn/common/quota/BaseQuotaManagerSuite.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/Source.scala client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java common/src/test/java/org/apache/celeborn/common/network/RpcIntegrationSuiteJ.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RetryReviveTest.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala common/src/main/java/org/apache/celeborn/common/network/util/NettyMemoryMetrics.java README.md server-common/pom.xml master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java common/src/main/scala/org/apache/celeborn/common/metrics/source/JVMCPUSource.scala client/src/test/java/org/apache/celeborn/client/compress/CodecSuite.java common/src/test/java/org/apache/celeborn/common/haclient/RssHARetryClientSuiteJ.java client-spark/shuffle-manager-2/pom.xml client-spark/shuffle-manager-2/src/main/scala/org/apache/spark/shuffle/rss/RssShuffleFallbackPolicyRunner.scala common/src/main/scala/org/apache/celeborn/common/rpc/RpcAddress.scala client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/RssShuffleReader.scala sbin/start-master.sh common/src/test/java/org/apache/celeborn/common/network/ChunkFetchIntegrationSuiteJ.java common/src/test/scala/com/aliyun/emr/rss/common/RssConfSuite.scala client/src/main/java/org/apache/celeborn/client/write/PushState.java worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala common/src/main/scala/com/aliyun/emr/rss/common/meta/WorkerInfo.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java sbin/start-worker.sh master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client-spark/shuffle-manager-3/pom.xml client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java common/src/test/scala/org/apache/celeborn/RssFunSuite.scala client/src/main/scala/com/aliyun/emr/rss/client/write/LifecycleManager.scala common/src/main/java/com/aliyun/emr/rss/common/network/client/TransportResponseHandler.java common/src/main/java/org/apache/celeborn/common/haclient/MasterNotLeaderException.java server-worker/src/test/scala/org/apache/celeborn/service/deploy/MiniClusterFeature.scala common/src/main/scala/org/apache/celeborn/common/rpc/RpcEndpointAddress.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigEntry.scala server-worker/src/main/java/com/aliyun/emr/rss/service/deploy/worker/storage/PartitionFilesSorter.java docker/helm/Chart.yaml client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/pom.xml client/src/main/scala/org/apache/celeborn/client/write/LifecycleManager.scala conf/metrics.properties.template client-spark/shuffle-manager-3/src/main/scala/org/apache/spark/shuffle/rss/RssShuffleReader.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MasterStateMachineSuiteJ.java common/src/main/scala/com/aliyun/emr/rss/common/rpc/netty/NettyRpcEnv.scala client/src/main/java/org/apache/celeborn/client/read/RetryingChunkClient.java server-worker/src/test/scala/com/aliyun/emr/rss/service/deploy/cluster/ClusterReadWriteTest.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java sbin/stop-master.sh client/src/main/java/org/apache/celeborn/client/read/DfsPartitionReader.java server-master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/scala/org/apache/celeborn/common/rpc/RpcEnv.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java client/src/main/java/org/apache/celeborn/client/compress/Compressor.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SendBufferPool.java common/src/test/scala/org/apache/celeborn/common/util/PbSerDeUtilsTest.scala common/src/main/scala/org/apache/celeborn/common/serializer/SerializationDebugger.scala client-flink/flink-1.15/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java common/src/test/scala/org/apache/celeborn/common/CelebornConfSuite.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java client/src/main/scala/org/apache/celeborn/client/ShuffleClientHelper.scala sbin/restart-worker.sh pom.xml ... |
| 4. | fengmingxiao.fmx@alibaba-inc.com | chengpan@apache.org |
134 shared files
client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/RssShuffleFallbackPolicyRunner.scala CONFIGURATION_GUIDE.md common/src/main/scala/com/aliyun/emr/rss/common/protocol/message/ControlMessages.scala server-master/src/test/scala/com/aliyun/emr/rss/service/deploy/master/MasterSuite.scala client-spark/spark-3/pom.xml docs/deploy.md worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ClusterReadWriteSuite.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala server-master/src/main/proto/Resource.proto common/src/main/scala/com/aliyun/emr/rss/common/RssConf.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala common/src/main/scala/org/apache/celeborn/common/RssConf.scala client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/FetchHandler.scala server-master/src/main/scala/com/aliyun/emr/rss/service/deploy/master/Master.scala common/src/test/scala/org/apache/celeborn/common/RssConfSuite.scala common/src/test/java/com/aliyun/emr/rss/common/network/TransportClientFactorySuiteJ.java server-master/src/main/scala/com/aliyun/emr/rss/service/deploy/master/MasterSource.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/test/scala/com/aliyun/emr/rss/common/meta/WorkerInfoSuite.scala client-spark/shuffle-manager-2/src/test/java/org/apache/spark/shuffle/rss/RssShuffleWriterSuiteJ.java server-worker/src/test/scala/com/aliyun/emr/rss/service/deploy/SparkTestBase.scala .github/workflows/regression_manual.yml bin/celeborn-class server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/Controller.scala .github/workflows/regression.yml server-worker/src/main/java/com/aliyun/emr/rss/service/deploy/worker/storage/FileWriter.java server-master/src/test/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/ha/MasterStateMachineSuiteJ.java .github/workflows/benchmark.yml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala common/src/main/scala/com/aliyun/emr/rss/common/meta/PartitionLocationInfo.scala README.md master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MetaHandler.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java client-spark/shuffle-manager-2/pom.xml common/src/main/java/com/aliyun/emr/rss/common/network/server/OneForOneStreamManager.java client/src/main/java/com/aliyun/emr/rss/client/ShuffleClient.java sbin/start-master.sh common/src/test/scala/com/aliyun/emr/rss/common/RssConfSuite.scala common/src/main/scala/com/aliyun/emr/rss/common/meta/WorkerInfo.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala common/src/main/java/com/aliyun/emr/rss/common/utils/PBSerDeUtils.java common/src/main/java/com/aliyun/emr/rss/common/protocol/StorageInfo.java sbin/start-worker.sh client/src/main/java/com/aliyun/emr/rss/client/read/RetryingChunkClient.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/FlushTask.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client-spark/shuffle-manager-3/pom.xml server-master/src/test/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/ha/RatisBaseSuiteJ.java client/src/main/scala/com/aliyun/emr/rss/client/write/LifecycleManager.scala dev/check-spark-2.4.sh server-worker/src/main/java/com/aliyun/emr/rss/service/deploy/worker/storage/PartitionFilesSorter.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/pom.xml docs/configuration/metrics.md client-spark/shuffle-manager-3/src/main/scala/org/apache/spark/shuffle/rss/RssShuffleReader.scala server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/ha/MetaHandler.java common/src/test/java/com/aliyun/emr/rss/common/network/TransportResponseHandlerSuiteJ.java server-worker/src/test/scala/com/aliyun/emr/rss/service/deploy/cluster/ClusterReadWriteTest.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java sbin/stop-master.sh client-spark/spark-2/pom.xml client/src/main/java/org/apache/celeborn/client/read/DfsPartitionReader.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala server-master/src/test/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java common/src/test/scala/org/apache/celeborn/common/CelebornConfSuite.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java sbin/restart-worker.sh server-worker/src/test/java/com/aliyun/emr/rss/service/deploy/worker/storage/FileWriterSuiteJ.java pom.xml common/src/main/java/com/aliyun/emr/rss/common/network/server/ChannelsLimiter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/WorkerSource.scala server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/PushDataHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitor.scala client/src/main/java/com/aliyun/emr/rss/client/read/WorkerPartitionReader.java master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java sbin/stop-all.sh server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/storage/StorageManager.scala docs/configuration/network.md server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/MetaUtil.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java sbin/stop-worker.sh client-spark/shuffle-manager-3/src/test/java/org/apache/spark/shuffle/rss/RssShuffleWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala sbin/start-all.sh server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/IMetadataHandler.java common/src/test/java/com/aliyun/emr/rss/common/network/ChunkFetchIntegrationSuiteJ.java master/src/main/proto/Resource.proto common/src/main/java/com/aliyun/emr/rss/common/utils/ShuffleBlockInfoUtils.java dev/checkstyle.xml master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java common/src/test/java/com/aliyun/emr/rss/common/haclient/RssHARetryClientSuiteJ.java ... |
| 5. | angers.zhu@gmail.com | fengmingxiao.fmx@alibaba-inc.com |
117 shared files
client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/RssShuffleFallbackPolicyRunner.scala sbin/celeborn-daemon.sh CONFIGURATION_GUIDE.md server-worker/src/main/java/com/aliyun/emr/rss/service/deploy/worker/FileWriter.java toolkit/scripts/genConfs.py common/src/main/java/com/aliyun/emr/rss/common/network/server/FileInfo.java common/src/main/scala/com/aliyun/emr/rss/common/protocol/message/ControlMessages.scala server-master/src/test/scala/com/aliyun/emr/rss/service/deploy/master/MasterSuite.scala server-worker/src/test/java/com/aliyun/emr/rss/service/deploy/worker/PartitionFilesSorterSuiteJ.java docs/deploy.md worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ClusterReadWriteSuite.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala server-master/src/main/proto/Resource.proto common/src/main/scala/com/aliyun/emr/rss/common/RssConf.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala common/src/main/scala/org/apache/celeborn/common/RssConf.scala assets/grafana/rss-dashboard.json client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/FetchHandler.scala server-master/src/main/scala/com/aliyun/emr/rss/service/deploy/master/Master.scala common/src/test/scala/org/apache/celeborn/common/RssConfSuite.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala client-spark/shuffle-manager-2/src/test/java/org/apache/spark/shuffle/rss/RssShuffleWriterSuiteJ.java server-worker/src/test/scala/com/aliyun/emr/rss/service/deploy/SparkTestBase.scala bin/celeborn-class server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/Controller.scala server-worker/src/main/java/com/aliyun/emr/rss/service/deploy/worker/storage/FileWriter.java assets/grafana/celeborn-dashboard.json worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala common/src/main/scala/com/aliyun/emr/rss/common/meta/PartitionLocationInfo.scala README.md master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MetaHandler.java sbin/celeborn-config.sh master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java client/src/main/java/com/aliyun/emr/rss/client/ShuffleClient.java sbin/start-master.sh common/src/main/scala/com/aliyun/emr/rss/common/meta/WorkerInfo.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala common/src/main/java/com/aliyun/emr/rss/common/utils/PBSerDeUtils.java common/src/main/java/org/apache/celeborn/common/network/protocol/TransportMessage.java sbin/start-worker.sh client/src/main/java/com/aliyun/emr/rss/client/read/RetryingChunkClient.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client/src/main/scala/com/aliyun/emr/rss/client/write/LifecycleManager.scala server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/LocalStorageManager.scala server-worker/src/main/java/com/aliyun/emr/rss/service/deploy/worker/storage/PartitionFilesSorter.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/pom.xml docs/configuration/metrics.md client-spark/shuffle-manager-3/src/main/scala/org/apache/spark/shuffle/rss/RssShuffleReader.scala server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/ha/MetaHandler.java server-worker/src/test/scala/com/aliyun/emr/rss/service/deploy/cluster/ClusterReadWriteTest.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java client/src/main/java/org/apache/celeborn/client/read/DfsPartitionReader.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala server-worker/src/test/java/com/aliyun/emr/rss/service/deploy/worker/FileWriterSuiteJ.java common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala server-master/src/test/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java common/src/test/scala/org/apache/celeborn/common/CelebornConfSuite.scala server-worker/src/main/java/com/aliyun/emr/rss/service/deploy/worker/PartitionFilesSorter.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java sbin/restart-worker.sh server-worker/src/test/java/com/aliyun/emr/rss/service/deploy/worker/storage/FileWriterSuiteJ.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/WorkerSource.scala server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/PushDataHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitor.scala master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java sbin/stop-all.sh server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/storage/StorageManager.scala docs/configuration/network.md worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java sbin/stop-worker.sh client-spark/shuffle-manager-3/src/test/java/org/apache/spark/shuffle/rss/RssShuffleWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala common/src/main/scala/org/apache/celeborn/common/util/CelebornHadoopUtils.scala sbin/start-all.sh server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/IMetadataHandler.java master/src/main/proto/Resource.proto master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java common/src/test/java/com/aliyun/emr/rss/common/haclient/RssHARetryClientSuiteJ.java docs/configuration/client.md docs/configuration/master.md server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/Worker.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/SingleMasterMetaManager.java client/src/test/java/com/aliyun/emr/rss/client/read/RetryingChunkClientSuiteJ.java server-worker/src/test/java/com/aliyun/emr/rss/service/deploy/worker/storage/PartitionFilesSorterSuiteJ.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java server-master/src/test/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala client/src/main/java/com/aliyun/emr/rss/client/ShuffleClientImpl.java METRICS.md ... |
| 6. | 30563796+nafiyaix@users.noreply.github.com | chengpan@apache.org |
105 shared files
client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/RssShuffleFallbackPolicyRunner.scala CONFIGURATION_GUIDE.md common/src/main/scala/com/aliyun/emr/rss/common/protocol/message/ControlMessages.scala worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ClusterReadWriteSuite.scala client/src/main/java/com/aliyun/emr/rss/client/compress/RssLz4Compressor.java server-master/src/main/proto/Resource.proto common/src/main/scala/com/aliyun/emr/rss/common/RssConf.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala common/src/main/scala/org/apache/celeborn/common/metrics/MetricLabels.scala client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java server-master/src/main/scala/com/aliyun/emr/rss/service/deploy/master/Master.scala client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/RssShuffleHandle.scala common/src/test/scala/com/aliyun/emr/rss/common/meta/WorkerInfoSuite.scala client/src/main/java/com/aliyun/emr/rss/client/compress/RssLz4Decompressor.java client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/RssShuffleHandle.scala client/src/main/java/com/aliyun/emr/rss/client/compress/RssZstdCompressor.java server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/Controller.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala client/src/main/java/com/aliyun/emr/rss/client/compress/RssLz4Trait.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/IMetadataHandler.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala README.md common/src/main/java/com/aliyun/emr/rss/common/util/PbSerDeUtils.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MetaHandler.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/MetaUtil.java client/src/main/java/com/aliyun/emr/rss/client/ShuffleClient.java common/src/test/scala/com/aliyun/emr/rss/common/RssConfSuite.scala common/src/main/scala/com/aliyun/emr/rss/common/meta/WorkerInfo.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/RssShuffleWriterSuiteJ.java server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/ha/HARaftServer.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/ObservedDevice.scala client/src/main/scala/com/aliyun/emr/rss/client/write/LifecycleManager.scala common/src/test/scala/org/apache/celeborn/common/metrics/source/CelebornSourceSuite.scala server-worker/src/main/java/com/aliyun/emr/rss/service/deploy/worker/storage/PartitionFilesSorter.java common/pom.xml client/src/main/java/com/aliyun/emr/rss/client/compress/Compressor.java docs/configuration/metrics.md common/src/main/scala/org/apache/celeborn/common/identity/UserIdentifier.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MasterStateMachineSuiteJ.java server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/ha/MetaHandler.java server-worker/src/test/scala/com/aliyun/emr/rss/service/deploy/cluster/ClusterReadWriteTest.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/RssShuffleWriterSuiteJ.java client/src/main/java/com/aliyun/emr/rss/client/compress/Decompressor.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala server-master/src/test/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java worker/src/test/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitorSuite.scala common/src/test/scala/org/apache/celeborn/common/util/PbSerDeUtilsTest.scala server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java client/src/main/scala/org/apache/celeborn/client/ShuffleClientHelper.scala pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client-spark/shuffle-manager-common/src/main/java/org/apache/spark/shuffle/rss/SortBasedPusher.java server-worker/src/main/java/com/aliyun/emr/rss/service/deploy/worker/LevelDBProvider.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitor.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorterSuiteJ.java client/src/main/java/com/aliyun/emr/rss/client/compress/RssZstdTrait.java server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/storage/StorageManager.scala docs/configuration/network.md common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/MetaUtil.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala common/src/main/java/org/apache/celeborn/common/haclient/RssHARetryClient.java client/pom.xml server-worker/src/test/scala/com/aliyun/emr/rss/service/deploy/worker/storage/DeviceMonitorSuite.scala server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/IMetadataHandler.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java docs/configuration/client.md docs/configuration/master.md server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/Worker.scala server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/SingleMasterMetaManager.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/ShuffleRecoverHelper.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java server-master/src/test/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java common/src/test/scala/org/apache/celeborn/common/identity/UserIdentifierSuite.scala client/src/main/java/com/aliyun/emr/rss/client/ShuffleClientImpl.java server-master/pom.xml client/src/main/java/com/aliyun/emr/rss/client/read/RssInputStream.java client-spark/shuffle-manager-2/src/main/java/org/apache/spark/shuffle/rss/SortBasedShuffleWriter.java client/src/main/java/com/aliyun/emr/rss/client/compress/RssZstdDecompressor.java client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/RssShuffleFallbackPolicyRunner.scala common/src/main/scala/com/aliyun/emr/rss/common/util/Utils.scala client-spark/shuffle-manager-common/src/main/java/org/apache/spark/shuffle/rss/ShuffleInMemorySorter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala docs/configuration.md server-worker/src/test/scala/com/aliyun/emr/rss/service/deploy/integration/SkewJoinTest.scala server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/AbstractMetaManager.java client-spark/shuffle-manager-3/src/main/java/org/apache/spark/shuffle/rss/SortBasedShuffleWriter.java client/src/test/java/com/aliyun/emr/rss/client/ShuffleClientSuiteJ.java ... |
| 7. | ethanfeng@apache.org | angers.zhu@gmail.com |
95 shared files
common/src/main/java/org/apache/celeborn/common/network/server/StreamManager.java assets/img/shuffle-procedure.jpg service/src/main/scala/org/apache/celeborn/server/common/HttpService.scala common/src/main/java/org/apache/celeborn/common/network/util/NettyUtils.java docs/deploy.md common/src/main/scala/org/apache/celeborn/common/metrics/MetricsConfig.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriterSuiteJ.java assets/grafana/rss-dashboard.json client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleMaster.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateDelegation.java docs/configuration/index.md docs/monitoring.md master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/IMetadataHandler.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HARaftServer.java client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java client/src/main/java/org/apache/celeborn/client/read/Replica.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala README.md master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MetaHandler.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/CreditStreamManagerSuiteJ.java service/src/main/scala/org/apache/celeborn/server/common/http/HttpRequestHandler.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala sbin/start-worker.sh client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/utils/FlinkUtils.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala common/src/main/java/org/apache/celeborn/common/network/server/OneForOneStreamManager.java .gitignore master/src/test/scala/org/apache/celeborn/service/deploy/master/AppDiskUsageMetricSuite.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigEntry.scala common/src/main/java/org/apache/celeborn/common/util/ShutdownHookManager.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/network/RequestTimeoutIntegrationSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala common/pom.xml common/src/main/java/org/apache/celeborn/common/network/server/memory/MemoryManager.java client/src/main/java/org/apache/celeborn/client/read/RetryingChunkClient.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResource.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java docs/configuration/quota.md client/src/main/java/org/apache/celeborn/client/read/DfsPartitionReader.java common/src/main/java/org/apache/celeborn/common/network/server/TransportServer.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/ChunkFetchIntegrationSuiteJ.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportResponseHandler.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitor.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/rpc/netty/NettyRpcEnv.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGate.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorterSuiteJ.java client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala docs/configuration/network.md worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala sbin/start-all.sh worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/ChannelsLimiter.java common/src/main/java/org/apache/celeborn/common/network/TransportContext.java master/src/main/proto/Resource.proto master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java common/src/main/java/org/apache/celeborn/common/network/util/TransportConf.java docs/configuration/client.md docs/configuration/master.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteBufferStreamReader.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java client/src/test/java/org/apache/celeborn/client/read/RetryingChunkClientSuiteJ.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client/src/main/java/org/apache/celeborn/client/read/RssInputStream.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/MemoryManager.java tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/WordCountTest.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/test/java/org/apache/celeborn/common/network/TransportClientFactorySuiteJ.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java LICENSE-binary docs/configuration/worker.md NOTICE-binary common/src/main/scala/org/apache/celeborn/common/identity/IdentityProvider.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/SingleMasterMetaManager.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala common/src/test/java/org/apache/celeborn/common/network/TransportResponseHandlerSuiteJ.java |
| 8. | chengpan@apache.org | ethanfeng@apache.org |
95 shared files
service/src/main/scala/org/apache/celeborn/server/common/HttpService.scala client-flink/flink-1.17/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleServiceFactorySuitJ.java docs/deploy.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java common/src/test/java/org/apache/celeborn/common/network/RequestTimeoutIntegrationSuiteJ.java client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleServiceFactorySuitJ.java .asf.yaml tests/flink-it/pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/rpc/netty/Dispatcher.scala docs/configuration/index.md docs/monitoring.md master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/IMetadataHandler.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HARaftServer.java client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java common/src/test/java/org/apache/celeborn/common/network/RpcIntegrationSuiteJ.java conf/log4j2.xml.template worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala common/src/main/java/org/apache/celeborn/common/network/util/NettyMemoryMetrics.java README.md master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MetaHandler.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java service/src/main/scala/org/apache/celeborn/server/common/http/HttpRequestHandler.scala common/src/test/java/org/apache/celeborn/common/network/ChunkFetchIntegrationSuiteJ.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala sbin/start-worker.sh worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/FlushTask.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala .gitignore client-flink/flink-1.15/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleServiceFactorySuitJ.java common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigEntry.scala common/pom.xml NOTICE client/src/main/java/org/apache/celeborn/client/read/RetryingChunkClient.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java client/src/main/java/org/apache/celeborn/client/read/DfsPartitionReader.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java client-flink/flink-1.15/pom.xml common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/test/scala/org/apache/celeborn/common/util/PbSerDeUtilsTest.scala client-flink/flink-1.15/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/buffer/SortBuffer.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitor.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/rpc/netty/NettyRpcEnv.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorterSuiteJ.java docs/configuration/network.md worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java client-flink/flink-1.17/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala sbin/start-all.sh worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/ChannelsLimiter.java client-flink/flink-1.17/pom.xml worker/pom.xml master/src/main/proto/Resource.proto master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java common/src/main/java/org/apache/celeborn/common/network/util/TransportConf.java docs/configuration/client.md docs/configuration/master.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java CONTRIBUTING.md client/src/test/java/org/apache/celeborn/client/read/RetryingChunkClientSuiteJ.java common/src/main/java/org/apache/celeborn/common/util/JavaUtils.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client/src/main/java/org/apache/celeborn/client/read/RssInputStream.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/MemoryManager.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java build/make-distribution.sh dev/reformat worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/test/java/org/apache/celeborn/common/network/TransportClientFactorySuiteJ.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGateSuiteJ.java .github/workflows/maven.yml docs/configuration/worker.md NOTICE-binary common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/SingleMasterMetaManager.java .scalafmt.conf worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/congestcontrol/CongestionController.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/buffer/BufferPacker.java |
| 9. | 30563796+nafiyaix@users.noreply.github.com | angers.zhu@gmail.com |
90 shared files
client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/RssShuffleFallbackPolicyRunner.scala CONFIGURATION_GUIDE.md common/src/main/scala/com/aliyun/emr/rss/common/protocol/message/ControlMessages.scala worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ClusterReadWriteSuite.scala client/src/main/java/com/aliyun/emr/rss/client/compress/RssLz4Compressor.java server-master/src/main/proto/Resource.proto common/src/main/scala/com/aliyun/emr/rss/common/RssConf.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala common/src/main/scala/org/apache/celeborn/common/metrics/MetricLabels.scala client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java server-master/src/main/scala/com/aliyun/emr/rss/service/deploy/master/Master.scala client/src/main/java/com/aliyun/emr/rss/client/compress/RssLz4Decompressor.java server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/Controller.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala client/src/main/java/com/aliyun/emr/rss/client/compress/RssLz4Trait.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/IMetadataHandler.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala README.md common/src/main/scala/org/apache/celeborn/common/quota/Quota.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MetaHandler.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java client/src/main/java/com/aliyun/emr/rss/client/ShuffleClient.java common/src/main/scala/com/aliyun/emr/rss/common/meta/WorkerInfo.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/RssShuffleWriterSuiteJ.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/ObservedDevice.scala client/src/main/scala/com/aliyun/emr/rss/client/write/LifecycleManager.scala server-worker/src/main/java/com/aliyun/emr/rss/service/deploy/worker/storage/PartitionFilesSorter.java common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala common/pom.xml docs/configuration/metrics.md common/src/main/scala/org/apache/celeborn/common/identity/UserIdentifier.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MasterStateMachineSuiteJ.java server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/ha/MetaHandler.java server-worker/src/test/scala/com/aliyun/emr/rss/service/deploy/cluster/ClusterReadWriteTest.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java docs/configuration/quota.md client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/RssShuffleWriterSuiteJ.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/test/scala/com/aliyun/emr/rss/common/identity/UserIdentifierSuite.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala server-master/src/test/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java worker/src/test/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitorSuite.scala server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java client/src/main/scala/org/apache/celeborn/client/ShuffleClientHelper.scala pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala server-worker/src/main/java/com/aliyun/emr/rss/service/deploy/worker/LevelDBProvider.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitor.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorterSuiteJ.java client/src/main/java/com/aliyun/emr/rss/client/compress/RssZstdTrait.java server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/storage/StorageManager.scala docs/configuration/network.md common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala common/src/main/java/org/apache/celeborn/common/haclient/RssHARetryClient.java server-worker/src/test/scala/com/aliyun/emr/rss/service/deploy/worker/storage/DeviceMonitorSuite.scala server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/IMetadataHandler.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java docs/configuration/client.md docs/configuration/master.md server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/Worker.scala server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/SingleMasterMetaManager.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java server-master/src/test/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java client/src/main/java/com/aliyun/emr/rss/client/ShuffleClientImpl.java client/src/main/java/com/aliyun/emr/rss/client/read/RssInputStream.java common/src/main/java/org/apache/celeborn/common/protocol/PartitionLocation.java common/src/main/scala/org/apache/celeborn/common/quota/QuotaManager.scala client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/RssShuffleFallbackPolicyRunner.scala common/src/main/scala/com/aliyun/emr/rss/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/quota/DefaultQuotaManager.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/test/scala/org/apache/celeborn/common/quota/DefaultQuotaManagerSuite.scala docs/configuration.md server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/AbstractMetaManager.java client/src/test/java/com/aliyun/emr/rss/client/ShuffleClientSuiteJ.java docs/configuration/worker.md common/src/main/scala/org/apache/celeborn/common/identity/IdentityProvider.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/SingleMasterMetaManager.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala |
| 10. | fengmingxiao.fmx@alibaba-inc.com | zky.zhoukeyong@alibaba-inc.com |
90 shared files
CONFIGURATION_GUIDE.md server-worker/src/main/java/com/aliyun/emr/rss/service/deploy/worker/FileWriter.java common/src/main/java/com/aliyun/emr/rss/common/network/server/FileInfo.java common/src/main/scala/com/aliyun/emr/rss/common/protocol/message/ControlMessages.scala server-worker/src/test/java/com/aliyun/emr/rss/service/deploy/worker/PartitionFilesSorterSuiteJ.java tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala server-master/src/main/proto/Resource.proto common/src/main/scala/com/aliyun/emr/rss/common/RssConf.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala common/src/main/scala/org/apache/celeborn/common/RssConf.scala assets/grafana/rss-dashboard.json client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/FetchHandler.scala server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/MasterUtil.java server-master/src/main/scala/com/aliyun/emr/rss/service/deploy/master/Master.scala common/src/test/scala/org/apache/celeborn/common/RssConfSuite.scala common/src/main/java/org/apache/celeborn/common/protocol/StorageInfo.java server-master/src/main/scala/com/aliyun/emr/rss/service/deploy/master/MasterSource.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/test/scala/com/aliyun/emr/rss/common/meta/WorkerInfoSuite.scala server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/Controller.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala README.md master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java client-spark/shuffle-manager-2/pom.xml sbin/start-master.sh common/src/test/scala/com/aliyun/emr/rss/common/RssConfSuite.scala common/src/main/scala/com/aliyun/emr/rss/common/meta/WorkerInfo.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/main/java/org/apache/celeborn/common/network/protocol/TransportMessage.java sbin/start-worker.sh master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client-spark/shuffle-manager-3/pom.xml client/src/main/scala/com/aliyun/emr/rss/client/write/LifecycleManager.scala server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/LocalStorageManager.scala server-worker/src/main/java/com/aliyun/emr/rss/service/deploy/worker/storage/PartitionFilesSorter.java server-worker/src/test/scala/com/aliyun/emr/rss/service/deploy/worker/DeviceMonitorSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/pom.xml client-spark/shuffle-manager-3/src/main/scala/org/apache/spark/shuffle/rss/RssShuffleReader.scala server-worker/src/test/scala/com/aliyun/emr/rss/service/deploy/cluster/ClusterReadWriteTest.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java sbin/stop-master.sh client/src/main/java/org/apache/celeborn/client/read/DfsPartitionReader.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala server-worker/src/test/java/com/aliyun/emr/rss/service/deploy/worker/FileWriterSuiteJ.java common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/test/scala/org/apache/celeborn/common/CelebornConfSuite.scala server-master/src/test/java/com/aliyun/emr/rss/service/deploy/master/MasterUtilSuiteJ.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java sbin/restart-worker.sh common/src/main/java/org/apache/celeborn/common/meta/FileInfo.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/WorkerSource.scala server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/PushDataHandler.scala master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java docs/configuration/network.md server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/MetaUtil.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java sbin/stop-worker.sh common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/DeviceInfo.scala docs/configuration/client.md docs/configuration/master.md server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/Worker.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java server-worker/src/test/java/com/aliyun/emr/rss/service/deploy/worker/storage/PartitionFilesSorterSuiteJ.java common/src/main/scala/com/aliyun/emr/rss/common/metrics/source/AbstractSource.scala client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala client/src/main/java/com/aliyun/emr/rss/client/ShuffleClientImpl.java METRICS.md common/src/main/java/org/apache/celeborn/common/network/protocol/Message.java client/src/main/java/com/aliyun/emr/rss/client/read/RssInputStream.java client/src/main/java/org/apache/celeborn/client/read/RssInputStream.java common/src/main/scala/com/aliyun/emr/rss/common/util/Utils.scala common/src/main/java/org/apache/celeborn/common/network/protocol/OpenStream.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/SlotsAllocator.java docs/configuration.md common/src/test/scala/org/apache/celeborn/common/util/UtilsSuite.scala server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/AbstractMetaManager.java docs/configuration/worker.md server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/DeviceMonitor.scala server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala common/src/main/java/org/apache/celeborn/common/network/protocol/StreamHandle.java |
| 11. | ethanfeng@apache.org | zky.zhoukeyong@alibaba-inc.com |
83 shared files
common/src/main/java/org/apache/celeborn/common/network/server/StreamManager.java common/src/main/java/org/apache/celeborn/common/network/util/NettyUtils.java common/src/main/scala/org/apache/celeborn/common/metrics/MetricsConfig.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriterSuiteJ.java assets/grafana/rss-dashboard.json client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java common/src/test/java/org/apache/celeborn/common/network/RequestTimeoutIntegrationSuiteJ.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleMaster.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateDelegation.java common/src/main/scala/org/apache/celeborn/common/rpc/netty/Dispatcher.scala client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java common/src/test/java/org/apache/celeborn/common/network/RpcIntegrationSuiteJ.java client/src/main/java/org/apache/celeborn/client/read/Replica.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala common/src/main/java/org/apache/celeborn/common/network/util/NettyMemoryMetrics.java README.md master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java common/src/test/java/org/apache/celeborn/common/network/ChunkFetchIntegrationSuiteJ.java sbin/start-worker.sh master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala common/src/main/java/org/apache/celeborn/common/network/server/OneForOneStreamManager.java common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigEntry.scala common/src/main/java/org/apache/celeborn/common/util/ShutdownHookManager.java common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala common/pom.xml client/src/main/java/org/apache/celeborn/client/read/RetryingChunkClient.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java client/src/main/java/org/apache/celeborn/client/read/DfsPartitionReader.java common/src/main/java/org/apache/celeborn/common/network/server/TransportServer.java common/src/main/scala/org/apache/celeborn/common/identity/DefaultIdentityProvider.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/test/scala/org/apache/celeborn/common/util/PbSerDeUtilsTest.scala client-flink/flink-1.15/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java common/src/main/java/org/apache/celeborn/common/network/client/ChunkReceivedCallback.java common/src/main/java/org/apache/celeborn/common/meta/FileInfo.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala common/src/main/java/org/apache/celeborn/common/network/server/ChannelsLimiter.java common/src/main/java/org/apache/celeborn/common/network/client/TransportResponseHandler.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/rpc/netty/NettyRpcEnv.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGate.java client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala docs/configuration/network.md common/src/main/java/org/apache/celeborn/common/network/buffer/NettyManagedBuffer.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java client-flink/flink-1.17/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriter.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala common/src/main/java/org/apache/celeborn/common/network/TransportContext.java common/src/main/java/org/apache/celeborn/common/network/util/TransportConf.java docs/configuration/client.md docs/configuration/master.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteBufferStreamReader.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java CONTRIBUTING.md client/src/test/java/org/apache/celeborn/client/read/RetryingChunkClientSuiteJ.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala common/src/main/java/org/apache/celeborn/common/network/protocol/Message.java common/src/main/java/org/apache/celeborn/common/util/ShuffleBlockInfoUtils.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client/src/main/java/org/apache/celeborn/client/read/RssInputStream.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/test/java/org/apache/celeborn/common/network/TransportClientFactorySuiteJ.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGateSuiteJ.java docs/configuration/worker.md common/src/main/scala/org/apache/celeborn/common/identity/IdentityProvider.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala .scalafmt.conf common/src/test/java/org/apache/celeborn/common/network/TransportResponseHandlerSuiteJ.java |
| 12. | angers.zhu@gmail.com | zhouky@apache.org |
80 shared files
tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/HugeDataTest.scala service/src/main/scala/org/apache/celeborn/server/common/HttpService.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriterSuiteJ.java assets/grafana/rss-dashboard.json client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/PushDataTimeoutTest.scala client/src/test/java/org/apache/celeborn/client/write/DataPushQueueSuitJ.java client/src/main/java/org/apache/celeborn/client/write/DataPusher.java common/src/main/scala/org/apache/celeborn/common/meta/WorkerPartitionLocationInfo.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RssNonPipelineSortSuite.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RssHashCheckDiskSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RetryReviveTest.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala README.md master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java client/src/main/java/org/apache/celeborn/client/read/PartitionReader.java client/src/main/java/org/apache/celeborn/client/write/PushState.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/main/java/org/apache/celeborn/common/write/InFlightRequestTracker.java common/src/main/java/org/apache/celeborn/common/write/PushState.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/RssShuffleWriterSuiteJ.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/ShuffleFallbackSuite.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java master/src/main/java/org/apache/celeborn/service/deploy/master/SlotsAllocator.java common/src/main/java/org/apache/celeborn/common/network/server/memory/MemoryManager.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MasterStateMachineSuiteJ.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/RssShuffleWriterSuiteJ.java client/src/main/java/org/apache/celeborn/client/read/DfsPartitionReader.java common/src/main/java/org/apache/celeborn/common/network/server/TransportServer.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala worker/src/test/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitorSuite.scala common/src/test/scala/org/apache/celeborn/common/CelebornConfSuite.scala pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RssPipelineSortSuite.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala common/src/main/java/org/apache/celeborn/common/protocol/message/StatusCode.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/SkewJoinSuite.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/PushdataTimeoutTest.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigBuilder.scala master/src/main/proto/Resource.proto docs/configuration/client.md docs/configuration/master.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/SparkTestBase.scala common/src/main/scala/org/apache/celeborn/common/meta/ShufflePartitionLocationInfo.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client/src/main/java/org/apache/celeborn/client/write/DataPushQueue.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RetryCommitFilesTest.scala common/src/main/java/org/apache/celeborn/common/protocol/PartitionLocation.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client/src/main/java/org/apache/celeborn/client/read/RssInputStream.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/test/java/org/apache/celeborn/common/network/TransportClientFactorySuiteJ.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java LICENSE-binary docs/configuration/worker.md NOTICE-binary client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala |
| 13. | chengpan@apache.org | zhouky@apache.org |
73 shared files
tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/HugeDataTest.scala service/src/main/scala/org/apache/celeborn/server/common/HttpService.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RssHashSuite.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/PushDataTimeoutTest.scala client/src/main/java/org/apache/celeborn/client/write/DataPusher.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RssNonPipelineSortSuite.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RssHashCheckDiskSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java common/src/test/java/org/apache/celeborn/common/network/RpcIntegrationSuiteJ.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RetryReviveTest.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala README.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/buffer/PartitionSortedBuffer.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/MetaUtil.java client/src/main/java/org/apache/celeborn/client/write/PushState.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/main/java/org/apache/celeborn/common/write/PushState.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/RssShuffleWriterSuiteJ.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java master/src/main/java/org/apache/celeborn/service/deploy/master/SlotsAllocator.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MasterStateMachineSuiteJ.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/RssShuffleWriterSuiteJ.java client/src/main/java/org/apache/celeborn/client/read/DfsPartitionReader.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala worker/src/test/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitorSuite.scala common/src/test/scala/org/apache/celeborn/common/util/PbSerDeUtilsTest.scala common/src/test/scala/org/apache/celeborn/common/CelebornConfSuite.scala pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RssPipelineSortSuite.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/SkewJoinSuite.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigBuilder.scala master/src/main/proto/Resource.proto docs/configuration/client.md docs/configuration/master.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/SparkTestBase.scala common/src/main/java/org/apache/celeborn/common/util/JavaUtils.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RetryCommitFilesTest.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client/src/main/java/org/apache/celeborn/client/read/RssInputStream.java .rat-excludes client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/java/org/apache/celeborn/common/meta/FileManagedBuffers.java common/src/test/java/org/apache/celeborn/common/network/TransportClientFactorySuiteJ.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RssSortSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java .github/workflows/maven.yml docs/configuration/worker.md NOTICE-binary common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala |
| 14. | angers.zhu@gmail.com | cfmcgrady@gmail.com |
72 shared files
service/src/main/scala/org/apache/celeborn/server/common/HttpService.scala client/src/test/java/org/apache/celeborn/client/ShuffleClientBaseSuiteJ.java master/pom.xml assets/grafana/rss-dashboard.json tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/PushDataTimeoutTest.scala client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java client/src/main/java/org/apache/celeborn/client/write/DataPusher.java common/src/main/scala/org/apache/celeborn/common/meta/WorkerPartitionLocationInfo.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala docs/monitoring.md common/src/test/scala/org/apache/celeborn/common/meta/WorkerPartitionLocationInfoSuite.scala client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala client/src/main/scala/org/apache/celeborn/client/WorkerStatusTracker.scala client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriterSuiteJ.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/main/java/org/apache/celeborn/common/write/PushState.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java .gitignore common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/pom.xml master/src/main/java/org/apache/celeborn/service/deploy/master/SlotsAllocator.java common/src/main/java/org/apache/celeborn/common/network/server/TransportServer.java worker/src/test/scala/org/apache/celeborn/service/deploy/MiniClusterFeature.scala client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriterSuiteJ.java service/src/main/scala/org/apache/celeborn/server/common/http/HttpServer.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportResponseHandler.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java docs/migration.md worker/src/test/scala/org/apache/celeborn/service/deploy/worker/storage/WorkerSuite.scala client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala docs/configuration/columnar-shuffle.md client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/CelebornShuffleWriterSuiteBase.java common/src/main/java/org/apache/celeborn/common/protocol/message/StatusCode.java common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/network/CelebornRackResolver.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java master/src/main/scala/org/apache/celeborn/service/deploy/master/clustermeta/ha/MasterClusterInfo.scala common/src/main/scala/org/apache/celeborn/common/meta/ShufflePartitionLocationInfo.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala client/src/main/scala/org/apache/celeborn/client/CommitManager.scala METRICS.md client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java common/src/main/java/org/apache/celeborn/common/protocol/PartitionLocation.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/MemoryManager.java client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriterSuiteJ.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriterSuiteJ.java service/src/main/scala/org/apache/celeborn/server/common/Service.scala common/src/test/scala/org/apache/celeborn/common/util/UtilsSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/CelebornShuffleWriterSuiteBase.java client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala |
| 15. | zhouky@apache.org | zky.zhoukeyong@alibaba-inc.com |
70 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriterSuiteJ.java assets/grafana/rss-dashboard.json client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java client/src/test/java/org/apache/celeborn/client/write/DataPushQueueSuitJ.java client/src/main/java/org/apache/celeborn/client/write/DataPusher.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/test/java/org/apache/celeborn/common/network/StreamTestHelper.java client/src/main/scala/org/apache/celeborn/client/commit/MapPartitionCommitHandler.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java common/src/test/java/org/apache/celeborn/common/network/RpcIntegrationSuiteJ.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RetryReviveTest.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala README.md master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java client/src/main/java/org/apache/celeborn/client/read/PartitionReader.java client/src/main/java/org/apache/celeborn/client/write/PushState.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/main/java/org/apache/celeborn/common/write/InFlightRequestTracker.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MasterStateMachineSuiteJ.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java common/src/main/java/org/apache/celeborn/common/network/util/LimitedInputStream.java client/src/main/java/org/apache/celeborn/client/read/DfsPartitionReader.java common/src/main/java/org/apache/celeborn/common/network/server/TransportServer.java common/src/main/java/org/apache/celeborn/common/network/client/ChunkFetchFailureException.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/test/scala/org/apache/celeborn/common/util/PbSerDeUtilsTest.scala common/src/test/scala/org/apache/celeborn/common/CelebornConfSuite.scala common/src/main/java/org/apache/celeborn/common/meta/FileInfo.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala common/src/main/java/org/apache/celeborn/common/protocol/message/StatusCode.java common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java assets/spark-patch/RSS_RDA_spark3.patch worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriter.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigBuilder.scala docs/configuration/client.md docs/configuration/master.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client/src/main/java/org/apache/celeborn/client/write/DataPushQueue.java common/src/main/java/org/apache/celeborn/common/protocol/PartitionLocation.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client/src/main/java/org/apache/celeborn/client/read/RssInputStream.java common/src/main/java/org/apache/celeborn/common/network/buffer/FileSegmentManagedBuffer.java assets/spark-patch/RSS_RDA_spark2.patch client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/java/org/apache/celeborn/common/meta/FileManagedBuffers.java common/src/test/java/org/apache/celeborn/common/network/TransportClientFactorySuiteJ.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java docs/configuration/worker.md client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala |
| 16. | 30563796+nafiyaix@users.noreply.github.com | zky.zhoukeyong@alibaba-inc.com |
67 shared files
CONFIGURATION_GUIDE.md common/src/main/scala/com/aliyun/emr/rss/common/protocol/message/ControlMessages.scala server-master/src/main/proto/Resource.proto common/src/main/scala/com/aliyun/emr/rss/common/RssConf.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java server-master/src/main/scala/com/aliyun/emr/rss/service/deploy/master/Master.scala common/src/test/scala/com/aliyun/emr/rss/common/meta/WorkerInfoSuite.scala server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/Controller.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala README.md common/src/main/scala/org/apache/celeborn/common/quota/Quota.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java common/src/test/scala/com/aliyun/emr/rss/common/RssConfSuite.scala common/src/main/scala/com/aliyun/emr/rss/common/meta/WorkerInfo.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client/src/main/scala/com/aliyun/emr/rss/client/write/LifecycleManager.scala server-worker/src/main/java/com/aliyun/emr/rss/service/deploy/worker/storage/PartitionFilesSorter.java common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala common/pom.xml master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MasterStateMachineSuiteJ.java server-worker/src/test/scala/com/aliyun/emr/rss/service/deploy/cluster/ClusterReadWriteTest.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java common/src/main/scala/org/apache/celeborn/common/identity/DefaultIdentityProvider.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/main/java/org/apache/celeborn/common/network/server/MemoryTracker.java common/src/test/scala/org/apache/celeborn/common/util/PbSerDeUtilsTest.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java client/src/main/scala/org/apache/celeborn/client/ShuffleClientHelper.scala common/src/main/java/org/apache/celeborn/common/meta/FileInfo.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java docs/configuration/network.md common/src/main/java/org/apache/celeborn/common/meta/DiskStatus.java common/src/test/java/org/apache/celeborn/common/protocol/PartitionLocationSuiteJ.java common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/MetaUtil.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala common/src/main/java/org/apache/celeborn/common/haclient/RssHARetryClient.java client/pom.xml docs/configuration/client.md docs/configuration/master.md server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/Worker.scala common/src/test/scala/org/apache/celeborn/common/identity/UserIdentifierSuite.scala common/src/main/java/org/apache/celeborn/common/util/PbSerDeUtils.java client/src/main/java/com/aliyun/emr/rss/client/ShuffleClientImpl.java server-master/pom.xml client/src/main/java/com/aliyun/emr/rss/client/read/RssInputStream.java common/src/main/java/org/apache/celeborn/common/protocol/PartitionLocation.java common/src/main/scala/org/apache/celeborn/common/quota/QuotaManager.scala common/src/main/scala/com/aliyun/emr/rss/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/quota/DefaultQuotaManager.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/test/scala/org/apache/celeborn/common/quota/DefaultQuotaManagerSuite.scala docs/configuration.md server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/AbstractMetaManager.java docs/configuration/worker.md common/src/main/scala/org/apache/celeborn/common/identity/IdentityProvider.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala |
| 17. | ethanfeng@apache.org | lvshuang.tb@gmail.com |
65 shared files
common/src/main/java/org/apache/celeborn/common/network/protocol/TransportableError.java client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleMasterTest.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleMaster.java common/src/main/java/org/apache/celeborn/common/network/server/memory/BufferRecycler.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/FlinkTransportClientFactory.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateDelegation.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HARaftServer.java client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala conf/log4j2.xml.template client-flink/flink-1.17/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartition.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala common/src/test/java/org/apache/celeborn/common/network/server/ChunkStreamManagerSuiteJ.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapDataPartition.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/RssBufferStream.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/utils/FlinkUtils.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala common/src/main/java/org/apache/celeborn/common/network/server/ChunkStreamManager.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/TransportFrameDecoderWithBufferSupplier.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResource.java common/src/main/java/org/apache/celeborn/common/network/server/MapDataPartitionReader.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java common/src/main/java/org/apache/celeborn/common/network/server/DataPartitionReader.java common/src/main/java/org/apache/celeborn/common/network/server/BufferStreamManager.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala client-flink/flink-1.15/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/buffer/SortBuffer.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapDataPartitionReader.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGate.java client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java client-flink/flink-1.17/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteBufferStreamReader.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriter.java common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGate.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionDelegation.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteBufferStreamReader.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-flink/flink-1.15/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartition.java build/make-distribution.sh worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/java/org/apache/celeborn/common/network/server/memory/ReadBufferDispatcher.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/ReadClientHandler.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java docs/configuration/worker.md client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleDescriptor.java common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartition.java |
| 18. | angers.zhu@gmail.com | lvshuang.tb@gmail.com |
63 shared files
tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/HugeDataTest.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleMaster.java common/src/main/scala/org/apache/celeborn/common/meta/WorkerPartitionLocationInfo.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateDelegation.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HARaftServer.java client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/CelebornBufferStream.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala client/src/main/scala/org/apache/celeborn/client/WorkerStatusTracker.scala worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/utils/FlinkUtils.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java common/src/main/java/org/apache/celeborn/common/util/ExceptionUtils.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResource.java worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ClusterReadWriteTestWithLZ4.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java worker/src/test/scala/org/apache/celeborn/service/deploy/MiniClusterFeature.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala worker/src/test/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitorSuite.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/client/ShuffleClientSuite.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ClusterReadWriteTestWithZSTD.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGate.java client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/SkewJoinSuite.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java client/src/test/scala/org/apache/celeborn/client/WorkerStatusTrackerSuite.scala worker/src/test/scala/org/apache/celeborn/service/deploy/HeartbeatFeature.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/PushdataTimeoutTest.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java client/src/main/scala/org/apache/celeborn/client/ApplicationHeartbeater.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteBufferStreamReader.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAHelper.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/SparkTestBase.scala common/src/main/scala/org/apache/celeborn/common/meta/ShufflePartitionLocationInfo.scala client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RetryCommitFilesTest.scala common/src/main/java/org/apache/celeborn/common/protocol/PartitionLocation.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala docs/configuration/worker.md client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala |
| 19. | 30563796+nafiyaix@users.noreply.github.com | fengmingxiao.fmx@alibaba-inc.com |
62 shared files
client-spark/spark-2/src/main/scala/org/apache/spark/shuffle/celeborn/RssShuffleFallbackPolicyRunner.scala CONFIGURATION_GUIDE.md common/src/main/scala/com/aliyun/emr/rss/common/protocol/message/ControlMessages.scala worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ClusterReadWriteSuite.scala server-master/src/main/proto/Resource.proto common/src/main/scala/com/aliyun/emr/rss/common/RssConf.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala server-master/src/main/scala/com/aliyun/emr/rss/service/deploy/master/Master.scala common/src/test/scala/com/aliyun/emr/rss/common/meta/WorkerInfoSuite.scala server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/Controller.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala README.md master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MetaHandler.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java client/src/main/java/com/aliyun/emr/rss/client/ShuffleClient.java common/src/test/scala/com/aliyun/emr/rss/common/RssConfSuite.scala common/src/main/scala/com/aliyun/emr/rss/common/meta/WorkerInfo.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client/src/main/scala/com/aliyun/emr/rss/client/write/LifecycleManager.scala server-worker/src/main/java/com/aliyun/emr/rss/service/deploy/worker/storage/PartitionFilesSorter.java common/pom.xml docs/configuration/metrics.md server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/ha/MetaHandler.java server-worker/src/test/scala/com/aliyun/emr/rss/service/deploy/cluster/ClusterReadWriteTest.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala server-master/src/test/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java common/src/main/java/org/apache/celeborn/common/meta/FileInfo.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitor.scala master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/storage/StorageManager.scala docs/configuration/network.md server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/MetaUtil.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/IMetadataHandler.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java docs/configuration/client.md docs/configuration/master.md server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/Worker.scala server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/SingleMasterMetaManager.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java server-master/src/test/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java client/src/main/java/com/aliyun/emr/rss/client/ShuffleClientImpl.java client/src/main/java/com/aliyun/emr/rss/client/read/RssInputStream.java client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/RssShuffleFallbackPolicyRunner.scala common/src/main/scala/com/aliyun/emr/rss/common/util/Utils.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala docs/configuration.md server-master/src/main/java/com/aliyun/emr/rss/service/deploy/master/clustermeta/AbstractMetaManager.java client/src/test/java/com/aliyun/emr/rss/client/ShuffleClientSuiteJ.java docs/configuration/worker.md common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala |
| 20. | chengpan@apache.org | cfmcgrady@gmail.com |
60 shared files
service/src/main/scala/org/apache/celeborn/server/common/HttpService.scala client/src/test/java/org/apache/celeborn/client/ShuffleClientBaseSuiteJ.java master/pom.xml tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/PushDataTimeoutTest.scala client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java client-spark/spark-2-shaded/pom.xml client-flink/flink-1.14-shaded/pom.xml client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java client/src/main/java/org/apache/celeborn/client/write/DataPusher.java docs/README.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala docs/monitoring.md client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/main/java/org/apache/celeborn/common/write/PushState.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/WorkingPartitionSuiteJ.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java .gitignore client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/pom.xml master/src/main/java/org/apache/celeborn/service/deploy/master/SlotsAllocator.java worker/src/test/scala/org/apache/celeborn/service/deploy/MiniClusterFeature.scala service/src/main/scala/org/apache/celeborn/server/common/http/HttpServer.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/clustermeta/ha/MasterNode.scala common/src/test/scala/org/apache/celeborn/common/util/PbSerDeUtilsTest.scala client-spark/spark-3-shaded/pom.xml pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java docs/migration.md docs/configuration/columnar-shuffle.md common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar/RssColumnarBatchBuilder.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java master/src/main/scala/org/apache/celeborn/service/deploy/master/clustermeta/ha/MasterClusterInfo.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala METRICS.md client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/MemoryManager.java .rat-excludes client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java service/src/main/scala/org/apache/celeborn/server/common/Service.scala common/src/test/scala/org/apache/celeborn/common/util/UtilsSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGateSuiteJ.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala |
| 21. | ethanfeng@apache.org | zhouky@apache.org |
60 shared files
service/src/main/scala/org/apache/celeborn/server/common/HttpService.scala client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateFactory.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriterSuiteJ.java assets/grafana/rss-dashboard.json client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java common/src/test/java/org/apache/celeborn/common/network/RpcIntegrationSuiteJ.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala README.md common/src/test/java/org/apache/celeborn/common/network/server/ChunkStreamManagerSuiteJ.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala common/src/main/java/org/apache/celeborn/common/network/server/memory/MemoryManager.java common/src/main/java/org/apache/celeborn/common/network/server/ChunkStreamManager.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/TransportFrameDecoderWithBufferSupplier.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java common/src/main/java/org/apache/celeborn/common/network/server/DataPartitionReader.java client/src/main/java/org/apache/celeborn/client/read/DfsPartitionReader.java common/src/main/java/org/apache/celeborn/common/network/server/TransportServer.java common/src/main/java/org/apache/celeborn/common/network/server/BufferStreamManager.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/test/scala/org/apache/celeborn/common/util/PbSerDeUtilsTest.scala common/src/main/java/org/apache/celeborn/common/meta/FileInfo.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriter.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGate.java master/src/main/proto/Resource.proto docs/configuration/client.md docs/configuration/master.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java common/src/main/java/org/apache/celeborn/common/util/JavaUtils.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client/src/main/java/org/apache/celeborn/client/read/RssInputStream.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/test/java/org/apache/celeborn/common/network/TransportClientFactorySuiteJ.java common/src/main/java/org/apache/celeborn/common/network/server/memory/ReadBufferDispatcher.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java LICENSE-binary .github/workflows/maven.yml docs/configuration/worker.md NOTICE-binary common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala |
| 22. | zky.zhoukeyong@alibaba-inc.com | cfmcgrady@gmail.com |
59 shared files
client/src/test/java/org/apache/celeborn/client/ShuffleClientBaseSuiteJ.java assets/grafana/rss-dashboard.json client-spark/common/src/test/java/org/apache/spark/shuffle/celeborn/SortBasedPusherSuiteJ.java client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java client/src/main/java/org/apache/celeborn/client/write/DataPusher.java docs/README.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala client/src/main/scala/org/apache/celeborn/client/commit/MapPartitionCommitHandler.scala client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala client/src/main/scala/org/apache/celeborn/client/WorkerStatusTracker.scala client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriterSuiteJ.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java common/src/main/java/org/apache/celeborn/common/network/protocol/PushData.java common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/pom.xml common/src/main/java/org/apache/celeborn/common/network/server/TransportServer.java client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriterSuiteJ.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/test/scala/org/apache/celeborn/common/util/PbSerDeUtilsTest.scala client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportResponseHandler.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java docs/migration.md client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala common/src/test/java/org/apache/celeborn/common/protocol/PartitionLocationSuiteJ.java common/src/main/java/org/apache/celeborn/common/protocol/message/StatusCode.java common/src/main/java/org/apache/celeborn/common/network/protocol/PushMergedData.java common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala client/src/main/scala/org/apache/celeborn/client/CommitManager.scala METRICS.md client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java common/src/main/java/org/apache/celeborn/common/protocol/PartitionLocation.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriterSuiteJ.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriterSuiteJ.java common/src/test/scala/org/apache/celeborn/common/util/UtilsSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGateSuiteJ.java client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala |
| 23. | chengpan@apache.org | lvshuang.tb@gmail.com |
54 shared files
tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/HugeDataTest.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RssHashSuite.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java client-flink/flink-1.14-shaded/pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HARaftServer.java client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala conf/log4j2.xml.template worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala charts/celeborn/templates/configmap.yaml worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java worker/src/test/scala/org/apache/celeborn/service/deploy/MiniClusterFeature.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala worker/src/test/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitorSuite.scala client-flink/flink-1.15/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/buffer/SortBuffer.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/client/ShuffleClientSuite.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client-flink/flink-1.14/pom.xml client-flink/common/pom.xml tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/SkewJoinSuite.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java client-flink/flink-1.17/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java worker/src/test/scala/org/apache/celeborn/service/deploy/HeartbeatFeature.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java client/src/main/scala/org/apache/celeborn/client/ApplicationHeartbeater.scala docs/configuration/client.md master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAHelper.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/SparkTestBase.scala client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RetryCommitFilesTest.scala build/make-distribution.sh worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RssSortSuite.scala docs/configuration/worker.md common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala |
| 24. | zhouky@apache.org | lvshuang.tb@gmail.com |
54 shared files
tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/HugeDataTest.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RssHashSuite.scala client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/ShuffleTaskInfo.java client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java common/src/main/scala/org/apache/celeborn/common/meta/WorkerPartitionLocationInfo.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala client/src/main/scala/org/apache/celeborn/client/commit/MapPartitionCommitHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala common/src/test/java/org/apache/celeborn/common/network/server/ChunkStreamManagerSuiteJ.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/ShuffleResourceDescriptor.java common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala common/src/main/java/org/apache/celeborn/common/network/server/ChunkStreamManager.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/TransportFrameDecoderWithBufferSupplier.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGateSuiteJ.java common/src/main/java/org/apache/celeborn/common/network/server/DataPartitionReader.java common/src/main/java/org/apache/celeborn/common/network/server/BufferStreamManager.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala worker/src/test/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitorSuite.scala pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/ShuffleTaskInfoSuitJ.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/SkewJoinSuite.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriter.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/PushdataTimeoutTest.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGate.java common/src/test/java/org/apache/celeborn/common/network/server/BufferStreamManagerSuiteJ.java docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/SparkTestBase.scala common/src/main/scala/org/apache/celeborn/common/meta/ShufflePartitionLocationInfo.scala client/src/main/scala/org/apache/celeborn/client/CommitManager.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RetryCommitFilesTest.scala common/src/main/java/org/apache/celeborn/common/protocol/PartitionLocation.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/java/org/apache/celeborn/common/network/server/memory/ReadBufferDispatcher.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RssSortSuite.scala client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleMaster.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGate.java docs/configuration/worker.md client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala |
| 25. | fengmingxiao.fmx@alibaba-inc.com | ethanfeng@apache.org |
50 shared files
assets/img/dashboard1.png docs/deploy.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala assets/grafana/rss-dashboard.json client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala README.md master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MetaHandler.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala sbin/start-worker.sh worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/FlushTask.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala common/src/main/java/org/apache/celeborn/common/network/protocol/OpenStreamWithCredit.java common/pom.xml assets/img/g6.png assets/img/g3.png master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java assets/img/g4.png client/src/main/java/org/apache/celeborn/client/read/DfsPartitionReader.java assets/img/g5.png client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java common/src/main/java/org/apache/celeborn/common/meta/FileInfo.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitor.scala assets/img/g1.png docs/configuration/network.md assets/img/g2.png worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala sbin/start-all.sh master/src/main/proto/Resource.proto master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java docs/configuration/client.md docs/configuration/master.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java common/src/main/java/org/apache/celeborn/common/network/protocol/Message.java client/src/main/java/org/apache/celeborn/client/read/RssInputStream.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala docs/configuration/worker.md common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala |
| 26. | zky.zhoukeyong@alibaba-inc.com | lvshuang.tb@gmail.com |
50 shared files
tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleMaster.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateDelegation.java client/src/main/scala/org/apache/celeborn/client/commit/MapPartitionCommitHandler.scala client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala client/src/main/scala/org/apache/celeborn/client/WorkerStatusTracker.scala worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala common/src/main/java/org/apache/celeborn/common/network/protocol/PushData.java common/src/main/java/org/apache/celeborn/common/network/util/TransportFrameDecoder.java common/src/main/scala/org/apache/celeborn/common/meta/PartitionLocationInfo.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala client-flink/flink-1.15/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/client/ShuffleClientSuite.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGate.java client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala common/src/test/java/org/apache/celeborn/common/protocol/PartitionLocationSuiteJ.java common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java client-flink/flink-1.17/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriter.java common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/RemoteBufferStreamReader.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java common/src/main/java/org/apache/celeborn/common/protocol/PartitionLocation.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/test/java/org/apache/celeborn/common/network/TestUtils.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java docs/configuration/worker.md client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala |
| 27. | zhongqiang.czq@alibaba-inc.com | angers.zhu@gmail.com |
46 shared files
sbin/celeborn-daemon.sh tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriterSuiteJ.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RssHashCheckDiskSuite.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala README.md sbin/start-master.sh worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java sbin/start-worker.sh master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/network/RequestTimeoutIntegrationSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java docs/configuration/metrics.md worker/src/test/scala/org/apache/celeborn/service/deploy/MiniClusterFeature.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorterSuiteJ.java docs/migration.md worker/src/test/scala/org/apache/celeborn/service/deploy/worker/storage/WorkerSuite.scala worker/src/test/scala/org/apache/celeborn/service/deploy/HeartbeatFeature.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala common/src/main/java/org/apache/celeborn/common/network/TransportContext.java conf/celeborn-defaults.conf.template client/src/main/scala/org/apache/celeborn/client/ApplicationHeartbeater.scala common/src/main/java/org/apache/celeborn/common/network/util/TransportConf.java docs/configuration/client.md docs/configuration/master.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/MemoryManager.java tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/WordCountTest.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/test/java/org/apache/celeborn/common/network/TransportClientFactorySuiteJ.java docs/configuration/worker.md client/src/test/java/org/apache/celeborn/client/ShuffleClientImplSuiteJ.java NOTICE-binary worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala |
| 28. | ethanfeng@apache.org | zhongqiang.czq@alibaba-inc.com |
45 shared files
client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateFactory.java client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriterSuiteJ.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/config/PluginConf.java README.md worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java sbin/start-worker.sh master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/MessageDecoderExt.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/network/RequestTimeoutIntegrationSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala NOTICE client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/PluginConfSuiteJ.java client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleServiceFactory.java common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/main/java/org/apache/celeborn/common/meta/FileInfo.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionFactory.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorterSuiteJ.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriter.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala common/src/main/java/org/apache/celeborn/common/network/TransportContext.java common/src/main/java/org/apache/celeborn/common/network/util/TransportConf.java docs/configuration/client.md docs/configuration/master.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/ReducePartitionFileWriter.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java common/src/main/java/org/apache/celeborn/common/network/protocol/Message.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/MemoryManager.java tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/WordCountTest.scala build/make-distribution.sh worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/test/java/org/apache/celeborn/common/network/TransportClientFactorySuiteJ.java docs/configuration/worker.md NOTICE-binary client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartition.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/buffer/BufferPacker.java |
| 29. | chengpan@apache.org | zhongqiang.czq@alibaba-inc.com |
45 shared files
tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RssHashCheckDiskSuite.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala README.md sbin/start-master.sh worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java sbin/start-worker.sh master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala common/src/test/scala/org/apache/celeborn/common/metrics/source/CelebornSourceSuite.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java NOTICE docs/configuration/metrics.md worker/src/test/scala/org/apache/celeborn/service/deploy/MiniClusterFeature.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorterSuiteJ.java docs/migration.md client-flink/common/pom.xml worker/src/test/scala/org/apache/celeborn/service/deploy/HeartbeatFeature.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala conf/celeborn-defaults.conf.template client/src/main/scala/org/apache/celeborn/client/ApplicationHeartbeater.scala common/src/main/java/org/apache/celeborn/common/network/util/TransportConf.java docs/configuration/client.md docs/configuration/master.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/MemoryManager.java build/make-distribution.sh worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/test/java/org/apache/celeborn/common/network/TransportClientFactorySuiteJ.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/HeartbeatTest.scala docs/configuration/worker.md NOTICE-binary worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/buffer/BufferPacker.java |
| 30. | zhouky@apache.org | cfmcgrady@gmail.com |
42 shared files
service/src/main/scala/org/apache/celeborn/server/common/HttpService.scala assets/grafana/rss-dashboard.json tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/PushDataTimeoutTest.scala client/src/main/java/org/apache/celeborn/client/write/DataPusher.java common/src/main/scala/org/apache/celeborn/common/meta/WorkerPartitionLocationInfo.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala client/src/main/scala/org/apache/celeborn/client/commit/MapPartitionCommitHandler.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/main/java/org/apache/celeborn/common/write/PushState.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java master/src/main/java/org/apache/celeborn/service/deploy/master/SlotsAllocator.java common/src/main/java/org/apache/celeborn/common/network/server/TransportServer.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/test/scala/org/apache/celeborn/common/util/PbSerDeUtilsTest.scala pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala common/src/main/java/org/apache/celeborn/common/protocol/message/StatusCode.java common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/meta/ShufflePartitionLocationInfo.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala common/src/main/java/org/apache/celeborn/common/protocol/PartitionLocation.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java .rat-excludes client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala |
| 31. | 30563796+nafiyaix@users.noreply.github.com | ethanfeng@apache.org |
39 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/IMetadataHandler.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala README.md master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MetaHandler.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala common/pom.xml master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java docs/configuration/quota.md common/src/main/scala/org/apache/celeborn/common/identity/DefaultIdentityProvider.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/test/scala/org/apache/celeborn/common/util/PbSerDeUtilsTest.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java common/src/main/java/org/apache/celeborn/common/meta/FileInfo.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitor.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorterSuiteJ.java docs/configuration/network.md worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java docs/configuration/client.md docs/configuration/master.md worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala docs/configuration/worker.md common/src/main/scala/org/apache/celeborn/common/identity/IdentityProvider.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/SingleMasterMetaManager.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala |
| 32. | ethanfeng@apache.org | cfmcgrady@gmail.com |
38 shared files
service/src/main/scala/org/apache/celeborn/server/common/HttpService.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/ShuffleResourceTracker.java assets/grafana/rss-dashboard.json worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala docs/monitoring.md client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala .gitignore common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala common/pom.xml client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/ShuffleResourceTrackerTest.java common/src/main/java/org/apache/celeborn/common/network/server/TransportServer.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/test/scala/org/apache/celeborn/common/util/PbSerDeUtilsTest.scala pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportResponseHandler.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client-flink/flink-1.15-shaded/pom.xml client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/MemoryManager.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java client-flink/flink-1.17-shaded/pom.xml client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGateSuiteJ.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala |
| 33. | zky.zhoukeyong@alibaba-inc.com | zhongqiang.czq@alibaba-inc.com |
37 shared files
tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriterSuiteJ.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala README.md sbin/start-master.sh worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala sbin/start-worker.sh master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala common/src/main/java/org/apache/celeborn/common/network/util/TransportFrameDecoder.java common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/main/java/org/apache/celeborn/common/meta/FileInfo.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java docs/migration.md worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriter.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala common/src/main/java/org/apache/celeborn/common/network/TransportContext.java common/src/main/java/org/apache/celeborn/common/network/util/TransportConf.java docs/configuration/client.md docs/configuration/master.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java common/src/main/java/org/apache/celeborn/common/network/protocol/Message.java client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java common/src/main/java/org/apache/celeborn/common/network/server/TransportChannelHandler.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/test/java/org/apache/celeborn/common/network/TransportClientFactorySuiteJ.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/HeartbeatTest.scala docs/configuration/worker.md |
| 34. | fwang12@ebay.com | angers.zhu@gmail.com |
34 shared files
common/src/main/scala/org/apache/celeborn/common/meta/WorkerPartitionLocationInfo.scala common/src/main/java/org/apache/celeborn/common/write/SlowStartPushStrategy.java common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala common/src/main/java/org/apache/celeborn/common/write/InFlightRequestTracker.java common/src/main/java/org/apache/celeborn/common/write/PushState.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/ObservedDevice.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigEntry.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MasterStateMachineSuiteJ.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportResponseHandler.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/rpc/netty/NettyRpcEnv.scala worker/src/test/scala/org/apache/celeborn/service/deploy/worker/storage/WorkerSuite.scala client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java common/src/main/scala/org/apache/celeborn/common/quota/QuotaManager.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala |
| 35. | fengmingxiao.fmx@alibaba-inc.com | zhouky@apache.org |
33 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala assets/grafana/rss-dashboard.json client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala README.md master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java client/src/main/java/org/apache/celeborn/client/read/DfsPartitionReader.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/test/scala/org/apache/celeborn/common/CelebornConfSuite.scala common/src/main/java/org/apache/celeborn/common/meta/FileInfo.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala master/src/main/proto/Resource.proto docs/configuration/client.md docs/configuration/master.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/java/org/apache/celeborn/client/read/RssInputStream.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala docs/configuration/worker.md common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala |
| 36. | cfmcgrady@gmail.com | lvshuang.tb@gmail.com |
33 shared files
client-flink/flink-1.14-shaded/pom.xml common/src/main/scala/org/apache/celeborn/common/meta/WorkerPartitionLocationInfo.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala client/src/main/scala/org/apache/celeborn/client/commit/MapPartitionCommitHandler.scala client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala client/src/main/scala/org/apache/celeborn/client/WorkerStatusTracker.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala common/src/main/java/org/apache/celeborn/common/network/protocol/PushData.java common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java worker/src/test/scala/org/apache/celeborn/service/deploy/MiniClusterFeature.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala common/src/test/scala/org/apache/celeborn/common/meta/ShufflePartitionLocationInfoSuite.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala common/src/test/java/org/apache/celeborn/common/protocol/PartitionLocationSuiteJ.java common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/meta/ShufflePartitionLocationInfo.scala client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java common/src/main/java/org/apache/celeborn/common/protocol/PartitionLocation.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala |
| 37. | fwang12@ebay.com | zky.zhoukeyong@alibaba-inc.com |
33 shared files
common/src/main/java/org/apache/celeborn/common/write/SlowStartPushStrategy.java common/src/main/scala/org/apache/celeborn/common/rpc/netty/Dispatcher.scala client/src/main/scala/org/apache/celeborn/client/commit/MapPartitionCommitHandler.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala common/src/main/java/org/apache/celeborn/common/write/InFlightRequestTracker.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigEntry.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MasterStateMachineSuiteJ.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/test/scala/org/apache/celeborn/common/util/PbSerDeUtilsTest.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportResponseHandler.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/rpc/netty/NettyRpcEnv.scala client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java common/src/main/scala/org/apache/celeborn/common/quota/QuotaManager.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala |
| 38. | 30563796+nafiyaix@users.noreply.github.com | zhouky@apache.org |
32 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala README.md master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/DefaultMetaSystemSuiteJ.java master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/MetaUtil.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/RssShuffleWriterSuiteJ.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MasterStateMachineSuiteJ.java master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/RssShuffleWriterSuiteJ.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala worker/src/test/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitorSuite.scala common/src/test/scala/org/apache/celeborn/common/util/PbSerDeUtilsTest.scala common/src/main/java/org/apache/celeborn/common/meta/FileInfo.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala docs/configuration/client.md docs/configuration/master.md common/src/main/java/org/apache/celeborn/common/protocol/PartitionLocation.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala docs/configuration/worker.md common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala |
| 39. | angers.zhu@gmail.com | lyh-36@163.com |
31 shared files
common/src/main/java/org/apache/celeborn/common/network/util/NettyUtils.java docs/celeborn_ratis_shell.md tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala assets/grafana/rss-dashboard.json common/src/main/scala/org/apache/celeborn/common/metrics/MetricLabels.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/java/org/apache/celeborn/common/write/SlowStartPushStrategy.java docs/configuration/index.md docs/monitoring.md common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HARaftServer.java client/src/main/scala/org/apache/celeborn/client/WorkerStatusTracker.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/ObservedDevice.scala common/src/main/java/org/apache/celeborn/common/client/MasterClient.java common/src/main/java/org/apache/celeborn/common/util/ShutdownHookManager.java docs/configuration/quota.md common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala worker/src/test/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitorSuite.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitor.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/java/org/apache/celeborn/common/network/TransportContext.java docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/StateMachine.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala |
| 40. | lvshuang.tb@gmail.com | zhongqiang.czq@alibaba-inc.com |
31 shared files
tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/java/org/apache/celeborn/common/network/protocol/Heartbeat.java worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala common/src/main/java/org/apache/celeborn/common/network/util/TransportFrameDecoder.java common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGateSuiteJ.java worker/src/test/scala/org/apache/celeborn/service/deploy/MiniClusterFeature.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client-flink/common/pom.xml worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriter.java worker/src/test/scala/org/apache/celeborn/service/deploy/HeartbeatFeature.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client/src/main/scala/org/apache/celeborn/client/ApplicationHeartbeater.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java build/make-distribution.sh worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGate.java docs/configuration/worker.md client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartition.java |
| 41. | lvshuang.tb@gmail.com | fwang12@ebay.com |
30 shared files
client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/ShuffleTaskInfo.java common/src/main/scala/org/apache/celeborn/common/meta/WorkerPartitionLocationInfo.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/FlinkTransportClientFactory.java client/src/main/scala/org/apache/celeborn/client/commit/MapPartitionCommitHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/network/TransportFrameDecoderWithBufferSupplierSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala common/src/main/java/org/apache/celeborn/common/network/server/ChunkStreamManager.java common/src/main/java/org/apache/celeborn/common/network/server/BufferStreamManager.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleMaster.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/ReadClientHandler.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala |
| 42. | 52876270+zwangsheng@users.noreply.github.com | chengpan@apache.org |
29 shared files
charts/celeborn/values.yaml worker/src/test/scala/org/apache/celeborn/service/deploy/WorkerArgumentsSuite.scala docker/helm/templates/configmap.yaml bin/celeborn-class dev/make-distribution.sh docker/helm/templates/worker-statefulset.yaml docker/helm/templates/worker-service.yaml master/src/main/scala/org/apache/celeborn/service/deploy/master/MasterArguments.scala client/src/test/scala/org/apache/celeborn/client/WithShuffleClientSuite.scala charts/celeborn/templates/configmap.yaml docker/helm/templates/_helpers.tpl docker/Dockerfile worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerArguments.scala docker/helm/Chart.yaml docker/helm/templates/NOTES.txt docker/helm/values.yaml tests/spark-it/src/test/scala/org/apache/celeborn/tests/client/ShuffleClientSuite.scala server-worker/src/main/scala/com/aliyun/emr/rss/service/deploy/worker/storage/StorageManager.scala docker/helm/templates/prometheus-podmonitor.yaml tests/spark-it/pom.xml docker/DEPLOY_ON_K8S.md client/pom.xml docker/helm/templates/master-service.yaml METRICS.md master/src/test/scala/org/apache/celeborn/service/deploy/master/MasterArgumentsSuite.scala build/make-distribution.sh .github/workflows/maven.yml docs/deploy_on_k8s.md docker/helm/templates/master-statefulset.yaml |
| 43. | zhongqiang.czq@alibaba-inc.com | zhouky@apache.org |
28 shared files
client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateFactory.java client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriterSuiteJ.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/RssHashCheckDiskSuite.scala README.md worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGateSuiteJ.java common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/main/java/org/apache/celeborn/common/meta/FileInfo.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriter.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala docs/configuration/client.md docs/configuration/master.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/test/java/org/apache/celeborn/common/network/TransportClientFactorySuiteJ.java client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGate.java docs/configuration/worker.md NOTICE-binary |
| 44. | fwang12@ebay.com | zhouky@apache.org |
28 shared files
client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/ShuffleTaskInfo.java common/src/main/scala/org/apache/celeborn/common/meta/WorkerPartitionLocationInfo.scala client/src/main/scala/org/apache/celeborn/client/commit/MapPartitionCommitHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala common/src/main/java/org/apache/celeborn/common/write/InFlightRequestTracker.java common/src/main/java/org/apache/celeborn/common/write/PushState.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MasterStateMachineSuiteJ.java common/src/main/java/org/apache/celeborn/common/network/server/ChunkStreamManager.java common/src/main/java/org/apache/celeborn/common/network/server/BufferStreamManager.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/test/scala/org/apache/celeborn/common/util/PbSerDeUtilsTest.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java common/src/main/java/org/apache/celeborn/common/util/JavaUtils.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleMaster.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala |
| 45. | ethanfeng@apache.org | fwang12@ebay.com |
28 shared files
client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/FlinkTransportClientFactory.java common/src/main/scala/org/apache/celeborn/common/rpc/netty/Dispatcher.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigEntry.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala common/src/main/java/org/apache/celeborn/common/network/server/ChunkStreamManager.java common/src/main/java/org/apache/celeborn/common/network/server/BufferStreamManager.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/test/scala/org/apache/celeborn/common/util/PbSerDeUtilsTest.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportResponseHandler.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/rpc/netty/NettyRpcEnv.scala client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java common/src/main/java/org/apache/celeborn/common/util/JavaUtils.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/network/ReadClientHandler.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/congestcontrol/CongestionController.java |
| 46. | lyh-36@163.com | chengpan@apache.org |
27 shared files
docs/celeborn_ratis_shell.md tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala common/src/main/scala/org/apache/celeborn/common/metrics/MetricLabels.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala docs/configuration/index.md docs/monitoring.md common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HARaftServer.java common/src/main/java/org/apache/celeborn/common/network/util/NettyMemoryMetrics.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/ObservedDevice.scala common/src/test/scala/org/apache/celeborn/common/metrics/source/CelebornSourceSuite.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala worker/src/test/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitorSuite.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/buffer/SortBuffer.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitor.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/StateMachine.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/congestcontrol/CongestionController.java |
| 47. | fwang12@ebay.com | chengpan@apache.org |
27 shared files
common/src/main/scala/org/apache/celeborn/common/rpc/netty/Dispatcher.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala common/src/main/java/org/apache/celeborn/common/write/PushState.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/ObservedDevice.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigEntry.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MasterStateMachineSuiteJ.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/test/scala/org/apache/celeborn/common/util/PbSerDeUtilsTest.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/rpc/netty/NettyRpcEnv.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java common/src/main/java/org/apache/celeborn/common/util/JavaUtils.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/congestcontrol/CongestionController.java |
| 48. | zky.zhoukeyong@alibaba-inc.com | lyh-36@163.com |
26 shared files
common/src/main/java/org/apache/celeborn/common/network/util/NettyUtils.java tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala assets/grafana/rss-dashboard.json worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/java/org/apache/celeborn/common/write/SlowStartPushStrategy.java common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala common/src/main/java/org/apache/celeborn/common/network/util/NettyMemoryMetrics.java client/src/main/scala/org/apache/celeborn/client/WorkerStatusTracker.scala common/src/main/java/org/apache/celeborn/common/network/buffer/ManagedBuffer.java common/src/main/java/org/apache/celeborn/common/network/protocol/ChunkFetchSuccess.java common/src/main/java/org/apache/celeborn/common/util/ShutdownHookManager.java common/src/main/java/org/apache/celeborn/common/network/protocol/MessageWithHeader.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/test/java/org/apache/celeborn/common/protocol/PartitionLocationSuiteJ.java common/src/main/java/org/apache/celeborn/common/network/TransportContext.java docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala common/src/main/java/org/apache/celeborn/common/network/server/TransportChannelHandler.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala |
| 49. | ethanfeng@apache.org | lyh-36@163.com |
25 shared files
common/src/main/java/org/apache/celeborn/common/network/util/NettyUtils.java assets/grafana/rss-dashboard.json worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala docs/configuration/index.md docs/monitoring.md master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HARaftServer.java common/src/main/java/org/apache/celeborn/common/network/util/NettyMemoryMetrics.java common/src/main/java/org/apache/celeborn/common/util/ShutdownHookManager.java docs/configuration/quota.md common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/buffer/SortBuffer.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapDataPartitionReader.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitor.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/java/org/apache/celeborn/common/network/TransportContext.java docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/congestcontrol/CongestionController.java |
| 50. | fengmingxiao.fmx@alibaba-inc.com | lvshuang.tb@gmail.com |
25 shared files
tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala docs/configuration/worker.md common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala |
| 51. | zhongqiang.czq@alibaba-inc.com | 96606293+zhongqiangczq@users.noreply.github.com |
25 shared files
client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriterSuiteJ.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGateSuiteJ.java client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleServiceFactory.java client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/main/java/org/apache/celeborn/common/meta/FileInfo.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionFactory.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/test/scala/org/apache/celeborn/service/deploy/worker/storage/WorkerSuite.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriter.java docs/configuration/client.md worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/ReducePartitionFileWriter.java common/src/main/java/org/apache/celeborn/common/network/protocol/Message.java client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGate.java client/src/test/java/org/apache/celeborn/client/ShuffleClientImplSuiteJ.java client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartition.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/buffer/BufferPacker.java |
| 52. | 30563796+nafiyaix@users.noreply.github.com | lvshuang.tb@gmail.com |
25 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/RatisMasterStatusSystemSuiteJ.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala worker/src/test/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitorSuite.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/test/java/org/apache/celeborn/common/protocol/PartitionLocationSuiteJ.java common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HAMasterMetaManager.java docs/configuration/client.md worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java common/src/main/java/org/apache/celeborn/common/protocol/PartitionLocation.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala docs/configuration/worker.md common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala |
| 53. | angers.zhu@gmail.com | anh131@126.com |
24 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/java/org/apache/celeborn/common/write/SlowStartPushStrategy.java common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/congestcontrol/TimeSlidingHub.java common/src/main/java/org/apache/celeborn/common/write/SimplePushStrategy.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java common/src/main/java/org/apache/celeborn/common/write/InFlightRequestTracker.java common/src/main/java/org/apache/celeborn/common/write/PushState.java common/src/main/java/org/apache/celeborn/common/network/server/memory/MemoryManager.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/test/scala/org/apache/celeborn/common/CelebornConfSuite.scala sbin/restart-worker.sh worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala common/src/main/java/org/apache/celeborn/common/write/PushStrategy.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/java/org/apache/celeborn/common/protocol/message/StatusCode.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala docs/configuration/client.md docs/configuration/worker.md worker/src/main/java/org/apache/celeborn/service/deploy/worker/congestcontrol/BufferStatusHub.java common/src/test/java/org/apache/celeborn/common/write/SlowStartPushStrategyTest.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/congestcontrol/TestTimeSlidingHub.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala |
| 54. | ethanfeng@apache.org | 96606293+zhongqiangczq@users.noreply.github.com |
24 shared files
client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriterSuiteJ.java client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleServiceFactorySuitJ.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleEnvironment.java client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleServiceFactory.java client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/main/java/org/apache/celeborn/common/meta/FileInfo.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionFactory.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriter.java docs/configuration/client.md worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/ReducePartitionFileWriter.java common/src/main/java/org/apache/celeborn/common/network/protocol/Message.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartition.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/buffer/BufferPacker.java |
| 55. | zhongqiang.czq@alibaba-inc.com | fengmingxiao.fmx@alibaba-inc.com |
23 shared files
sbin/celeborn-daemon.sh tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala README.md sbin/start-master.sh worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java sbin/start-worker.sh master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala docs/configuration/metrics.md common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/main/java/org/apache/celeborn/common/meta/FileInfo.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala docs/configuration/client.md docs/configuration/master.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java common/src/main/java/org/apache/celeborn/common/network/protocol/Message.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala docs/configuration/worker.md |
| 56. | lvshuang.tb@gmail.com | lvshuang.xjs@alibaba-inc.com |
23 shared files
tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/HugeDataTest.scala client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/utils/FlinkUtils.java client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleMasterTest.java client/src/test/scala/org/apache/celeborn/client/ShuffleTaskInfoSuite.scala client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResource.java client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/FlinkResultPartitionInfo.java client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/ShuffleResourceDescriptor.java common/src/main/scala/org/apache/celeborn/common/meta/PartitionLocationInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java pom.xml client/src/main/scala/org/apache/celeborn/client/ShuffleTaskInfo.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/client/ShuffleClientSuite.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client-flink/flink-1.14/pom.xml common/src/test/java/org/apache/celeborn/common/protocol/PartitionLocationSuiteJ.java common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java common/src/main/java/org/apache/celeborn/common/protocol/PartitionLocation.java client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleMaster.java client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleDescriptor.java |
| 57. | xiyu.zk@alibaba-inc.com | chengpan@apache.org |
23 shared files
client-spark/shuffle-manager-3/src/main/java/org/apache/spark/shuffle/rss/HashBasedShuffleWriter.java common/src/main/scala/com/aliyun/emr/rss/common/RssConf.scala common/src/main/scala/org/apache/celeborn/common/RssConf.scala client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar/RssCompressionScheme.scala README.md client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java client-spark/shuffle-manager-3/src/main/scala/org/apache/spark/shuffle/rss/RssShuffleReader.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala pom.xml client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java docs/configuration/columnar-shuffle.md client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar/RssColumnarBatchBuilder.scala docs/configuration/client.md client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar/RssColumnBuilder.scala client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/RssShuffleReader.scala mkdocs.yml client/src/main/java/org/apache/celeborn/client/read/RssInputStream.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar/RssCompressionSchemes.scala docs/configuration.md client-spark/shuffle-manager-3/src/main/java/org/apache/spark/shuffle/rss/SparkUtils.java client-spark/spark-3/src/main/scala/org/apache/spark/sql/execution/columnar/RssNullableColumnBuilder.scala |
| 58. | fwang12@ebay.com | cfmcgrady@gmail.com |
22 shared files
common/src/main/scala/org/apache/celeborn/common/meta/WorkerPartitionLocationInfo.scala client/src/main/scala/org/apache/celeborn/client/commit/MapPartitionCommitHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala common/src/main/java/org/apache/celeborn/common/write/PushState.java common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/test/scala/org/apache/celeborn/common/util/PbSerDeUtilsTest.scala client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportResponseHandler.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/test/scala/org/apache/celeborn/service/deploy/worker/storage/WorkerSuite.scala client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java client/src/main/scala/org/apache/celeborn/client/commit/ReducePartitionCommitHandler.scala |
| 59. | 30563796+nafiyaix@users.noreply.github.com | zhongqiang.czq@alibaba-inc.com |
22 shared files
common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala README.md worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala common/src/test/scala/org/apache/celeborn/common/metrics/source/CelebornSourceSuite.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala docs/configuration/metrics.md common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/main/java/org/apache/celeborn/common/meta/FileInfo.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala docs/configuration/client.md docs/configuration/master.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala docs/configuration/worker.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala |
| 60. | angers.zhu@gmail.com | 82567833+zy-jordan@users.noreply.github.com |
20 shared files
tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/HugeDataTest.scala client/src/test/java/org/apache/celeborn/client/write/DataPushQueueSuitJ.java client/src/main/java/org/apache/celeborn/client/write/DataPusher.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java client/src/main/java/org/apache/celeborn/client/write/PushState.java client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/RssShuffleWriterSuiteJ.java client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/RssShuffleWriterSuiteJ.java client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/SkewJoinSuite.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/PushdataTimeoutTest.scala docs/configuration/client.md client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java client/src/main/java/org/apache/celeborn/client/write/DataPushQueue.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala docs/configuration/worker.md |
| 61. | cfmcgrady@gmail.com | zhongqiang.czq@alibaba-inc.com |
20 shared files
charts/celeborn/templates/master-statefulset.yaml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala client-flink/common/src/test/java/org/apache/celeborn/plugin/flink/FlinkShuffleClientImplSuiteJ.java worker/src/test/scala/org/apache/celeborn/service/deploy/MiniClusterFeature.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java docs/migration.md worker/src/test/scala/org/apache/celeborn/service/deploy/worker/storage/WorkerSuite.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/memory/MemoryManager.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala |
| 62. | cfmcgrady@gmail.com | fengmingxiao.fmx@alibaba-inc.com |
20 shared files
assets/grafana/rss-dashboard.json worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/pom.xml client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala METRICS.md common/src/test/scala/org/apache/celeborn/common/util/UtilsSuite.scala |
| 63. | cfmcgrady@gmail.com | 30563796+nafiyaix@users.noreply.github.com |
20 shared files
client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala common/pom.xml client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/test/scala/org/apache/celeborn/common/util/PbSerDeUtilsTest.scala pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java master/src/test/java/org/apache/celeborn/service/deploy/master/SlotsAllocatorSuiteJ.java common/src/test/java/org/apache/celeborn/common/protocol/PartitionLocationSuiteJ.java common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala docs/configuration/client.md common/src/main/java/org/apache/celeborn/common/protocol/PartitionLocation.java common/src/test/scala/org/apache/celeborn/common/quota/QuotaSuite.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala |
| 64. | angers.zhu@gmail.com | sychen@ctrip.com |
20 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/MasterArguments.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigEntry.scala common/src/main/scala/org/apache/celeborn/common/metrics/MetricsSystem.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/JVMSource.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala pom.xml client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigBuilder.scala common/src/main/scala/org/apache/celeborn/common/meta/ShufflePartitionLocationInfo.scala client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/RssShuffleReader.scala tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/WordCountTest.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala |
| 65. | zhouky@apache.org | 82567833+zy-jordan@users.noreply.github.com |
19 shared files
tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/HugeDataTest.scala client/src/test/java/org/apache/celeborn/client/write/DataPushQueueSuitJ.java client/src/main/java/org/apache/celeborn/client/write/DataPusher.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java client/src/main/java/org/apache/celeborn/client/write/PushState.java client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/RssShuffleWriterSuiteJ.java client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/RssShuffleWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/SkewJoinSuite.scala tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/PushdataTimeoutTest.scala client/src/main/java/org/apache/celeborn/client/write/InFlightRequestTracker.java docs/configuration/client.md client/src/main/java/org/apache/celeborn/client/write/DataPushQueue.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala docs/configuration/worker.md |
| 66. | chengpan@apache.org | 96606293+zhongqiangczq@users.noreply.github.com |
19 shared files
client/src/test/java/org/apache/celeborn/client/ShuffleClientBaseSuiteJ.java client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleServiceFactorySuitJ.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/utils/BufferUtils.java client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client-flink/flink-1.14/pom.xml worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java docs/configuration/client.md client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/buffer/BufferPacker.java |
| 67. | 30563796+nafiyaix@users.noreply.github.com | fwang12@ebay.com |
19 shared files
common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/ObservedDevice.scala common/src/main/scala/org/apache/celeborn/common/util/PbSerDeUtils.scala master/src/test/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/MasterStateMachineSuiteJ.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/test/scala/org/apache/celeborn/common/util/PbSerDeUtilsTest.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java common/src/main/scala/org/apache/celeborn/common/quota/QuotaManager.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala |
| 68. | zky.zhoukeyong@alibaba-inc.com | 96606293+zhongqiangczq@users.noreply.github.com |
18 shared files
client/src/test/java/org/apache/celeborn/client/ShuffleClientBaseSuiteJ.java client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriterSuiteJ.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/main/java/org/apache/celeborn/common/meta/FileInfo.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/java/org/apache/celeborn/common/protocol/message/StatusCode.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriter.java docs/configuration/client.md common/src/main/java/org/apache/celeborn/common/network/protocol/Message.java client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala |
| 69. | angers.zhu@gmail.com | 96606293+zhongqiangczq@users.noreply.github.com |
18 shared files
client/src/test/java/org/apache/celeborn/client/ShuffleClientBaseSuiteJ.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriterSuiteJ.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/test/scala/org/apache/celeborn/service/deploy/worker/storage/WorkerSuite.scala common/src/main/java/org/apache/celeborn/common/protocol/message/StatusCode.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java docs/configuration/client.md client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala client/src/test/java/org/apache/celeborn/client/ShuffleClientImplSuiteJ.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala |
| 70. | lvshuang.tb@gmail.com | 96606293+zhongqiangczq@users.noreply.github.com |
18 shared files
client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGateSuiteJ.java client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client-flink/flink-1.14/pom.xml worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriter.java docs/configuration/client.md client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGate.java client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartition.java |
| 71. | zky.zhoukeyong@alibaba-inc.com | ethan.aquarius.fmx@gmail.com |
18 shared files
client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java common/src/test/java/org/apache/celeborn/common/network/RequestTimeoutIntegrationSuiteJ.java client/src/main/java/org/apache/celeborn/client/read/Replica.java common/src/test/java/org/apache/celeborn/common/network/ChunkFetchIntegrationSuiteJ.java worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/main/java/org/apache/celeborn/common/network/client/ChunkReceivedCallback.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportResponseHandler.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java common/src/main/scala/org/apache/celeborn/common/rpc/netty/NettyRpcCallContext.scala docs/configuration/client.md common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala docs/configuration/worker.md common/src/test/java/org/apache/celeborn/common/network/TransportResponseHandlerSuiteJ.java |
| 72. | chengpan@apache.org | 490081539@qq.com |
18 shared files
client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java common/src/main/scala/org/apache/celeborn/common/rpc/netty/Dispatcher.scala README.md common/src/test/java/org/apache/celeborn/common/haclient/RssHARetryClientSuiteJ.java worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala common/src/main/scala/org/apache/celeborn/common/rpc/RpcEndpointAddress.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigEntry.scala common/src/main/scala/org/apache/celeborn/common/identity/UserIdentifier.scala docker/helm/values.yaml client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala conf/celeborn-defaults.conf.template common/src/test/scala/org/apache/celeborn/common/identity/UserIdentifierSuite.scala client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/RssShuffleFallbackPolicyRunner.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala |
| 73. | zky.zhoukeyong@alibaba-inc.com | 490081539@qq.com |
18 shared files
client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java common/src/main/scala/org/apache/celeborn/common/rpc/netty/Dispatcher.scala README.md common/src/test/java/org/apache/celeborn/common/haclient/RssHARetryClientSuiteJ.java worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala common/src/main/scala/org/apache/celeborn/common/rpc/RpcEndpointNotFoundException.scala common/src/main/scala/org/apache/celeborn/common/rpc/RpcEndpointAddress.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigEntry.scala common/src/main/scala/org/apache/celeborn/common/rpc/RpcEndpoint.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/test/scala/org/apache/celeborn/common/identity/UserIdentifierSuite.scala common/src/main/scala/org/apache/celeborn/common/util/ThreadUtils.scala common/src/main/scala/org/apache/celeborn/common/rpc/netty/Outbox.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/rpc/netty/Inbox.scala |
| 74. | sychen@ctrip.com | zky.zhoukeyong@alibaba-inc.com |
18 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigEntry.scala common/src/main/scala/org/apache/celeborn/common/metrics/MetricsSystem.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/JVMSource.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala client/src/main/scala/org/apache/celeborn/client/ReleasePartitionManager.scala pom.xml client/src/main/scala/org/apache/celeborn/client/commit/CommitHandler.scala common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigBuilder.scala client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/RssShuffleReader.scala common/src/main/scala/org/apache/celeborn/common/util/ThreadUtils.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala |
| 75. | chengpan@apache.org | 82567833+zy-jordan@users.noreply.github.com |
17 shared files
tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/HugeDataTest.scala client/src/main/java/org/apache/celeborn/client/write/DataPusher.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java client/src/main/java/org/apache/celeborn/client/write/PushState.java client-spark/spark-2/src/test/java/org/apache/spark/shuffle/celeborn/RssShuffleWriterSuiteJ.java client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java client-spark/spark-3/src/test/java/org/apache/spark/shuffle/celeborn/RssShuffleWriterSuiteJ.java client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/SkewJoinSuite.scala docs/configuration/client.md client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala docs/configuration/worker.md |
| 76. | angers.zhu@gmail.com | xiyu.zk@alibaba-inc.com |
17 shared files
common/src/main/scala/com/aliyun/emr/rss/common/RssConf.scala common/src/main/scala/org/apache/celeborn/common/RssConf.scala client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java README.md client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java common/src/main/java/org/apache/celeborn/common/protocol/CompressionCodec.java client-spark/shuffle-manager-3/src/main/scala/org/apache/spark/shuffle/rss/RssShuffleReader.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala pom.xml client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java docs/configuration/columnar-shuffle.md docs/configuration/client.md client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/RssShuffleReader.scala mkdocs.yml client/src/main/java/org/apache/celeborn/client/read/RssInputStream.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java docs/configuration.md |
| 77. | chengpan@apache.org | anh131@126.com |
17 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/congestcontrol/TestCongestionController.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/Source.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java common/src/main/java/org/apache/celeborn/common/write/PushState.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/test/scala/org/apache/celeborn/common/CelebornConfSuite.scala sbin/restart-worker.sh worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala docs/configuration/client.md docs/configuration/worker.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/congestcontrol/CongestionController.java |
| 78. | anh131@126.com | zky.zhoukeyong@alibaba-inc.com |
17 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/java/org/apache/celeborn/common/write/SlowStartPushStrategy.java common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/Source.scala common/src/main/java/org/apache/celeborn/common/write/SimplePushStrategy.java common/src/main/java/org/apache/celeborn/common/write/InFlightRequestTracker.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/test/scala/org/apache/celeborn/common/CelebornConfSuite.scala sbin/restart-worker.sh worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/java/org/apache/celeborn/common/protocol/message/StatusCode.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala docs/configuration/client.md docs/configuration/worker.md common/src/test/java/org/apache/celeborn/common/write/SlowStartPushStrategyTest.java |
| 79. | zhouky@apache.org | 96606293+zhongqiangczq@users.noreply.github.com |
17 shared files
client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionSuiteJ.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriterSuiteJ.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java client-flink/flink-1.14/src/test/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGateSuiteJ.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/main/java/org/apache/celeborn/common/meta/FileInfo.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/java/org/apache/celeborn/common/protocol/message/StatusCode.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionFileWriter.java docs/configuration/client.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala client-flink/flink-1.14/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleOutputGate.java |
| 80. | chengpan@apache.org | ethan.aquarius.fmx@gmail.com |
17 shared files
client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java common/src/test/java/org/apache/celeborn/common/network/RequestTimeoutIntegrationSuiteJ.java client-spark/spark-2-shaded/pom.xml .github/workflows/regression.yml .github/workflows/benchmark.yml common/src/test/java/org/apache/celeborn/common/network/ChunkFetchIntegrationSuiteJ.java worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala client-spark/spark-3-shaded/pom.xml pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java docs/configuration/client.md common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala docs/configuration/worker.md |
| 81. | angers.zhu@gmail.com | ethan.aquarius.fmx@gmail.com |
17 shared files
client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java client/src/main/java/org/apache/celeborn/client/read/ChunkClient.java client/src/main/java/org/apache/celeborn/client/read/Replica.java worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ClusterReadWriteTestWithLZ4.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportResponseHandler.java worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ClusterReadWriteTestWithZSTD.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java docs/configuration/client.md common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala docs/configuration/worker.md common/src/test/java/org/apache/celeborn/common/network/TransportResponseHandlerSuiteJ.java |
| 82. | angers.zhu@gmail.com | 490081539@qq.com |
16 shared files
toolkit/scripts/genConfs.py client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java README.md common/src/test/java/org/apache/celeborn/common/haclient/RssHARetryClientSuiteJ.java worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/FetchHandler.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigEntry.scala common/src/main/scala/org/apache/celeborn/common/identity/UserIdentifier.scala docker/helm/values.yaml client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala conf/celeborn-defaults.conf.template client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/RssShuffleFallbackPolicyRunner.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala |
| 83. | lyh-36@163.com | lvshuang.tb@gmail.com |
16 shared files
tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/ha/HARaftServer.java client/src/main/scala/org/apache/celeborn/client/WorkerStatusTracker.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala worker/src/test/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitorSuite.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/buffer/SortBuffer.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapDataPartitionReader.java client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/test/java/org/apache/celeborn/common/protocol/PartitionLocationSuiteJ.java docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java |
| 84. | ethan.aquarius.fmx@gmail.com | ethanfeng@apache.org |
16 shared files
client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java common/src/test/java/org/apache/celeborn/common/network/RequestTimeoutIntegrationSuiteJ.java client/src/main/java/org/apache/celeborn/client/read/Replica.java common/src/test/java/org/apache/celeborn/common/network/ChunkFetchIntegrationSuiteJ.java client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/main/java/org/apache/celeborn/common/network/client/ChunkReceivedCallback.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportResponseHandler.java worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java docs/configuration/client.md common/src/main/java/org/apache/celeborn/common/network/client/TransportClient.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala docs/configuration/worker.md common/src/test/java/org/apache/celeborn/common/network/TransportResponseHandlerSuiteJ.java |
| 85. | chengpan@apache.org | sychen@ctrip.com |
16 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/MasterArguments.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigEntry.scala common/src/main/scala/org/apache/celeborn/common/util/FunctionConverter.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/clustermeta/ha/MasterNode.scala pom.xml common/src/test/scala/org/apache/celeborn/common/meta/WorkerInfoSuite.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala common/src/main/scala/org/apache/celeborn/common/internal/config/ConfigBuilder.scala client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/RssShuffleReader.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala |
| 86. | chengpan@apache.org | lvshuang.xjs@alibaba-inc.com |
15 shared files
tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/HugeDataTest.scala common/src/main/scala/org/apache/celeborn/common/util/FunctionConverter.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java pom.xml tests/spark-it/src/test/scala/org/apache/celeborn/tests/client/ShuffleClientSuite.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client-flink/flink-1.14/pom.xml common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client/pom.xml client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java dev/reformat common/src/test/scala/org/apache/celeborn/common/util/UtilsSuite.scala |
| 87. | cfmcgrady@gmail.com | 96606293+zhongqiangczq@users.noreply.github.com |
15 shared files
client/src/test/java/org/apache/celeborn/client/ShuffleClientBaseSuiteJ.java common/src/main/java/org/apache/celeborn/common/network/protocol/RegionStart.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java worker/src/test/scala/org/apache/celeborn/service/deploy/worker/storage/WorkerSuite.scala common/src/main/java/org/apache/celeborn/common/protocol/message/StatusCode.java docs/configuration/client.md common/src/main/java/org/apache/celeborn/common/network/protocol/PushDataHandShake.java common/src/main/java/org/apache/celeborn/common/network/protocol/RegionFinish.java client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala |
| 88. | xiyu.zk@alibaba-inc.com | zky.zhoukeyong@alibaba-inc.com |
15 shared files
common/src/main/scala/com/aliyun/emr/rss/common/RssConf.scala common/src/main/scala/org/apache/celeborn/common/RssConf.scala client/src/test/java/org/apache/celeborn/client/ShuffleClientSuiteJ.java README.md client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/RssShuffleManager.java client-spark/shuffle-manager-3/src/main/scala/org/apache/spark/shuffle/rss/RssShuffleReader.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala pom.xml client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java docs/configuration/client.md client-spark/spark-3/src/main/scala/org/apache/spark/shuffle/celeborn/RssShuffleReader.scala mkdocs.yml client/src/main/java/org/apache/celeborn/client/read/RssInputStream.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java docs/configuration.md |
| 89. | anh131@126.com | zhouky@apache.org |
15 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java common/src/main/java/org/apache/celeborn/common/write/InFlightRequestTracker.java common/src/main/java/org/apache/celeborn/common/write/PushState.java common/src/main/java/org/apache/celeborn/common/network/server/memory/MemoryManager.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/test/scala/org/apache/celeborn/common/CelebornConfSuite.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/java/org/apache/celeborn/common/protocol/message/StatusCode.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala client/src/main/java/org/apache/celeborn/client/write/InFlightRequestTracker.java docs/configuration/client.md docs/configuration/worker.md |
| 90. | cfmcgrady@gmail.com | lyh-36@163.com |
15 shared files
assets/grafana/rss-dashboard.json worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala docs/monitoring.md client/src/main/scala/org/apache/celeborn/client/WorkerStatusTracker.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/test/java/org/apache/celeborn/common/protocol/PartitionLocationSuiteJ.java docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala |
| 91. | zky.zhoukeyong@alibaba-inc.com | 82567833+zy-jordan@users.noreply.github.com |
15 shared files
client/src/test/java/org/apache/celeborn/client/write/DataPushQueueSuitJ.java client/src/main/java/org/apache/celeborn/client/write/DataPusher.java client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java client/src/main/java/org/apache/celeborn/client/write/PushState.java client-spark/common/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedPusher.java client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java docs/configuration/client.md client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java client/src/main/java/org/apache/celeborn/client/write/DataPushQueue.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala docs/configuration/worker.md |
| 92. | lvshuang.xjs@alibaba-inc.com | zky.zhoukeyong@alibaba-inc.com |
15 shared files
common/src/main/scala/org/apache/celeborn/common/meta/PartitionLocationInfo.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java pom.xml tests/spark-it/src/test/scala/org/apache/celeborn/tests/client/ShuffleClientSuite.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/RequestLocationCallContext.scala common/src/test/java/org/apache/celeborn/common/protocol/PartitionLocationSuiteJ.java common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client/pom.xml client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java common/src/main/java/org/apache/celeborn/common/protocol/PartitionLocation.java common/src/test/scala/org/apache/celeborn/common/util/UtilsSuite.scala |
| 93. | lyh-36@163.com | zhouky@apache.org |
14 shared files
assets/grafana/rss-dashboard.json worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala worker/src/test/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitorSuite.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/java/org/apache/celeborn/common/network/client/TransportClientFactory.java common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala |
| 94. | 30563796+nafiyaix@users.noreply.github.com | lyh-36@163.com |
14 shared files
common/src/main/scala/org/apache/celeborn/common/metrics/MetricLabels.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/ObservedDevice.scala common/src/test/scala/org/apache/celeborn/common/metrics/source/CelebornSourceSuite.scala docs/configuration/quota.md common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala worker/src/test/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitorSuite.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/DeviceMonitor.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/test/java/org/apache/celeborn/common/protocol/PartitionLocationSuiteJ.java docs/configuration/client.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala |
| 95. | lyh-36@163.com | zhongqiang.czq@alibaba-inc.com |
13 shared files
tests/flink-it/src/test/scala/org/apache/celeborn/tests/flink/HeartbeatTest.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala common/src/main/scala/org/apache/celeborn/common/metrics/source/AbstractSource.scala common/src/test/scala/org/apache/celeborn/common/metrics/source/CelebornSourceSuite.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/java/org/apache/celeborn/common/network/TransportContext.java docs/configuration/client.md client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java common/src/main/java/org/apache/celeborn/common/network/server/TransportChannelHandler.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala |
| 96. | fengmingxiao.fmx@alibaba-inc.com | fwang12@ebay.com |
13 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala common/src/main/scala/org/apache/celeborn/common/util/Utils.scala client-flink/common/src/main/java/org/apache/celeborn/plugin/flink/readclient/FlinkShuffleClientImpl.java worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/PartitionFilesSorter.java client/src/main/scala/org/apache/celeborn/client/ChangePartitionManager.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala |
| 97. | angers.zhu@gmail.com | lvshuang.xjs@alibaba-inc.com |
12 shared files
tests/spark-it/src/test/scala/org/apache/celeborn/tests/spark/HugeDataTest.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/proto/TransportMessages.proto client/src/main/java/org/apache/celeborn/client/ShuffleClient.java pom.xml tests/spark-it/src/test/scala/org/apache/celeborn/tests/client/ShuffleClientSuite.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/protocol/message/ControlMessages.scala client/src/main/scala/org/apache/celeborn/client/CommitManager.scala client/src/test/java/org/apache/celeborn/client/DummyShuffleClient.java common/src/main/java/org/apache/celeborn/common/protocol/PartitionLocation.java common/src/test/scala/org/apache/celeborn/common/util/UtilsSuite.scala |
| 98. | ethanfeng@apache.org | anh131@126.com |
12 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/Flusher.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java common/src/main/java/org/apache/celeborn/common/network/server/memory/MemoryManager.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java common/src/main/scala/org/apache/celeborn/common/util/Utils.scala docs/configuration/client.md docs/configuration/worker.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/WorkerSource.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/congestcontrol/CongestionController.java |
| 99. | ethan.aquarius.fmx@gmail.com | lvshuang.tb@gmail.com |
12 shared files
client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ReadWriteTestBase.scala worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ClusterReadWriteTestWithLZ4.scala client/src/main/scala/org/apache/celeborn/client/LifecycleManager.scala common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/ClusterReadWriteTestWithZSTD.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java docs/configuration/client.md worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala docs/configuration/worker.md |
| 100. | fengmingxiao.fmx@alibaba-inc.com | 96606293+zhongqiangczq@users.noreply.github.com |
12 shared files
worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Controller.scala worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/FileWriter.java client/src/main/java/org/apache/celeborn/client/ShuffleClient.java common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala common/src/main/java/org/apache/celeborn/common/meta/FileInfo.java pom.xml worker/src/main/scala/org/apache/celeborn/service/deploy/worker/Worker.scala worker/src/test/java/org/apache/celeborn/service/deploy/worker/storage/FileWriterSuiteJ.java docs/configuration/client.md common/src/main/java/org/apache/celeborn/common/network/protocol/Message.java worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala |
| Contributor | # connections | # commits | |
|---|---|---|---|
| 1. | chengpan@apache.org | 50 | 140 |
| 2. | angers.zhu@gmail.com | 49 | 275 |
| 3. | zky.zhoukeyong@alibaba-inc.com | 48 | 98 |
| 4. | fengmingxiao.fmx@alibaba-inc.com | 43 | 43 |
| 5. | ethanfeng@apache.org | 40 | 88 |
| 6. | zhouky@apache.org | 40 | 34 |
| 7. | 30563796+nafiyaix@users.noreply.github.com | 38 | 48 |
| 8. | cfmcgrady@gmail.com | 36 | 35 |
| 9. | zhongqiang.czq@alibaba-inc.com | 36 | 27 |
| 10. | lvshuang.tb@gmail.com | 35 | 60 |
| 11. | xiyu.zk@alibaba-inc.com | 34 | 29 |
| 12. | lyh-36@163.com | 32 | 9 |
| 13. | 490081539@qq.com | 32 | 5 |
| 14. | fwang12@ebay.com | 31 | 3 |
| 15. | 96606293+zhongqiangczq@users.noreply.github.com | 30 | 20 |
| 16. | ethan.aquarius.fmx@gmail.com | 29 | 8 |
| 17. | sychen@ctrip.com | 29 | 2 |
| 18. | anh131@126.com | 27 | 14 |
| 19. | 1178404354@qq.com | 27 | 11 |
| 20. | lvshuang.xjs@alibaba-inc.com | 27 | 5 |
| 21. | 82567833+zy-jordan@users.noreply.github.com | 26 | 3 |
| 22. | gabrielleebuaa@gmail.com | 25 | 3 |
| 23. | cxzl25@users.noreply.github.com | 25 | 2 |
| 24. | caojiaqing@bilibili.com | 23 | 3 |
| 25. | 52876270+zwangsheng@users.noreply.github.com | 22 | 29 |
| 26. | ckj@apache.org | 22 | 4 |
| 27. | turbofei@foxmail.com | 22 | 1 |
| 28. | tcodehuber@gmail.com | 22 | 1 |
| 29. | 2213335496@qq.com | 19 | 7 |
| 30. | liangdingwen.ldw@alipay.com | 18 | 1 |
| 31. | 89496918+cvedetect@users.noreply.github.com | 17 | 1 |
| 32. | lmlianne@outlook.com | 16 | 1 |
| 33. | 643348094@qq.com | 14 | 2 |
| 34. | dxheming@163.com | 14 | 1 |
| 35. | 99078115+skytin1004@users.noreply.github.com | 14 | 1 |
| 36. | 55676558+liugs0213@users.noreply.github.com | 12 | 2 |
| 37. | 52647492+xunxunmimi5577@users.noreply.github.com | 11 | 2 |
| 38. | 48054931+szywilliam@users.noreply.github.com | 9 | 2 |
| 39. | xianyao.jiang@gmail.com | 8 | 1 |
| 40. | cchung100m@cs.ccu.edu.tw | 7 | 1 |
| 41. | akpatnam25@gmail.com | 7 | 1 |
| 42. | jn_hdd@163.com | 7 | 1 |
| 43. | fyl_8@sina.com | 6 | 1 |
| 44. | apatnam@linkedin.com | 5 | 1 |
| 45. | work4dong@163.com | 5 | 1 |
| 46. | 39462475+flyangz@users.noreply.github.com | 5 | 1 |
| 47. | waitinfuture@gmail.com | 4 | 1 |
| 48. | peter.wsj@alibaba-inc.com | 4 | 1 |
| 49. | zouxxyy@qq.com | 4 | 1 |
| 50. | lichao@kuaishou.com | 3 | 1 |
| 51. | liyihe@bigo.sg | 3 | 1 |
| 52. | wangweirao16@gmail.com | 3 | 1 |
| 53. | ulyssesyou18@gmail.com | 2 | 1 |
| 54. | 942011334@qq.com | 2 | 1 |
| 55. | 86960423+every-breaking-wave@users.noreply.github.com | 1 | 2 |
C-median: 22.0
A half of the contributors has more than 22.0 connections, and a half has less than this number.
C-mean: 20.3
An average number of connections a contributor has with other contributors.
C-index: 23.0
There are 23.0 contributors with 23.0 or more connections.
