Hudi
Components & Dependencies

An overview of source code logical components.

Intro

Logical decomposition is a representation of the organization of the main source code, where every and each file is put in exactly one logical component.

Learn more...
Logical Decompositions Overview

Analyzed system has 1 logical decomposition:

Logical Decomposition #1: PRIMARY

The decompositions is based on the folder structure at level 1 (relative to the source code root).

Bubble Chart | Tree Map
Component Sizes (Lines of Code)
The "primary" logical decomposition has 22 components.
  • 2,460 files, 251,281 LOC (100.0% vs. main code).
  • "hudi-common" is biggest, containing 22.03% of LOC.
  • "style" is smallest, containing 0.05% of LOC.


hudi-common55356 LOC (22%) 527 files
hudi-spark-datasource55228 LOC (21%) 387 files
hudi-client52003 LOC (20%) 620 files
hudi-flink-datasource32917 LOC (13%) 285 files
hudi-utilities17708 LOC (7%) 191 files
hudi-cli5868 LOC (2%) 43 files
hudi-integ-test5700 LOC (2%) 91 files
hudi-sync5405 LOC (2%) 56 files
hudi-hadoop-mr5391 LOC (2%) 54 files
hudi-io3255 LOC (1%) 52 files
hudi-hadoop-common2173 LOC (<1%) 19 files
hudi-kafka-connect1902 LOC (<1%) 22 files
hudi-timeline-service1897 LOC (<1%) 15 files
hudi-platform-service1858 LOC (<1%) 29 files
hudi-aws1783 LOC (<1%) 15 files
hudi-gcp706 LOC (<1%) 5 files
docker613 LOC (<1%) 8 files
ROOT471 LOC (<1%) 2 files
scripts350 LOC (<1%) 2 files
packaging291 LOC (<1%) 24 files
hudi-examples285 LOC (<1%) 11 files
style121 LOC (<1%) 2 files
Static Dependencies
Dependencies among components are static code dependencies among files in different components.
  • Analyzed system has 104 links (arrows) between components.
  • The number on the arrow represents the number of files from referring component that depend on files in referred component.
  • These 104 links contain 2610 dependencies.
  • There are 10 places (20 links) with cyclic dependencies (749 file dependencies).
G packaging packaging hudi-io hudi-io packaging->hudi-io 14 hudi-common hudi-common packaging->hudi-common 14 hudi-hadoop-common hudi-hadoop-common hudi-hadoop-common->hudi-io 9 hudi-hadoop-common->hudi-common 7 hudi-client hudi-client hudi-hadoop-common->hudi-client 5 docker docker hudi-aws hudi-aws hudi-aws->hudi-hadoop-common 1 hudi-sync hudi-sync hudi-aws->hudi-sync 5 hudi-platform-service hudi-platform-service hudi-aws->hudi-platform-service 3 hudi-aws->hudi-io 7 hudi-aws->hudi-common 10 hudi-aws->hudi-client 1 hudi-kafka-connect hudi-kafka-connect hudi-kafka-connect->hudi-hadoop-common 1 hudi-kafka-connect->hudi-aws 3 hudi-kafka-connect->hudi-sync 2 hudi-kafka-connect->hudi-platform-service 3 hudi-kafka-connect->hudi-io 9 hudi-kafka-connect->hudi-common 10 hudi-kafka-connect->hudi-client 10 hudi-utilities hudi-utilities hudi-kafka-connect->hudi-utilities 1 hudi-flink-datasource hudi-flink-datasource hudi-kafka-connect->hudi-flink-datasource 5 hudi-sync->hudi-hadoop-common 2 hudi-sync->hudi-platform-service 5 hudi-hadoop-mr hudi-hadoop-mr hudi-sync->hudi-hadoop-mr 3 hudi-sync->hudi-io 27 hudi-sync->hudi-common 31 hudi-sync->hudi-client 10 hudi-examples hudi-examples ROOT ROOT hudi-platform-service->hudi-aws 1 hudi-platform-service->hudi-io 8 hudi-spark-datasource hudi-spark-datasource hudi-platform-service->hudi-spark-datasource 2 hudi-platform-service->hudi-common 9 hudi-platform-service->hudi-client 7 style style hudi-hadoop-mr->hudi-hadoop-common 4 hudi-hadoop-mr->hudi-platform-service 10 hudi-hadoop-mr->hudi-io 34 hudi-hadoop-mr->hudi-spark-datasource 1 hudi-hadoop-mr->hudi-common 36 hudi-hadoop-mr->hudi-client 25 hudi-cli hudi-cli hudi-cli->hudi-hadoop-common 6 hudi-cli->hudi-aws 3 hudi-cli->hudi-platform-service 26 hudi-cli->hudi-io 26 hudi-cli->hudi-spark-datasource 1 hudi-cli->hudi-common 32 hudi-cli->hudi-client 19 hudi-cli->hudi-utilities 6 hudi-cli->hudi-flink-datasource 1 hudi-gcp hudi-gcp hudi-gcp->hudi-sync 3 hudi-gcp->hudi-platform-service 3 hudi-gcp->hudi-io 4 hudi-gcp->hudi-common 4 hudi-gcp->hudi-client 1 hudi-timeline-service hudi-timeline-service hudi-timeline-service->hudi-hadoop-common 1 hudi-timeline-service->hudi-platform-service 10 hudi-timeline-service->hudi-io 9 hudi-timeline-service->hudi-common 14 hudi-timeline-service->hudi-client 7 hudi-spark-datasource->hudi-hadoop-common 1 hudi-spark-datasource->hudi-aws 22 hudi-spark-datasource->hudi-sync 1 hudi-spark-datasource->hudi-platform-service 8 hudi-spark-datasource->hudi-io 9 hudi-spark-datasource->hudi-common 24 hudi-spark-datasource->hudi-client 35 hudi-spark-datasource->hudi-flink-datasource 9 hudi-common->hudi-hadoop-common 33 hudi-common->hudi-io 27 hudi-common->hudi-client 12 scripts scripts hudi-client->hudi-hadoop-common 18 hudi-client->hudi-aws 1 hudi-client->hudi-platform-service 153 hudi-client->hudi-io 261 hudi-client->hudi-timeline-service 2 hudi-client->hudi-spark-datasource 5 hudi-client->hudi-common 438 hudi-utilities->hudi-hadoop-common 20 hudi-utilities->hudi-aws 23 hudi-utilities->hudi-sync 6 hudi-utilities->hudi-platform-service 29 hudi-utilities->hudi-io 143 hudi-utilities->hudi-spark-datasource 30 hudi-utilities->hudi-common 169 hudi-utilities->hudi-client 96 hudi-utilities->hudi-flink-datasource 7 hudi-flink-datasource->hudi-hadoop-common 13 hudi-flink-datasource->hudi-aws 21 hudi-flink-datasource->hudi-sync 5 hudi-flink-datasource->hudi-platform-service 41 hudi-flink-datasource->hudi-hadoop-mr 3 hudi-flink-datasource->hudi-io 72 hudi-flink-datasource->hudi-spark-datasource 2 hudi-flink-datasource->hudi-common 106 hudi-flink-datasource->hudi-client 82 hudi-integ-test hudi-integ-test hudi-integ-test->hudi-hadoop-common 6 hudi-integ-test->hudi-sync 3 hudi-integ-test->hudi-platform-service 8 hudi-integ-test->hudi-io 34 hudi-integ-test->hudi-spark-datasource 16 hudi-integ-test->hudi-common 47 hudi-integ-test->hudi-client 41 hudi-integ-test->hudi-utilities 13


Download: SVG DOT (open online Graphviz editor)

Open 3D force graph...

Show more details about dependencies...




Component Commits
Components ordered by number of commits
Total Commits per Component
All commits, some commits may include files from multiple components.
hudi-client1195 commits (22%)
hudi-common1106 commits (21%)
hudi-spark-datasource719 commits (13%)
hudi-utilities568 commits (10%)
hudi-flink-datasource411 commits (7%)
hudi-cli216 commits (4%)
hudi-hadoop-mr190 commits (3%)
hudi-sync142 commits (2%)
hudi-integ-test111 commits (2%)
hudi-timeline-service69 commits (1%)
hudi-aws49 commits (<1%)
ROOT45 commits (<1%)
hudi-kafka-connect30 commits (<1%)
packaging21 commits (<1%)
hudi-gcp20 commits (<1%)
hudi-io15 commits (<1%)
docker15 commits (<1%)
style12 commits (<1%)
hudi-platform-service10 commits (<1%)
hudi-hadoop-common9 commits (<1%)
scripts7 commits (<1%)
hudi-examples2 commits (<1%)
Yearly File Updates Trend per Components
The number of file changes in commits
animated commit history: all time cumulative | 12 months window
2024 2023 2022 2021 2020 2019 2018
hudi-client
193
1532
1647
1267
385
hudi-common
266
1055
1062
572
506
473
hudi-spark-datasource
88
1050
1058
214
23
hudi-utilities
136
580
262
207
319
196
hudi-flink-datasource
107
561
608
hudi-sync
18
98
153
66
19
hudi-hadoop-mr
17
81
125
82
122
82
hudi-io
75
hudi-cli
12
57
148
56
163
136
hudi-platform-service
68
hudi-integ-test
10
49
107
119
108
49
hudi-timeline-service
9
43
23
29
9
20
hudi-aws
12
37
22
10
hudi-gcp
1
26
8
hudi-hadoop-common
26
ROOT
9
15
6
4
9
2
hudi-kafka-connect
2
15
17
65
packaging
9
9
2
2
6
hudi-examples
5
7
docker
2
5
1
4
11
2
style
2
5
2
1
2
scripts
2
3
1
1


Dependencies between components in same commits (past 180 days)
The number on the lines shows the number of shared commits.
See detailed temporal dependencies report...

G hudi-common hudi-common hudi-common--hudi-common 70 hudi-client hudi-client hudi-common--hudi-client 67 hudi-utilities hudi-utilities hudi-common--hudi-utilities 23 hudi-cli hudi-cli hudi-common--hudi-cli 7 hudi-client--hudi-client 65 hudi-client--hudi-utilities 25 hudi-hadoop-mr hudi-hadoop-mr hudi-client--hudi-hadoop-mr 9 hudi-client--hudi-cli 7 hudi-spark-datasource hudi-spark-datasource hudi-spark-datasource--hudi-common 44 hudi-spark-datasource--hudi-client 43 hudi-spark-datasource--hudi-spark-datasource 53 hudi-flink-datasource hudi-flink-datasource hudi-spark-datasource--hudi-flink-datasource 11 hudi-io hudi-io hudi-spark-datasource--hudi-io 5 hudi-spark-datasource--hudi-hadoop-mr 8 hudi-spark-datasource--hudi-cli 6 hudi-sync hudi-sync hudi-spark-datasource--hudi-sync 5 hudi-utilities--hudi-spark-datasource 21 hudi-utilities--hudi-utilities 36 hudi-utilities--hudi-flink-datasource 9 hudi-utilities--hudi-hadoop-mr 5 hudi-timeline-service hudi-timeline-service hudi-utilities--hudi-timeline-service 6 hudi-utilities--hudi-cli 6 hudi-flink-datasource--hudi-common 21 hudi-flink-datasource--hudi-client 23 hudi-flink-datasource--hudi-flink-datasource 34 hudi-flink-datasource--hudi-hadoop-mr 6 hudi-flink-datasource--hudi-cli 6 hudi-io--hudi-common 10 hudi-io--hudi-client 6 hudi-io--hudi-flink-datasource 5 hudi-io--hudi-io 8 hudi-hadoop-common hudi-hadoop-common hudi-io--hudi-hadoop-common 8 hudi-hadoop-mr--hudi-common 10 hudi-hadoop-mr--hudi-hadoop-mr 6 hudi-timeline-service--hudi-common 9 hudi-timeline-service--hudi-client 9 hudi-timeline-service--hudi-spark-datasource 6 hudi-timeline-service--hudi-flink-datasource 5 hudi-timeline-service--hudi-hadoop-mr 4 hudi-timeline-service--hudi-cli 4 hudi-hadoop-common--hudi-common 6 hudi-hadoop-common--hudi-hadoop-common 5 hudi-integ-test hudi-integ-test hudi-integ-test--hudi-common 4 hudi-integ-test--hudi-client 5 hudi-integ-test--hudi-spark-datasource 6 hudi-integ-test--hudi-utilities 6 hudi-sync--hudi-common 6 hudi-sync--hudi-client 5 hudi-sync--hudi-sync 4 hudi-aws hudi-aws hudi-sync--hudi-aws 4

2024-04-08 15:08