apache / spark
Components

An overview of source code logical components.

Intro

Logical decomposition is a representation of the organization of the main source code, where every and each file is put in exactly one logical component.

Logical Decompositions Overview

Analyzed system has 1 logical decomposition:

Logical Decomposition #1: PRIMARY

The decompositions is based on the folder structure at level 1 (relative to the source code root).

Bubble Chart | Tree Map
Component Sizes (Lines of Code)
The "primary" logical decomposition has 21 components.
  • 4,067 files, 637,115 LOC (79.4% vs. main code).
  • "sql" is biggest, containing 48.77% of LOC.
  • "R" is smallest, containing 0.01% of LOC.


sql310693 LOC (38%) 2,006 files
python107118 LOC (13%) 345 files
core96926 LOC (12%) 718 files
mllib48531 LOC (6%) 331 files
common28749 LOC (3%) 287 files
resource-managers10843 LOC (1%) 81 files
streaming10374 LOC (1%) 110 files
connector9329 LOC (1%) 83 files
dev3472 LOC (<1%) 17 files
graphx3058 LOC (<1%) 42 files
launcher2514 LOC (<1%) 21 files
mllib-local2174 LOC (<1%) 5 files
project1735 LOC (<1%) 4 files
licenses-binary369 LOC (<1%) 1 file
ROOT337 LOC (<1%) 1 file
hadoop-cloud226 LOC (<1%) 3 files
repl213 LOC (<1%) 3 files
build189 LOC (<1%) 2 files
connect-examples121 LOC (<1%) 4 files
tools99 LOC (<1%) 1 file
R45 LOC (<1%) 2 files
Component Commits
Components ordered by number of commits
Total Commits per Component
All commits, some commits may include files from multiple components.
sql12984 commits (29%)
core6227 commits (14%)
python4419 commits (10%)
mllib2253 commits (5%)
project1782 commits (4%)
streaming742 commits (1%)
common720 commits (1%)
dev626 commits (1%)
resource-managers552 commits (1%)
graphx244 commits (<1%)
launcher172 commits (<1%)
connector115 commits (<1%)
repl97 commits (<1%)
mllib-local75 commits (<1%)
ROOT74 commits (<1%)
tools28 commits (<1%)
build17 commits (<1%)
hadoop-cloud3 commits (<1%)
R2 commits (<1%)
connect-examples1 commits (<1%)
licenses-binary1 commits (<1%)
Yearly File Updates Trend per Components
The number of file changes in commits
animated commit history: all time cumulative | 12 months window
2025 2024 2023 2022 2021 2020 2019 2018 2017 2016 2015 2014 2013 2012 2011
sql
1833
4653
3966
3194
4216
3555
3023
2292
2880
4636
2544
754
python
503
1393
2049
1103
1367
526
340
363
273
663
714
379
431
core
127
881
1157
558
676
1005
1384
834
1073
2105
2567
4078
4885
mllib
349
317
565
124
114
476
522
387
437
1852
1772
722
288
common
41
395
279
105
155
85
144
135
124
270
resource-managers
5
148
134
138
170
165
164
253
106
21
connector
30
111
119
109
project
26
100
134
89
76
75
64
63
63
207
177
262
456
123
30
dev
33
72
181
71
67
47
44
42
27
64
66
31
streaming
1
75
64
12
2
60
88
31
56
285
549
743
783
launcher
15
28
17
13
9
6
11
37
45
50
71
ROOT
3
6
5
5
2
1
1
5
3
20
18
5
graphx
8
7
3
8
1
29
4
15
85
96
528
repl
1
4
3
3
2
2
2
37
62
mllib-local
4
11
5
12
15
5
3
7
30
connect-examples
4
hadoop-cloud
2
3
tools
1
2
2
1
1
5
5
11
R
1
1
build
2
1
4
2
2
1
4
1
licenses-binary
1


Dependencies between components in same commits (past 180 days)
The number on the lines shows the number of shared commits.
See detailed temporal dependencies report...

G sql sql sql--sql 401 core core sql--core 33 connector connector sql--connector 11 resource-managers resource-managers sql--resource-managers 2 python python python--sql 107 python--python 127 dev dev python--dev 19 launcher launcher python--launcher 6 mllib mllib mllib--sql 41 mllib--python 32 mllib--mllib 34 mllib--core 3 core--python 16 core--core 29 project project core--project 2 common common common--sql 26 common--python 2 common--core 8 common--common 11 dev--sql 14 dev--mllib 6 dev--project 2 connector--mllib 3 connector--core 3 connector--common 2 connector--connector 8 project--sql 9 project--python 3 project--mllib 2 project--connector 2 project--project 3 mllib-local mllib-local project--mllib-local 1 launcher--sql 4 launcher--core 4 launcher--project 2 launcher--launcher 4 mllib-local--sql 3 mllib-local--mllib 4 streaming streaming streaming--sql 3 streaming--core 3 streaming--common 2 streaming--connector 2 streaming--resource-managers 2 repl repl repl--sql 2 repl--python 2 repl--project 1 resource-managers--core 2 resource-managers--connector 2 connect-examples connect-examples connect-examples--connect-examples 1 graphx graphx graphx--connector 1

2025-05-07 15:43