apache / spark

1201	3748	4100	3218	3082	2861	2618	2330	2508	4312	4982	3526	3899	1085	320	299
166	301	346	312	342	322	368	389	426	482	661	411	153	47	14	10
2025	2024	2023	2022	2021	2020	2019	2018	2017	2016	2015	2014	2013	2012	2011	2010

	github actions maven npm gemfile make docker
Standard analyses:
		Main Code: 637,115 LOC (4067 files) = SCALA (71%) + PY (15%) + JAVA (9%) + PYI (2%) + PROTO (<1%) + JS (<1%) + G4 (<1%) + CSS (<1%) + HTML (<1%) + XML (<1%) + BASH (<1%) + YAML (<1%) + PS1 (<1%) + TOML (<1%) + IN (<1%) + C (<1%) + SBT (<1%) + CFG (<1%) Secondary code: Test: 802,204 LOC (5497); Generated: 6,220 LOC (2); Build & Deploy: 11,932 LOC (88); Other: 282,810 LOC (2484);
		File Size: 21% long (>1000 LOC), 30% short (<= 200 LOC)
		Logical Component Decomposition: primary (21 components)
		15 years, 1 month old 88% of code older than 365 days 22% of code not updated in the past 365 days
		37% of code updated more than 50 times Also see temporal dependencies for files frequently changed in same commits.
		Goals: Keep the system simple and easy to change (4)
Experimental analyses (less reliable heuristic analyses):
		Unit Size: 6% long (>100 LOC), 53% short (<= 10 LOC)
		Conditional Complexity: 5% complex (McCabe index > 50), 65% simple (McCabe index <= 5)
		Static Component Dependencies: primary (21 components)

	Features of interest: TODOs 408 files

All Analysis Reports

Source Code Overview

Components

Temporal Dependencies

Duplication

File Size

File Age & Freshness

File Change Frequency

Commits

Contributors

Unit Size*

Conditional Complexity*

Features of Interest

All Metrics

Goals & Controls

Component Dependencies*

Trend

Notes & Findings

Overall Activity Per Year

Latest commit date: 2025-05-07

Reference analysis date: 2025-05-07

252

commits
(30 days)

66

contributors
(30 days)

1201	3748	4100	3218	3082	2861	2618	2330	2508	4312	4982	3526	3899	1085	320	299
166	301	346	312	342	322	368	389	426	482	661	411	153	47	14	10
2025	2024	2023	2022	2021	2020	2019	2018	2017	2016	2015	2014	2013	2012	2011	2010

Activity Per File Extension

commits

	2025	2024	2023	2022	2021	2020	2019	2018	2017	2016	2015	2014	2013	2012	2011	2010
	774	2321	2411	2078	2143	2180	1947	1838	1989	3430	3832	2677	3225	883	285	272	scala
	346	842	1296	735	474	319	278	352	300	554	701	432	378	85			py
	86	317	319	266	201	118	179	89	93	186	247	293	366	24	6	1	xml
	64	275	186	221	225	181	252	229	240	440	522	224	310	31	1	1	java
	63	222	192	148	125	101	51	12	16	12	10	33	54	20			yaml
	16	56	30	26	36	37	95	16	34	68							g4
pyi	21	48	132	97	45	29											pyi
proto	22	47	155	115													proto
	5	13	10	11	9	3	7	2	4	14	7	21	51	19	10		sbt
	7	10	36	5	16	42	20	13	16	30	43	11	18	14	2	1	js
	6	7	16	2	8	21	10	5	3	10	36	31	55	42	2	1	css
	4	5	11	1	10	13	10	5	10	13	12	23	109	67	2	1	html
in		2				1	1			2					3	1	in
cfg	1	1	1							1							cfg
	1	1	3	1	4												toml
		2	17	11	9	5	8	5	7	1							ps1
											2				3	2	c
			1		4	2	2		1		4	11					bash

contributors

	2025	2024	2023	2022	2021	2020	2019	2018	2017	2016	2015	2014	2013	2012	2011	2010
	143	262	288	255	267	256	302	319	352	388	501	325	132	45	14	9	scala
	46	97	96	79	72	76	80	93	99	126	173	101	49	10			py
	33	75	76	69	76	77	89	84	93	116	105	66	54	7	1	1	java
	14	38	44	46	44	39	50	37	42	72	79	72	60	6	3	1	xml
	11	26	31	27	30	25	20	10	11	9	7	20	22	6			yaml
	12	24	17	14	14	17	29	9	20	26							g4
proto	12	20	30	14													proto
pyi	10	20	26	12	25	12											pyi
	4	5	9	2	7	11	6	5	3	7	17	17	17	6	2	1	css
	2	5	9	4	12	20	13	8	12	15	16	5	9	6	2	1	js
	2	4	7	1	10	10	9	5	8	10	8	13	26	8	2	1	html
	2	3	4	6	5	3	4	2	3	7	6	16	23	6	2		sbt
cfg	1	1	1							1							cfg
	1	1	3	1	3												toml
in		1				1	1			2					3	1	in
		1	6	6	4	3	4	3	3	1							ps1
											1				3	1	c
			1		3	2	2		1		4	8					bash

Visual Code Explorers

MAIN (4067)	Circles	Sunburst
TEST (5497)	Circles	Sunburst
BUILD AND DEPLOYMENT (88)	Circles	Sunburst
GENERATED (2)	Circles	Sunburst
OTHER (2484)	Circles	Sunburst

File Visualizations

File size views:

File age views:

	files grouped by age category files grouped by folder
	files grouped by freshness category files grouped by folder

File change frequency views:

Contributors per file views:

Contributor Visualizations

Contributor dependency views:

past 30 days: graphviz | 2D graph | 2D graph (with files) | 2D graph (with shared files only) | 3D graph | 3D graph (with files) | 3D graph (with shared files only)
past 3 months: graphviz | 2D graph | 2D graph (with files) | 2D graph (with shared files only) | 3D graph | 3D graph (with files) | 3D graph (with shared files only)
past 6 months: graphviz | 2D graph | 2D graph (with files) | 2D graph (with shared files only) | 3D graph | 3D graph (with files) | 3D graph (with shared files only)
past year: graphviz | 2D graph | 2D graph (with files) | 2D graph (with shared files only) | 3D graph | 3D graph (with files) | 3D graph (with shared files only)

Components and Dependencies Visualizations

Components

Temporal Dependencies

Duplication

Commits Racing Charts

30 days

3 months

6 months

PRIMARY (21)

Bubble Chart

Tree Map

graphviz

2D

3D

graphviz

2D

3D

graphviz

2D

3D

Duplication Graph

All Time

12 Months

File Dependencies Visualizations

Temporal dependencies among files:

past 30 days: graphviz | 2D graph | 2D graph (with commits) | 3D graph | 3D graph (with commits)
past 3 months: graphviz | 2D graph | 2D graph (with commits) | 3D graph | 3D graph (with commits)
past 6 months: graphviz | 2D graph | 2D graph (with commits) | 3D graph | 3D graph (with commits)

Units Visualizations

Unit size and conditional complexity views:

Lists of Files Per Scope

Analysis Results

CONFIGURATION: JSON
ALL ANALYSIS RESULTS: JSON
DUPLICATES: TXT | JSON
UNITS: TXT | JSON
CONTRIBUTORS: TXT | JSON
LOGICAL DECOMPOSITIONS: JSON
CONCERNS: JSON
CONTROLS: TXT
ALL METRICS: TXT

Zipped Files

GIT HISTORY: ZIP
ALL FILES IN ALL ANALYSIS SCOPES: ZIP

Generative AI tools, like ChatGPT or Gemini, can help you explore and discuss various aspects of source code repositories using simple prompts and file uploads. Sokrates provides you with curated data that you can use to analyze your source code further.

Example Prompt 1: Repository Evolution Analyzer (based on git history)

Try on: OpenAI ChatGPT | Claude.ai Chat | Google Gemini

Files to upload: git-history.zip

Prompt:

You are an experienced software architect tasked with analyzing Git commit history.
Context:
- Repository Name: apache / spark
- Repository Description: Apache Spark - A unified analytics engine for large-scale data processing
- Data Provided: A plain text file containing Git commit records. Source code is not available.
- Analysis Basis: Your analysis must be based solely on inferring context from the provided file paths, file names, file extensions, commit timestamps, and author information within the commit records.

Input Format:
The commit records are provided in the following format per line:
[YYYY-MM-DD] [author email] [commit hash] [file path changed]

Requested Insights:

Please analyze the provided commit history and generate a report covering the following sections:

1. Management Summary
- Provide a concise, high-level overview suitable for non-technical stakeholders.
- Summarize the repository's likely purpose, main development phases observed, and key takeaways about the team structure/activity.

2. Functional Overview
- Based only on file/module/class names, infer and describe the primary functions and capabilities of the software in this repository.
- What services or features does the codebase seem to support?

3. Key Business/Domain Concepts
- Identify and list core business or domain concepts reflected in the file and directory names (e.g., reporting, analytics, data export, user management, sourcecode analysis, landscape, visualization).

4. Inferred Architecture & Design
- Infer potential architectural patterns (e.g., modular, layered, microservices) based on directory structures and file naming conventions.
- Highlight notable design choices evident from the structure, such as separation of concerns (e.g., common module), use of configuration files, or templating engines.

5. Inferred Technology Stack
- List the programming languages, frameworks, libraries, and tools likely used, based on file extensions (.java, .py, .js, .html, .xml, .yml, pom.xml, dockerfile), configuration files, and common directory structures (e.g., /src/main/java).
- Categorize these technologies where possible (e.g., Backend, Frontend, Build, Infrastructure).

6. Logical Components / Modules
- Identify the major logical components or modules suggested by the directory structure (e.g., codeanalyzer, reports, cli, common, web).
- Briefly describe the inferred purpose of each major component.

7. Evolution by Year
- Summarize the apparent focus of development activity for each year present in the commit history.
- Assign a thematic title to each year (e.g., "Year 1: Foundation & Core Analysis", "Year 2: Reporting & Visualization Expansion").

8. Trends Over Time
Identify and describe significant trends observed across the years, such as:
- Shifts in technology usage (e.g., introduction of Docker).
- Changes in module activity (e.g., increased focus on landscape analysis).
- Signs of project maturity, expansion into new areas, or periods of focused maintenance.
9. Team Dynamics
- Analyze contributor patterns based on author emails and commit frequency:
 - Identify core maintainer(s) vs. occasional contributors.
 - Describe observable contribution trends (e.g., stable team, high turnover, reliance on a single developer).
 - Note any appearance of automated contributors (e.g., Dependabot).
10. Risk Analysis:
- Based on the findings in all previous sections (Team Dynamics, Technology, Architecture, Evolution), identify potential key risks for the project.
- Examples: Key person dependency, technology obsolescence, maintainability challenges due to complexity, potential scalability bottlenecks, bus factor.

Input File:
You will receive the commit records in a plain text file. Please parse this file to perform your analysis.

Example Prompt 2: File name conventions

Try on: OpenAI ChatGPT | Claude.ai Chat | Google Gemini

Files to upload: files.json

Prompt:

Example Prompt 3: Technology analyzer (based of file paths)

Try on: OpenAI ChatGPT | Claude.ai Chat | Google Gemini

Files to upload: files.json

Prompt:

Analyze the provided list of file paths to identify as many technologies, frameworks, tools, programming languages, cloud services, and architectural patterns used in the project as possible.

**Input:**
Please analyze the following list of file structures (provided as a list of strings or a JSON object containing file paths and optionally extensions/metadata):

*(Example: A JSON array like the one previously provided, or a simple list like `["src/server.ts", "Dockerfile", "tests/e2e/spec.cy.js", "infra/main.tf"]`)*

**Analysis Instructions:**
When performing the analysis, please consider the following:

1. **File Extensions:** Identify languages and configuration types (e.g., `.ts`, `.js`, `.py`, `.java`, `.tf`, `.yml`, `.hcl`, `.css`, `.html`).
2. **Directory Structure & Naming:** Look for conventional directory names (`src`, `tests`, `infra`, `docs`, `cicd`) and names indicating specific components or frameworks (`packages/bff`, `features`, `controllers`, `services`, `cypress`).
3. **Specific Filenames:** Identify standard configuration or definition files (e.g., `package.json`, `pom.xml`, `docker-compose.yml`, `Dockerfile`, `Jenkinsfile`, `webpack.config.js`, `tsconfig.json`, `requirements.txt`, `terragrunt.hcl`, `lint-staged.config.js`, `commitlint.config.js`).
4. **Keywords in Paths:** Look for names of known technologies, tools, frameworks, or cloud providers within the paths (e.g., `aws`, `azure`, `lambda`, `sqs`, `react`, `nest`, `k6`, `datadog`, `pm2`).

**Output:**
Please present the findings as a list of identified technologies. If possible, group them into relevant categories such as:

* Programming Languages
* Frameworks & Runtimes
* Testing Tools
* Infrastructure as Code / Cloud Providers
* Containerization & Orchestration
* Build Tools / Bundlers
* Databases (if identifiable)
* Monitoring & Logging
* CI/CD & Dev Tools
* Architectural Patterns