opensearch-project / data-prepper
File Age

File age measurements show the distribution of file ages (days since the first commit) and the recency of file updates (days since the latest commit).

Summary
  • Number of files: 247
  • Daily file updates (only one update per file and date counted): 1672
  • First update: 2020-08-27
  • Latest update: 2022-01-29
  • Days between first and latest update: 521 (74 weeks, estimated 370 working days)
  • Active days (at least one file change): 302
  • Data:
File Change History Overall
File Age Distribution Overall
Days since first update
  • There are 247 files with 13,355 lines of code in files.
    • 76 files that are 366+ days old (4,595 lines of code)
    • 29 files that are 181-365 days old (2,068 lines of code)
    • 71 files that are 91-180 days old (4,285 lines of code)
    • 45 files that are 31-90 days old (1,461 lines of code)
    • 26 files that are 1-30 days old (946 lines of code)
34% | 15% | 32% | 10% | 7%
Legend:
366+
181-365
91-180
31-90
1-30
Latest Change Distribution Overall
Days since last update
  • There are 247 files with 13,355 lines of code in files.
    • 0 files have been last changed 366+ days ago (0 lines of code)
    • 1 files have been last changed 181-365 days ago (25 lines of code)
    • 5 files have been last changed 91-180 days ago (220 lines of code)
    • 118 files have been last changed 31-90 days ago (4,531 lines of code)
    • 123 files have been last changed 1-30 days ago (8,579 lines of code)
0% | <1% | 1% | 33% | 64%
Legend:
366+
181-365
91-180
31-90
1-30
File Change History per File Extension
java, md, yml, yaml, gradle, json, sh, properties, py, txt, tst, bat, xml, gitattributes, dockerignore, gitignore, g4
File Age Distribution per Extension
Days since first update
366+
181-365
91-180
31-90
1-30
java36% | 13% | 32% | 10% | 7%
yaml0% | 84% | 2% | 10% | 2%
yml0% | 0% | 84% | 15% | 0%
g40% | 0% | 0% | 100% | 0%
Latest Change Distribution per Extension
Days since last update
366+
181-365
91-180
31-90
1-30
yaml0% | 5% | 0% | 91% | 2%
java0% | 0% | 1% | 31% | 67%
yml0% | 0% | 84% | 15% | 0%
g40% | 0% | 0% | 100% | 0%
File Change History per Logical Decomposition
primary
primary (file age distribution)
Days since first update
366+
181-365
91-180
31-90
1-30
data-prepper-core/src56% | 3% | 15% | 3% | 20%
data-prepper-plugins/otel-trace-raw-prepper88% | 11% | 0% | 0% | 0%
data-prepper-plugins/peer-forwarder60% | 39% | 0% | 0% | 0%
data-prepper-plugins/common57% | 0% | 25% | 16% | 0%
data-prepper-api/src29% | <1% | 57% | 12% | <1%
data-prepper-plugins/service-map-stateful100% | 0% | 0% | 0% | 0%
data-prepper-plugins/otel-trace-source88% | 0% | 11% | 0% | 0%
data-prepper-benchmarks/service-map-stateful-benchmarks100% | 0% | 0% | 0% | 0%
data-prepper-plugins/mapdb-prepper-state100% | 0% | 0% | 0% | 0%
data-prepper-benchmarks/mapdb-benchmarks100% | 0% | 0% | 0% | 0%
data-prepper-plugins/opensearch0% | 47% | 52% | 0% | 0%
data-prepper-plugins/otel-trace-group-prepper0% | 100% | 0% | 0% | 0%
deployment-template/ec20% | 100% | 0% | 0% | 0%
data-prepper-plugins/blocking-buffer0% | 100% | 0% | 0% | 0%
deployment-template/k8s0% | 100% | 0% | 0% | 0%
deployment-template/eks0% | 100% | 0% | 0% | 0%
e2e-test/trace0% | 0% | 100% | 0% | 0%
data-prepper-plugins/http-source0% | 0% | 100% | 0% | 0%
data-prepper-plugins/grok-prepper0% | 0% | 100% | 0% | 0%
research/zipkin-opensearch-to-otel0% | 0% | 100% | 0% | 0%
data-prepper-logstash-configuration/src0% | 0% | 18% | 79% | 1%
release/docker0% | 0% | 100% | 0% | 0%
e2e-test/log0% | 0% | 0% | 100% | 0%
data-prepper-plugins/armeria-common0% | 0% | 0% | 100% | 0%
data-prepper-plugins/aggregate-processor0% | 0% | 0% | 0% | 100%
data-prepper-plugins/key-value-processor0% | 0% | 0% | 0% | 100%
data-prepper-plugins/drop-events-processor0% | 0% | 0% | 0% | 100%
primary (latest change distribution)
Days since last update
366+
181-365
91-180
31-90
1-30
deployment-template/eks0% | 100% | 0% | 0% | 0%
data-prepper-plugins/opensearch0% | 0% | 8% | 13% | 77%
e2e-test/trace0% | 0% | 12% | 9% | 77%
data-prepper-api/src0% | 0% | 0% | 69% | 30%
data-prepper-core/src0% | 0% | 0% | 42% | 57%
data-prepper-logstash-configuration/src0% | 0% | 0% | 98% | 1%
data-prepper-plugins/peer-forwarder0% | 0% | 0% | 39% | 60%
data-prepper-plugins/common0% | 0% | 0% | 32% | 67%
deployment-template/ec20% | 0% | 0% | 100% | 0%
data-prepper-plugins/armeria-common0% | 0% | 0% | 100% | 0%
deployment-template/k8s0% | 0% | 0% | 100% | 0%
data-prepper-plugins/otel-trace-raw-prepper0% | 0% | 0% | 10% | 89%
data-prepper-plugins/otel-trace-group-prepper0% | 0% | 0% | 20% | 79%
e2e-test/log0% | 0% | 0% | 8% | 91%
release/docker0% | 0% | 0% | 100% | 0%
data-prepper-plugins/service-map-stateful0% | 0% | 0% | 0% | 100%
data-prepper-plugins/http-source0% | 0% | 0% | 0% | 100%
data-prepper-plugins/otel-trace-source0% | 0% | 0% | 0% | 100%
data-prepper-plugins/grok-prepper0% | 0% | 0% | 0% | 100%
research/zipkin-opensearch-to-otel0% | 0% | 0% | 0% | 100%
data-prepper-plugins/aggregate-processor0% | 0% | 0% | 0% | 100%
data-prepper-plugins/key-value-processor0% | 0% | 0% | 0% | 100%
data-prepper-benchmarks/service-map-stateful-benchmarks0% | 0% | 0% | 0% | 100%
data-prepper-plugins/blocking-buffer0% | 0% | 0% | 0% | 100%
data-prepper-plugins/mapdb-prepper-state0% | 0% | 0% | 0% | 100%
data-prepper-benchmarks/mapdb-benchmarks0% | 0% | 0% | 0% | 100%
data-prepper-plugins/drop-events-processor0% | 0% | 0% | 0% | 100%
Oldest Files (Top 20)
File# lines# unitslast modified
(days ago)
created
(days ago)
# changes
PipelineParser.java
in data-prepper-core/src/main/java/com/amazon/dataprepper/parser
186 10 27 427 25
OTelTraceSource.java
in data-prepper-plugins/otel-trace-source/src/main/java/com/amazon/dataprepper/plugins/source/oteltrace
158 5 14 427 26
PipelineConfiguration.java
in data-prepper-core/src/main/java/com/amazon/dataprepper/parser/model
151 18 64 427 15
Pipeline.java
in data-prepper-core/src/main/java/com/amazon/dataprepper/pipeline
144 11 64 427 28
OTelTraceSourceConfig.java
in data-prepper-plugins/otel-trace-source/src/main/java/com/amazon/dataprepper/plugins/source/oteltrace
141 20 14 427 19
PluginSetting.java
in data-prepper-api/src/main/java/com/amazon/dataprepper/model/configuration
124 17 27 427 17
PipelineConfigurationValidator.java
in data-prepper-core/src/main/java/com/amazon/dataprepper/parser
107 6 79 427 7
AbstractBuffer.java
in data-prepper-api/src/main/java/com/amazon/dataprepper/model/buffer
97 7 78 427 23
PluginRepository.java
in data-prepper-plugins/common/src/main/java/com/amazon/dataprepper/plugins
79 7 14 427 14
ProcessWorker.java
in data-prepper-core/src/main/java/com/amazon/dataprepper/pipeline
74 5 64 427 20
StdInSource.java
in data-prepper-plugins/common/src/main/java/com/amazon/dataprepper/plugins/source
66 5 14 427 7
DataPrepper.java
in data-prepper-core/src/main/java/com/amazon/dataprepper
65 8 27 427 34
PipelineConnector.java
in data-prepper-core/src/main/java/com/amazon/dataprepper/pipeline
64 8 79 427 12
FileSink.java
in data-prepper-plugins/common/src/main/java/com/amazon/dataprepper/plugins/sink
58 6 14 427 13
PipelineThreadPoolExecutor.java
in data-prepper-core/src/main/java/com/amazon/dataprepper/pipeline/common
55 3 64 427 11
PluginMetrics.java
in data-prepper-api/src/main/java/com/amazon/dataprepper/metrics
52 12 79 427 17
OTelTraceGrpcService.java
in data-prepper-plugins/otel-trace-source/src/main/java/com/amazon/dataprepper/plugins/source/oteltrace
51 2 14 427 13
PluginFactory.java
in data-prepper-plugins/common/src/main/java/com/amazon/dataprepper/plugins
51 3 14 427 7
FutureHelperResult.java
in data-prepper-core/src/main/java/com/amazon/dataprepper/pipeline/common
43 6 79 427 5
StdOutSink.java
in data-prepper-plugins/common/src/main/java/com/amazon/dataprepper/plugins/sink
33 5 14 427 10
Files Not Recently Changed (Top 20)
File# lines# unitslast modified
(days ago)
created
(days ago)
# changes
ingress.yaml
in deployment-template/eks
25 - 303 324 5
AwsRequestSigningApacheInterceptor.java
in data-prepper-plugins/opensearch/src/main/java/com/amazon/dataprepper/plugins/sink/opensearch
143 5 161 175 3
data_prepper.yml
in e2e-test/trace/src/integrationTest/resources
1 - 91 91 1
raw-span-e2e-pipeline.yml
in e2e-test/trace/src/integrationTest/resources
25 - 91 91 1
service-map-e2e-pipeline.yml
in e2e-test/trace/src/integrationTest/resources
25 - 91 91 1
raw-span-e2e-pipeline-latest-release.yml
in e2e-test/trace/src/integrationTest/resources
26 - 91 91 1
g4
Logstash.g4
in data-prepper-logstash-configuration/src/main/antlr
95 - 89 89 1
data_prepper.yml
in e2e-test/log/src/integrationTest/resources
1 - 84 84 1
default-data-prepper-config.yaml
in release/docker/config
10 - 84 96 2
amazon_es.mapping.yaml
in data-prepper-logstash-configuration/src/main/resources/org/opensearch/dataprepper/logstash/mapping
8 - 83 83 1
elasticsearch.mapping.yaml
in data-prepper-logstash-configuration/src/main/resources/org/opensearch/dataprepper/logstash/mapping
8 - 83 83 1
http.mapping.yaml
in data-prepper-logstash-configuration/src/main/resources/org/opensearch/dataprepper/logstash/mapping
11 - 83 83 1
LogstashAttributesMappings.java
in data-prepper-logstash-configuration/src/main/java/org/opensearch/dataprepper/logstash/mapping
6 - 82 82 1
GrpcAuthenticationProvider.java
in data-prepper-plugins/armeria-common/src/main/java/com/amazon/dataprepper/armeria/authentication
6 - 82 82 1
ArmeriaHttpAuthenticationProvider.java
in data-prepper-plugins/armeria-common/src/main/java/com/amazon/dataprepper/armeria/authentication
6 - 82 82 1
LogstashPluginAttributesMapper.java
in data-prepper-logstash-configuration/src/main/java/org/opensearch/dataprepper/logstash/mapping
7 - 82 82 1
UnauthenticatedArmeriaHttpAuthenticationProvider.java
in data-prepper-plugins/armeria-common/src/main/java/com/amazon/dataprepper/plugins
10 1 82 82 1
grok.mapping.yaml
in data-prepper-logstash-configuration/src/main/resources/org/opensearch/dataprepper/logstash/mapping
12 - 82 83 2
AttributesMapperProvider.java
in data-prepper-logstash-configuration/src/main/java/org/opensearch/dataprepper/logstash/mapping
19 1 82 82 1
UnauthenticatedGrpcAuthenticationProvider.java
in data-prepper-plugins/armeria-common/src/main/java/com/amazon/dataprepper/plugins
19 1 82 82 1
Most Recently Created Files (Top 20)
File# lines# unitslast modified
(days ago)
created
(days ago)
# changes
DefaultGroupState.java
in data-prepper-plugins/aggregate-processor/src/main/java/com/amazon/dataprepper/plugins/processor/aggregate
4 - 6 6 1
GroupState.java
in data-prepper-plugins/aggregate-processor/src/main/java/com/amazon/dataprepper/plugins/processor/aggregate
4 - 6 6 1
AggregateActionInput.java
in data-prepper-plugins/aggregate-processor/src/main/java/com/amazon/dataprepper/plugins/processor/aggregate
4 - 6 6 1
AggregateIdentificationKeysHasher.java
in data-prepper-plugins/aggregate-processor/src/main/java/com/amazon/dataprepper/plugins/processor/aggregate
32 3 8 8 1
AggregateGroupManager.java
in data-prepper-plugins/aggregate-processor/src/main/java/com/amazon/dataprepper/plugins/processor/aggregate
17 1 8 8 1
AggregateGroup.java
in data-prepper-plugins/aggregate-processor/src/main/java/com/amazon/dataprepper/plugins/processor/aggregate
10 1 6 8 2
PluginApplicationContext.java
in data-prepper-core/src/main/java/com/amazon/dataprepper/plugin
14 1 9 9 1
kv.mapping.yaml
in data-prepper-logstash-configuration/src/main/resources/org/opensearch/dataprepper/logstash/mapping
9 - 9 9 1
DataPrepperServerConfiguration.java
in data-prepper-core/src/main/java/com/amazon/dataprepper/pipeline/server/config
99 8 12 12 1
HttpServerProvider.java
in data-prepper-core/src/main/java/com/amazon/dataprepper/pipeline/server
54 2 12 12 1
KeyValueProcessor.java
in data-prepper-plugins/key-value-processor/src/main/java/com/amazon/dataprepper/plugins/processor/keyvalue
153 7 9 15 2
KeyValueProcessorConfig.java
in data-prepper-plugins/key-value-processor/src/main/java/com/amazon/dataprepper/plugins/processor/keyvalue
67 10 9 15 2
CombineAggregateAction.java
in data-prepper-plugins/aggregate-processor/src/main/java/com/amazon/dataprepper/plugins/processor/aggregate/actions
25 2 6 20 2
RemoveDuplicatesAggregateAction.java
in data-prepper-plugins/aggregate-processor/src/main/java/com/amazon/dataprepper/plugins/processor/aggregate/actions
20 1 6 20 2
AggregateActionResponse.java
in data-prepper-plugins/aggregate-processor/src/main/java/com/amazon/dataprepper/plugins/processor/aggregate
17 4 8 20 2
AggregateAction.java
in data-prepper-plugins/aggregate-processor/src/main/java/com/amazon/dataprepper/plugins/processor/aggregate
11 2 6 20 2
drop.mapping.yaml
in data-prepper-logstash-configuration/src/main/resources/org/opensearch/dataprepper/logstash/mapping
1 - 23 23 1
AggregateProcessor.java
in data-prepper-plugins/aggregate-processor/src/main/java/com/amazon/dataprepper/plugins/processor/aggregate
65 6 6 26 3
AggregateProcessorConfig.java
in data-prepper-plugins/aggregate-processor/src/main/java/com/amazon/dataprepper/plugins/processor/aggregate
43 4 8 26 2
MetricsConfig.java
in data-prepper-core/src/main/java/com/amazon/dataprepper/parser/config
128 12 12 27 2
Most Recently Changed Files (Top 20)
File# lines# unitslast modified
(days ago)
created
(days ago)
# changes
RecordMetadata.java
in data-prepper-api/src/main/java/com/amazon/dataprepper/model/record
29 6 4 427 6
Record.java
in data-prepper-api/src/main/java/com/amazon/dataprepper/model/record
20 4 4 427 6
AggregateProcessor.java
in data-prepper-plugins/aggregate-processor/src/main/java/com/amazon/dataprepper/plugins/processor/aggregate
65 6 6 26 3
CombineAggregateAction.java
in data-prepper-plugins/aggregate-processor/src/main/java/com/amazon/dataprepper/plugins/processor/aggregate/actions
25 2 6 20 2
RemoveDuplicatesAggregateAction.java
in data-prepper-plugins/aggregate-processor/src/main/java/com/amazon/dataprepper/plugins/processor/aggregate/actions
20 1 6 20 2
AggregateAction.java
in data-prepper-plugins/aggregate-processor/src/main/java/com/amazon/dataprepper/plugins/processor/aggregate
11 2 6 20 2
AggregateGroup.java
in data-prepper-plugins/aggregate-processor/src/main/java/com/amazon/dataprepper/plugins/processor/aggregate
10 1 6 8 2
DefaultGroupState.java
in data-prepper-plugins/aggregate-processor/src/main/java/com/amazon/dataprepper/plugins/processor/aggregate
4 - 6 6 1
GroupState.java
in data-prepper-plugins/aggregate-processor/src/main/java/com/amazon/dataprepper/plugins/processor/aggregate
4 - 6 6 1
AggregateActionInput.java
in data-prepper-plugins/aggregate-processor/src/main/java/com/amazon/dataprepper/plugins/processor/aggregate
4 - 6 6 1
AggregateProcessorConfig.java
in data-prepper-plugins/aggregate-processor/src/main/java/com/amazon/dataprepper/plugins/processor/aggregate
43 4 8 26 2
AggregateIdentificationKeysHasher.java
in data-prepper-plugins/aggregate-processor/src/main/java/com/amazon/dataprepper/plugins/processor/aggregate
32 3 8 8 1
AggregateGroupManager.java
in data-prepper-plugins/aggregate-processor/src/main/java/com/amazon/dataprepper/plugins/processor/aggregate
17 1 8 8 1
AggregateActionResponse.java
in data-prepper-plugins/aggregate-processor/src/main/java/com/amazon/dataprepper/plugins/processor/aggregate
17 4 8 20 2
KeyValueProcessor.java
in data-prepper-plugins/key-value-processor/src/main/java/com/amazon/dataprepper/plugins/processor/keyvalue
153 7 9 15 2
DefaultPluginFactory.java
in data-prepper-core/src/main/java/com/amazon/dataprepper/plugin
78 4 9 119 9
PluginCreator.java
in data-prepper-core/src/main/java/com/amazon/dataprepper/plugin
77 2 9 119 6
KeyValueProcessorConfig.java
in data-prepper-plugins/key-value-processor/src/main/java/com/amazon/dataprepper/plugins/processor/keyvalue
67 10 9 15 2
PluginConfigurationConverter.java
in data-prepper-core/src/main/java/com/amazon/dataprepper/plugin
38 1 9 100 4
PluginProviderLoader.java
in data-prepper-core/src/main/java/com/amazon/dataprepper/plugin
23 1 9 119 3