opensearch-project / data-prepper
File Size

The distribution of size of files (measured in lines of code).

Intro
  • File size measurements show the distribution of size of files.
  • Files are classified in four categories based on their size (lines of code): 1-100 (very small files), 101-200 (small files), 201-500 (medium size files), 501-1000 (long files), 1001+(very long files).
  • It is a good practice to keep files small. Long files may become "bloaters", code that have increased to such gargantuan proportions that they are hard to work with.
Learn more...
File Size Overall
  • There are 247 files with 13,355 lines of code.
    • 0 very long files (0 lines of code)
    • 0 long files (0 lines of code)
    • 11 medium size files (2,686 lines of codeclsfd_ftr_w_mp_ins)
    • 29 small files (4,119 lines of code)
    • 207 very small files (6,550 lines of code)
0% | 0% | 20% | 30% | 49%
Legend:
1001+
501-1000
201-500
101-200
1-100


explore: zoomable circles | sunburst | 3D view
File Size per Extension
1001+
501-1000
201-500
101-200
1-100
java0% | 0% | 19% | 31% | 49%
yaml0% | 0% | 50% | 27% | 21%
g40% | 0% | 0% | 0% | 100%
yml0% | 0% | 0% | 0% | 100%
File Size per Logical Decomposition
primary
1001+
501-1000
201-500
101-200
1-100
data-prepper-plugins/opensearch0% | 0% | 46% | 37% | 15%
data-prepper-api/src0% | 0% | 30% | 7% | 61%
e2e-test/trace0% | 0% | 77% | 0% | 22%
data-prepper-plugins/service-map-stateful0% | 0% | 60% | 34% | 4%
data-prepper-plugins/grok-prepper0% | 0% | 72% | 0% | 27%
deployment-template/ec20% | 0% | 100% | 0% | 0%
data-prepper-plugins/otel-trace-raw-prepper0% | 0% | 28% | 47% | 23%
data-prepper-core/src0% | 0% | 0% | 34% | 65%
data-prepper-plugins/peer-forwarder0% | 0% | 0% | 35% | 64%
data-prepper-plugins/otel-trace-source0% | 0% | 0% | 72% | 27%
data-prepper-plugins/otel-trace-group-prepper0% | 0% | 0% | 70% | 29%
data-prepper-benchmarks/service-map-stateful-benchmarks0% | 0% | 0% | 100% | 0%
data-prepper-plugins/key-value-processor0% | 0% | 0% | 69% | 30%
research/zipkin-opensearch-to-otel0% | 0% | 0% | 49% | 50%
data-prepper-plugins/common0% | 0% | 0% | 15% | 84%
data-prepper-logstash-configuration/src0% | 0% | 0% | 15% | 84%
data-prepper-plugins/blocking-buffer0% | 0% | 0% | 100% | 0%
data-prepper-plugins/http-source0% | 0% | 0% | 28% | 71%
e2e-test/log0% | 0% | 0% | 69% | 30%
deployment-template/k8s0% | 0% | 0% | 100% | 0%
data-prepper-plugins/mapdb-prepper-state0% | 0% | 0% | 100% | 0%
data-prepper-plugins/aggregate-processor0% | 0% | 0% | 0% | 100%
data-prepper-plugins/armeria-common0% | 0% | 0% | 0% | 100%
data-prepper-benchmarks/mapdb-benchmarks0% | 0% | 0% | 0% | 100%
data-prepper-plugins/drop-events-processor0% | 0% | 0% | 0% | 100%
deployment-template/eks0% | 0% | 0% | 0% | 100%
release/docker0% | 0% | 0% | 0% | 100%
Longest Files (Top 50)
File# lines# units
ConnectionConfiguration.java
in data-prepper-plugins/opensearch/src/main/java/com/amazon/dataprepper/plugins/sink/opensearch
347 34
ServiceMapStatefulPrepper.java
in data-prepper-plugins/service-map-stateful/src/main/java/com/amazon/dataprepper/plugins/prepper
266 17
JacksonEvent.java
in data-prepper-api/src/main/java/com/amazon/dataprepper/model/event
258 29
JacksonSpan.java
in data-prepper-api/src/main/java/com/amazon/dataprepper/model/trace
254 44
GrokPrepper.java
in data-prepper-plugins/grok-prepper/src/main/java/com/amazon/dataprepper/plugins/prepper/grok
249 14
EndToEndRawSpanTest.java
in e2e-test/trace/src/integrationTest/java/com/amazon/dataprepper/integration/trace
242 9
EndToEndServiceMapTest.java
in e2e-test/trace/src/integrationTest/java/com/amazon/dataprepper/integration/trace
224 7
IndexConfiguration.java
in data-prepper-plugins/opensearch/src/main/java/com/amazon/dataprepper/plugins/sink/opensearch/index
216 21
data-prepper-ec2-deployment-cfn.yaml
in deployment-template/ec2
216 -
OTelTraceRawPrepper.java
in data-prepper-plugins/otel-trace-raw-prepper/src/main/java/com/amazon/dataprepper/plugins/prepper/oteltrace
213 9
IndexManager.java
in data-prepper-plugins/opensearch/src/main/java/com/amazon/dataprepper/plugins/sink/opensearch/index
201 14
PipelineParser.java
in data-prepper-core/src/main/java/com/amazon/dataprepper/parser
186 10
OpenSearchSink.java
in data-prepper-plugins/opensearch/src/main/java/com/amazon/dataprepper/plugins/sink/opensearch
183 9
PeerForwarder.java
in data-prepper-plugins/peer-forwarder/src/main/java/com/amazon/dataprepper/plugins/prepper/peerforwarder
181 9
OTelTraceGroupPrepper.java
in data-prepper-plugins/otel-trace-group-prepper/src/main/java/com/amazon/dataprepper/plugins/prepper/oteltracegroup
171 6
AwsCloudMapPeerListProvider.java
in data-prepper-plugins/peer-forwarder/src/main/java/com/amazon/dataprepper/plugins/prepper/peerforwarder/discovery
161 10
ServiceMapStatefulPrepperBenchmarks.java
in data-prepper-benchmarks/service-map-stateful-benchmarks/src/jmh/java/com/amazon/dataprepper/benchmarks/prepper
160 10
OTelTraceSource.java
in data-prepper-plugins/otel-trace-source/src/main/java/com/amazon/dataprepper/plugins/source/oteltrace
158 5
ServiceMapRelationship.java
in data-prepper-plugins/service-map-stateful/src/main/java/com/amazon/dataprepper/plugins/prepper
154 28
KeyValueProcessor.java
in data-prepper-plugins/key-value-processor/src/main/java/com/amazon/dataprepper/plugins/processor/keyvalue
153 7
PipelineConfiguration.java
in data-prepper-core/src/main/java/com/amazon/dataprepper/parser/model
151 18
ZipkinOpenSearchToOtelPrepper.java
in research/zipkin-opensearch-to-otel/src/main/java/com/amazon/dataprepper/research/zipkin
149 3
BulkRetryStrategy.java
in data-prepper-plugins/opensearch/src/main/java/com/amazon/dataprepper/plugins/sink/opensearch
147 8
ACMCertificateProvider.java
in data-prepper-plugins/common/src/main/java/com/amazon/dataprepper/plugins/certificate/acm
145 6
Pipeline.java
in data-prepper-core/src/main/java/com/amazon/dataprepper/pipeline
144 11
AwsRequestSigningApacheInterceptor.java
in data-prepper-plugins/opensearch/src/main/java/com/amazon/dataprepper/plugins/sink/opensearch
143 5
OTelTraceSourceConfig.java
in data-prepper-plugins/otel-trace-source/src/main/java/com/amazon/dataprepper/plugins/source/oteltrace
141 20
ModelConvertingLogstashVisitor.java
in data-prepper-logstash-configuration/src/main/java/org/opensearch/dataprepper/logstash/parser
139 10
IsmPolicyManagement.java
in data-prepper-plugins/opensearch/src/main/java/com/amazon/dataprepper/plugins/sink/opensearch/index
138 9
RawSpanBuilder.java
in data-prepper-plugins/otel-trace-raw-prepper/src/main/java/com/amazon/dataprepper/plugins/prepper/oteltrace/model
131 20
BlockingBuffer.java
in data-prepper-plugins/blocking-buffer/src/main/java/com/amazon/dataprepper/plugins/buffer/blockingbuffer
130 8
MetricsConfig.java
in data-prepper-core/src/main/java/com/amazon/dataprepper/parser/config
128 12
HTTPSource.java
in data-prepper-plugins/http-source/src/main/java/com/amazon/dataprepper/plugins/source/loghttp
125 3
PluginSetting.java
in data-prepper-api/src/main/java/com/amazon/dataprepper/model/configuration
124 17
EndToEndBasicLogTest.java
in e2e-test/log/src/integrationTest/java/com/amazon/dataprepper/integration/log
120 5
data-prepper-k8s.yaml
in deployment-template/k8s
119 -
OTelProtoHelper.java
in data-prepper-plugins/otel-trace-raw-prepper/src/main/java/com/amazon/dataprepper/plugins/prepper/oteltrace/model
114 13
MapDbPrepperState.java
in data-prepper-plugins/mapdb-prepper-state/src/main/java/com/amazon/dataprepper/plugins/prepper/state
112 14
PipelineConfigurationValidator.java
in data-prepper-core/src/main/java/com/amazon/dataprepper/parser
107 6
RawSpan.java
in data-prepper-plugins/otel-trace-raw-prepper/src/main/java/com/amazon/dataprepper/plugins/prepper/oteltrace/model
105 19
DataPrepperServerConfiguration.java
in data-prepper-core/src/main/java/com/amazon/dataprepper/pipeline/server/config
99 8
AbstractBuffer.java
in data-prepper-api/src/main/java/com/amazon/dataprepper/model/buffer
97 7
GrokPrepperConfig.java
in data-prepper-plugins/grok-prepper/src/main/java/com/amazon/dataprepper/plugins/prepper/grok
95 11
g4
Logstash.g4
in data-prepper-logstash-configuration/src/main/antlr
95 -
FileSource.java
in data-prepper-plugins/common/src/main/java/com/amazon/dataprepper/plugins/source/file
92 6
GrokLogstashPluginAttributesMapper.java
in data-prepper-logstash-configuration/src/main/java/org/opensearch/dataprepper/logstash/mapping
92 3
PeerForwarderConfig.java
in data-prepper-plugins/peer-forwarder/src/main/java/com/amazon/dataprepper/plugins/prepper/peerforwarder
91 6
DefaultLink.java
in data-prepper-api/src/main/java/com/amazon/dataprepper/model/trace
87 14
HTTPSourceConfig.java
in data-prepper-plugins/http-source/src/main/java/com/amazon/dataprepper/plugins/source/loghttp
85 13
ZipkinOpenSearchToOtel.java
in research/zipkin-opensearch-to-otel/src/main/java/com/amazon/dataprepper/research/zipkin
85 3
Files With Most Units (Top 20)
File# lines# units
JacksonSpan.java
in data-prepper-api/src/main/java/com/amazon/dataprepper/model/trace
254 44
ConnectionConfiguration.java
in data-prepper-plugins/opensearch/src/main/java/com/amazon/dataprepper/plugins/sink/opensearch
347 34
JacksonEvent.java
in data-prepper-api/src/main/java/com/amazon/dataprepper/model/event
258 29
ServiceMapRelationship.java
in data-prepper-plugins/service-map-stateful/src/main/java/com/amazon/dataprepper/plugins/prepper
154 28
IndexConfiguration.java
in data-prepper-plugins/opensearch/src/main/java/com/amazon/dataprepper/plugins/sink/opensearch/index
216 21
OTelTraceSourceConfig.java
in data-prepper-plugins/otel-trace-source/src/main/java/com/amazon/dataprepper/plugins/source/oteltrace
141 20
RawSpanBuilder.java
in data-prepper-plugins/otel-trace-raw-prepper/src/main/java/com/amazon/dataprepper/plugins/prepper/oteltrace/model
131 20
RawSpan.java
in data-prepper-plugins/otel-trace-raw-prepper/src/main/java/com/amazon/dataprepper/plugins/prepper/oteltrace/model
105 19
PipelineConfiguration.java
in data-prepper-core/src/main/java/com/amazon/dataprepper/parser/model
151 18
ServiceMapStatefulPrepper.java
in data-prepper-plugins/service-map-stateful/src/main/java/com/amazon/dataprepper/plugins/prepper
266 17
PluginSetting.java
in data-prepper-api/src/main/java/com/amazon/dataprepper/model/configuration
124 17
IndexManager.java
in data-prepper-plugins/opensearch/src/main/java/com/amazon/dataprepper/plugins/sink/opensearch/index
201 14
GrokPrepper.java
in data-prepper-plugins/grok-prepper/src/main/java/com/amazon/dataprepper/plugins/prepper/grok
249 14
MapDbPrepperState.java
in data-prepper-plugins/mapdb-prepper-state/src/main/java/com/amazon/dataprepper/plugins/prepper/state
112 14
DefaultLink.java
in data-prepper-api/src/main/java/com/amazon/dataprepper/model/trace
87 14
HTTPSourceConfig.java
in data-prepper-plugins/http-source/src/main/java/com/amazon/dataprepper/plugins/source/loghttp
85 13
OTelProtoHelper.java
in data-prepper-plugins/otel-trace-raw-prepper/src/main/java/com/amazon/dataprepper/plugins/prepper/oteltrace/model
114 13
TraceGroup.java
in data-prepper-plugins/otel-trace-raw-prepper/src/main/java/com/amazon/dataprepper/plugins/prepper/oteltrace/model
78 12
MetricsConfig.java
in data-prepper-core/src/main/java/com/amazon/dataprepper/parser/config
128 12
DefaultSpanEvent.java
in data-prepper-api/src/main/java/com/amazon/dataprepper/model/trace
74 12
Files With Long Lines (Top 20)

There are 92 files with lines longer than 120 characters. In total, there are 252 long lines.

File# lines# units# long lines
IndexManager.java
in data-prepper-plugins/opensearch/src/main/java/com/amazon/dataprepper/plugins/sink/opensearch/index
201 14 12
ServiceMapStatefulPrepper.java
in data-prepper-plugins/service-map-stateful/src/main/java/com/amazon/dataprepper/plugins/prepper
266 17 10
KeyValueProcessor.java
in data-prepper-plugins/key-value-processor/src/main/java/com/amazon/dataprepper/plugins/processor/keyvalue
153 7 9
HTTPSource.java
in data-prepper-plugins/http-source/src/main/java/com/amazon/dataprepper/plugins/source/loghttp
125 3 9
EndToEndServiceMapTest.java
in e2e-test/trace/src/integrationTest/java/com/amazon/dataprepper/integration/trace
224 7 8
OTelTraceSource.java
in data-prepper-plugins/otel-trace-source/src/main/java/com/amazon/dataprepper/plugins/source/oteltrace
158 5 8
OTelTraceGroupPrepper.java
in data-prepper-plugins/otel-trace-group-prepper/src/main/java/com/amazon/dataprepper/plugins/prepper/oteltracegroup
171 6 8
AggregateProcessor.java
in data-prepper-plugins/aggregate-processor/src/main/java/com/amazon/dataprepper/plugins/processor/aggregate
65 6 8
OTelProtoHelper.java
in data-prepper-plugins/otel-trace-raw-prepper/src/main/java/com/amazon/dataprepper/plugins/prepper/oteltrace/model
114 13 7
PipelineParser.java
in data-prepper-core/src/main/java/com/amazon/dataprepper/parser
186 10 7
data-prepper-ec2-deployment-cfn.yaml
in deployment-template/ec2
216 - 7
AbstractLogstashPluginAttributesMapper.java
in data-prepper-logstash-configuration/src/main/java/org/opensearch/dataprepper/logstash/mapping
49 1 6
AwsCloudMapPeerListProvider.java
in data-prepper-plugins/peer-forwarder/src/main/java/com/amazon/dataprepper/plugins/prepper/peerforwarder/discovery
161 10 5
GrokPrepper.java
in data-prepper-plugins/grok-prepper/src/main/java/com/amazon/dataprepper/plugins/prepper/grok
249 14 5
JacksonEvent.java
in data-prepper-api/src/main/java/com/amazon/dataprepper/model/event
258 29 5
EndToEndRawSpanTest.java
in e2e-test/trace/src/integrationTest/java/com/amazon/dataprepper/integration/trace
242 9 4
PeerForwarderConfig.java
in data-prepper-plugins/peer-forwarder/src/main/java/com/amazon/dataprepper/plugins/prepper/peerforwarder
91 6 4
FileSource.java
in data-prepper-plugins/common/src/main/java/com/amazon/dataprepper/plugins/source/file
92 6 4
ACMCertificateProvider.java
in data-prepper-plugins/common/src/main/java/com/amazon/dataprepper/plugins/certificate/acm
145 6 4
ServiceMapStatefulPrepperBenchmarks.java
in data-prepper-benchmarks/service-map-stateful-benchmarks/src/jmh/java/com/amazon/dataprepper/benchmarks/prepper
160 10 4