mozilla / gcp-ingestion

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

4% duplication:

8,406 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
364 duplicated lines

24 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 24 longest duplicates.

See data for all 24 duplicates...

Size	#	Folders	Files	Lines	Code
22	x 2	ingestion-beam/src/main/...lla/telemetry/amplitude ingestion-beam/src/main/...etry/contextualservices	FilterByDocType.java FilterByDocType.java	42:73 (57%) 46:77 (28%)	view
19	x 2	ingestion-beam/src/main/...lla/telemetry/amplitude ingestion-beam/src/main/...etry/contextualservices	SendRequest.java SendRequest.java	133:163 (22%) 101:131 (30%)	view
16	x 2	ingestion-beam/src/main/...zilla/telemetry/decoder ingestion-beam/src/main/...metry/decoder/ipprivacy	ParsePayload.java ExtractClientIdAndDropPayload.java	392:413 (5%) 80:101 (31%)	view
10	x 2	ingestion-beam/src/main/...lla/telemetry/amplitude ingestion-beam/src/main/...etry/contextualservices	AmplitudePublisherOptions.java ContextualServicesReporterOptions.java	22:34 (21%) 18:30 (16%)	view
9	x 2	ingestion-beam/src/main/...zilla/telemetry/decoder ingestion-beam/src/main/...zilla/telemetry/decoder	ParseUri.java ParseUri.java	173:182 (4%) 197:206 (4%)	view
9	x 2	ingestion-sink/src/main/...metry/ingestion/sink/io ingestion-sink/src/main/...metry/ingestion/sink/io	Pubsub.java PubsubLite.java	79:90 (11%) 45:56 (30%)	view
8	x 2	ingestion-edge/ingestion_edge ingestion-edge/ingestion_edge	flush_manager.py flush_manager.py	249:256 (1%) 343:350 (1%)	view
8	x 2	ingestion-beam/src/main/...lla/telemetry/amplitude ingestion-beam/src/main/...etry/contextualservices	ParseAmplitudeEvents.java ParseReportingUrl.java	58:71 (4%) 106:116 (2%)	view
7	x 2	ingestion-beam/src/main/...zilla/telemetry/decoder ingestion-beam/src/main/...metry/decoder/ipprivacy	ParsePayload.java ExtractClientIdAndDropPayload.java	117:125 (2%) 46:54 (13%)	view
7	x 2	ingestion-beam/src/main/...zilla/telemetry/decoder ingestion-beam/src/main/...zilla/telemetry/decoder	GeoCityLookup.java GeoIspLookup.java	175:189 (5%) 95:110 (10%)	view
7	x 2	ingestion-beam/src/main/...lla/telemetry/amplitude ingestion-beam/src/main/...etry/contextualservices	AmplitudeEvent.java SponsoredInteraction.java	146:155 (7%) 109:118 (10%)	view
6	x 2	ingestion-beam/src/main/...a/telemetry/republisher ingestion-beam/src/main/...a/telemetry/republisher	RepublishPerChannel.java RepublishPerNamespace.java	56:65 (11%) 44:53 (14%)	view
6	x 2	ingestion-beam/src/main/...lla/telemetry/amplitude ingestion-beam/src/main/...etry/contextualservices	FilterByDocType.java FilterByDocType.java	23:29 (15%) 24:30 (7%)	view
6	x 2	ingestion-edge/ingestion_edge ingestion-edge/ingestion_edge	flush_manager.py flush_manager.py	333:338 (1%) 466:471 (1%)	view
6	x 2	ingestion-beam/src/main/...a/telemetry/republisher ingestion-beam/src/main/...a/telemetry/republisher	RepublishPerChannel.java RepublishPerDocType.java	56:65 (11%) 46:55 (12%)	view
6	x 2	ingestion-edge/ingestion_edge ingestion-edge/ingestion_edge	flush_manager.py flush_manager.py	333:338 (1%) 430:435 (1%)	view
6	x 2	ingestion-beam/src/main/.../mozilla/telemetry/avro ingestion-beam/src/main/.../mozilla/telemetry/avro	GuidedJsonDecoder.java GuidedJsonDecoder.java	404:412 (2%) 416:424 (2%)	view
6	x 2	ingestion-beam/src/main/...la/telemetry/transforms ingestion-sink/src/main/...ngestion/sink/transform	KeyByBigQueryTableDestination.java PubsubMessageToTemplatedString.java	57:63 (6%) 79:85 (15%)	view
6	x 2	ingestion-beam/src/main/...a/telemetry/republisher ingestion-beam/src/main/...a/telemetry/republisher	RepublishPerDocType.java RepublishPerNamespace.java	46:55 (12%) 44:53 (14%)	view
6	x 2	ingestion-beam/src/main/.../mozilla/telemetry/avro ingestion-beam/src/main/.../mozilla/telemetry/avro	GuidedJsonDecoder.java GuidedJsonDecoder.java	435:443 (2%) 447:455 (2%)	view
6	x 2	ingestion-beam/src/main/...om/mozilla/telemetry/io ingestion-beam/src/main/...om/mozilla/telemetry/io	Write.java Write.java	315:322 (1%) 344:351 (1%)	view
6	x 2	ingestion-beam/src/main/java/com/mozilla/telemetry ingestion-beam/src/main/java/com/mozilla/telemetry	AmplitudePublisher.java ContextualServicesReporter.java	98:109 (11%) 112:123 (11%)	view
6	x 2	ingestion-beam/src/main/...lla/telemetry/amplitude ingestion-beam/src/main/...etry/contextualservices	SendRequest.java SendRequest.java	47:57 (7%) 37:47 (9%)	view
6	x 2	ingestion-edge/ingestion_edge ingestion-edge/ingestion_edge	flush_manager.py flush_manager.py	430:435 (1%) 466:471 (1%)	view

Duplicated Units

The list of top 4 duplicated units.

See data for all 4 unit duplicates...

Size	#	Folders	Files	Lines	Code
13	x 2	ingestion-beam/src/main/...lla/telemetry/amplitude ingestion-beam/src/main/...etry/contextualservices	SendRequest.java SendRequest.java	139:157 107:125	view
10	x 2	ingestion-beam/src/main/...zilla/telemetry/decoder ingestion-beam/src/main/...metry/decoder/ipprivacy	ParsePayload.java ExtractClientIdAndDropPayload.java	393:406 81:94	view
6	x 2	ingestion-beam/src/main/...lla/telemetry/amplitude ingestion-beam/src/main/...etry/contextualservices	FilterByDocType.java FilterByDocType.java	42:49 46:53	view
6	x 2	ingestion-sink/src/main/...metry/ingestion/sink/io ingestion-sink/src/main/...metry/ingestion/sink/io	PubsubLite.java Pubsub.java	45:52 79:86	view