mozilla / bigquery-backfill

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

62% duplication:

13,570 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
8,479 duplicated lines

7,259 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 7,259 duplicates...

Size	#	Folders	Files	Lines	Code
128	x 2	backfill/2024_10_10_kwindau_clients_first_seen_v2 backfill/2024_10_10_kwindau_clients_first_seen_v2	query.sql query.sql	7:134 (22%) 148:275 (22%)	view
120	x 2	backfill/2022-01-27-sanitize-search-engines backfill/2022-01-27-sanitize-search-engines	org_mozilla_fenix.sql org_mozilla_firefox_incremental.sql	1:122 (82%) 1:122 (83%)	view
111	x 2	backfill/2024-07-15-feni...ive_users_aggregates_v3 backfill/2024-07-15-feni...ive_users_aggregates_v3	fenix_query_after_2024.sql fenix_query_before_2024.sql	14:124 (90%) 14:124 (90%)	view
109	x 2	backfill/2024-04-26-active_users_aggregates backfill/2024-07-15-feni...ive_users_aggregates_v3	fenix_query.sql fenix_query_after_2024.sql	15:123 (89%) 16:124 (89%)	view
109	x 2	backfill/2024-04-26-active_users_aggregates backfill/2024-07-15-feni...ive_users_aggregates_v3	fenix_query.sql fenix_query_before_2024.sql	15:123 (89%) 16:124 (89%)	view
85	x 2	backfill/2024-04-26-active_users_aggregates backfill/2024-07-15-feni...ive_users_aggregates_v3	mobile_schema.yaml mobile_schema.yaml	1:85 (100%) 1:85 (100%)	view
79	x 2	backfill/2025-01-22-fire...aller schema-error backfill/2025-01-22-fire...aller schema-error	null_field_ratio.sql null_field_ratio.sql	79:157 (24%) 238:316 (24%)	view
75	x 2	backfill/2023-08-03-feni...ive_users_aggregates_v1 backfill/2023-08-03-fire...ive_users_aggregates_v1	query.sql query.sql	42:118 (64%) 42:118 (64%)	view
74	x 2	backfill/2023-11-03-active_users_aggregates backfill/2023-11-03-active_users_aggregates	firefox_ios_query.sql klar_ios_query.sql	44:117 (63%) 40:113 (65%)	view
74	x 2	backfill/2023-11-03-active_users_aggregates backfill/2023-11-03-active_users_aggregates	fenix_query.sql focus_android_query.sql	44:117 (63%) 40:113 (65%)	view
74	x 2	backfill/2023-11-03-active_users_aggregates backfill/2023-11-03-active_users_aggregates	focus_ios_query.sql klar_ios_query.sql	40:113 (65%) 40:113 (65%)	view
74	x 2	backfill/2023-11-03-active_users_aggregates backfill/2023-11-03-active_users_aggregates	fenix_query.sql klar_ios_query.sql	44:117 (63%) 40:113 (65%)	view
74	x 2	backfill/2023-11-03-active_users_aggregates backfill/2023-11-03-active_users_aggregates	firefox_ios_query.sql focus_android_query.sql	44:117 (63%) 40:113 (65%)	view
74	x 2	backfill/2023-11-03-active_users_aggregates backfill/2023-11-03-active_users_aggregates	fenix_query.sql focus_ios_query.sql	44:117 (63%) 40:113 (65%)	view
74	x 2	backfill/2023-11-03-active_users_aggregates backfill/2023-11-03-active_users_aggregates	focus_android_query.sql klar_ios_query.sql	40:113 (65%) 40:113 (65%)	view
74	x 2	backfill/2023-11-03-active_users_aggregates backfill/2023-11-03-active_users_aggregates	fenix_query.sql firefox_ios_query.sql	44:117 (63%) 44:117 (63%)	view
74	x 2	backfill/2023-11-03-active_users_aggregates backfill/2023-11-03-active_users_aggregates	focus_android_query.sql focus_ios_query.sql	40:113 (65%) 40:113 (65%)	view
74	x 2	backfill/2023-11-03-active_users_aggregates backfill/2023-11-03-active_users_aggregates	firefox_ios_query.sql focus_ios_query.sql	44:117 (63%) 40:113 (65%)	view
72	x 2	backfill/2025-01-22-fire...aller schema-error backfill/2025-01-22-fire...aller schema-error	null_field_ratio.sql null_field_ratio.sql	3:74 (22%) 162:233 (22%)	view
69	x 2	backfill/2025-01-22-fire...aller schema-error backfill/2025-01-22-fire...aller schema-error	null_field_ratio.sql null_field_ratio.sql	162:230 (21%) 238:306 (21%)	view
69	x 2	backfill/2025-01-22-fire...aller schema-error backfill/2025-01-22-fire...aller schema-error	null_field_ratio.sql null_field_ratio.sql	79:147 (21%) 162:230 (21%)	view
69	x 2	backfill/2025-01-22-fire...aller schema-error backfill/2025-01-22-fire...aller schema-error	null_field_ratio.sql null_field_ratio.sql	3:71 (21%) 238:306 (21%)	view
69	x 2	backfill/2025-01-22-fire...aller schema-error backfill/2025-01-22-fire...aller schema-error	null_field_ratio.sql null_field_ratio.sql	3:71 (21%) 79:147 (21%)	view
57	x 2	backfill/2024-04-26-active_users_aggregates backfill/2024-04-26-active_users_aggregates	firefox_ios_query.sql klar_ios_query.sql	38:94 (60%) 34:90 (63%)	view
57	x 2	backfill/2024-04-26-active_users_aggregates backfill/2024-04-26-active_users_aggregates	focus_ios_query.sql klar_ios_query.sql	34:90 (63%) 34:90 (63%)	view
57	x 2	backfill/2024-04-26-active_users_aggregates backfill/2024-04-26-active_users_aggregates	firefox_ios_query.sql focus_ios_query.sql	38:94 (60%) 34:90 (63%)	view
53	x 2	backfill/2024-03-23-clie...s_last_seen_v2_20240322 backfill/2024-03-23-clie...s_last_seen_v2_20240322	backfill_clients_last_seen_v2.py backfill_clients_last_seen_v2_in_BQpr...	234:295 (38%) 250:311 (34%)	view
41	x 2	backfill/2023-09-26-init...e-clients_first_seen_v2 backfill/2023-09-26-init...e-clients_first_seen_v2	telemetry_derived_clients_first_seen_... telemetry_derived_clients_first_seen_...	11:51 (12%) 67:107 (12%)	view
40	x 2	backfill/2023-09-26-init...e-clients_first_seen_v2 backfill/2024_10_10_kwindau_clients_first_seen_v2	telemetry_derived_clients_first_seen_... query.sql	326:365 (11%) 570:609 (7%)	view
39	x 2	backfill/2024-03-23-clie...s_last_seen_v2_20240322 backfill/2024-03-23-clie...s_last_seen_v2_20240322	backfill_clients_last_seen_v2.py backfill_clients_last_seen_v2_in_BQpr...	196:234 (28%) 196:234 (25%)	view
38	x 2	backfill/2023-11-03-active_users_aggregates backfill/2023-11-03-active_users_aggregates	focus_android_query.sql focus_ios_query.sql	1:38 (33%) 1:38 (33%)	view
38	x 2	backfill/2023-11-03-active_users_aggregates backfill/2023-11-03-active_users_aggregates	focus_android_query.sql klar_ios_query.sql	1:38 (33%) 1:38 (33%)	view
38	x 2	backfill/2023-11-03-active_users_aggregates backfill/2023-11-03-active_users_aggregates	focus_ios_query.sql klar_ios_query.sql	1:38 (33%) 1:38 (33%)	view
34	x 2	backfill/2024-03-23-clie...s_last_seen_v1_20240322 backfill/2024-03-23-clie...s_last_seen_v1_20240322	query.sql query.sql	31:66 (60%) 30:65 (60%)	view
34	x 2	backfill/2024-03-23-clie...s_last_seen_v1_20240322 backfill/2024-03-23-clie...s_last_seen_v1_20240322	query.sql query.sql	30:65 (60%) 30:65 (60%)	view
34	x 2	backfill/2024-03-23-clie...s_last_seen_v1_20240322 backfill/2024-03-23-clie...s_last_seen_v1_20240322	query.sql query.sql	30:65 (60%) 30:65 (60%)	view
34	x 2	backfill/2024-03-23-clie...s_last_seen_v1_20240322 backfill/2024-03-23-clie...s_last_seen_v1_20240322	query.sql query.sql	30:65 (60%) 30:65 (60%)	view
34	x 2	backfill/2024-03-23-clie...s_last_seen_v1_20240322 backfill/2024-03-23-clie...s_last_seen_v1_20240322	query.sql query.sql	30:65 (60%) 30:65 (60%)	view
34	x 2	backfill/2024-03-23-clie...s_last_seen_v1_20240322 backfill/2024-03-23-clie...s_last_seen_v1_20240322	query.sql query.sql	30:65 (60%) 30:65 (60%)	view
34	x 2	backfill/2024-03-23-clie...s_last_seen_v1_20240322 backfill/2024-03-23-clie...s_last_seen_v1_20240322	query.sql query.sql	30:65 (60%) 30:65 (60%)	view
34	x 2	backfill/2024-03-23-clie...s_last_seen_v1_20240322 backfill/2024-03-23-clie...s_last_seen_v1_20240322	query.sql query.sql	30:65 (60%) 30:65 (60%)	view
34	x 2	backfill/2024-03-23-clie...s_last_seen_v1_20240322 backfill/2024-03-23-clie...s_last_seen_v1_20240322	query.sql query.sql	30:65 (60%) 30:65 (60%)	view
34	x 2	backfill/2024-03-23-clie...s_last_seen_v1_20240322 backfill/2024-03-23-clie...s_last_seen_v1_20240322	query.sql query.sql	30:65 (60%) 30:65 (60%)	view
34	x 2	backfill/2024-03-23-clie...s_last_seen_v1_20240322 backfill/2024-03-23-clie...s_last_seen_v1_20240322	query.sql query.sql	30:65 (60%) 30:65 (60%)	view
34	x 2	backfill/2024-03-23-clie...s_last_seen_v1_20240322 backfill/2024-03-23-clie...s_last_seen_v1_20240322	query.sql query.sql	30:65 (60%) 30:65 (60%)	view
34	x 2	backfill/2024-03-23-clie...s_last_seen_v1_20240322 backfill/2024-03-23-clie...s_last_seen_v1_20240322	query.sql query.sql	30:65 (60%) 30:65 (60%)	view
34	x 2	backfill/2024-03-23-clie...s_last_seen_v1_20240322 backfill/2024-03-23-clie...s_last_seen_v1_20240322	query.sql query.sql	30:65 (60%) 30:65 (60%)	view
34	x 2	backfill/2024-03-23-clie...s_last_seen_v1_20240322 backfill/2024-03-23-clie...s_last_seen_v1_20240322	query.sql query.sql	30:65 (60%) 30:65 (60%)	view
34	x 2	backfill/2024-03-23-clie...s_last_seen_v1_20240322 backfill/2024-03-23-clie...s_last_seen_v1_20240322	query.sql query.sql	30:65 (60%) 30:65 (60%)	view
34	x 2	backfill/2024-03-23-clie...s_last_seen_v1_20240322 backfill/2024-03-23-clie...s_last_seen_v1_20240322	query.sql query.sql	31:66 (60%) 30:65 (60%)	view