apache / sdap-in-situ-data-services

Intro

File size measurements show the distribution of size of files.
Files are classified in four categories based on their size (lines of code): 1-100 (very small files), 101-200 (small files), 201-500 (medium size files), 501-1000 (long files), 1001+(very long files).
It is a good practice to keep files small. Long files may become "bloaters", code that have increased to such gargantuan proportions that they are hard to work with.

Learn more...

File Size Overall

There are 112 files with 6,672 lines of code.

1 very long files (1,089 lines of code)
0 long files (0 lines of code)
2 medium size files (480 lines of codeclsfd_ftr_w_mp_ins)
15 small files (2,293 lines of code)
94 very small files (2,810 lines of code)

Legend:

1001+

501-1000

201-500

101-200

1-100

explore: grouped by folders | grouped by size | sunburst | 3D view

File Size per Extension

1001+

501-1000

201-500

101-200

1-100

File Size per Logical Decomposition

primary

1001+

501-1000

201-500

101-200

1-100

Longest Files (Top 50)

File	# lines	# units
cdms.demo.2021.12.09.ipynb in documentations/jupyter.notebooks	1089	-
audit_tool.py in parquet_cli/audit_tool	265	5
aws_ddb.py in parquet_flask/aws	215	22
parquet_query_condition_management_v3.py in parquet_flask/io_logic	198	21
org.alues.yaml in k8s_spark/k8s_spark	188	-
query_v2.py in parquet_flask/io_logic	186	34
ingest_aws_json.py in parquet_flask/v1	176	20
es_middleware.py in parquet_flask/aws	175	16
sub_collection_statistics.py in parquet_flask/io_logic	173	8
query_v4.py in parquet_flask/io_logic	173	13
cdms_schema.py in parquet_flask/io_logic	145	8
parquet_query_condition_management_v4.py in parquet_flask/io_logic	137	17
statistics_retriever.py in parquet_flask/parquet_stat_extractor	136	22
s3_stat_extractor.py in parquet_flask/cdms_lambda_func/index_to_es	130	23
partitioned_parquet_path.py in parquet_flask/io_logic	127	25
query_data_doms_custom_pagination.py in parquet_flask/v1	120	10
deployment.yaml in k8s_spark/parquet.spark.helm/templates	116	-
ingest_new_file.py in parquet_flask/io_logic	113	6
query_data_doms.py in parquet_flask/v1	100	5
s3_2_sqs.py in parquet_flask/cdms_lambda_func/s3_records	96	5
aws_s3.py in parquet_flask/aws	95	11
values.yaml in k8s_spark/parquet.spark.helm	87	-
raw_query.py in parquet_flask/io_logic	77	10
ingress.yaml in k8s_spark/parquet.spark.helm/templates	76	-
parquet_paths_es_retriever.py in parquet_flask/io_logic	75	5
sanitize_record.py in parquet_flask/io_logic	73	4
tpl _helpers.tpl in k8s_spark/parquet.spark.helm/templates	71	-
parquet_file_es_indexer.py in parquet_flask/cdms_lambda_func/index_to_es	70	6
__main__.py in parquet_cli/ingest_s3	68	3
file_utils.py in parquet_flask/utils	65	9
retrieve_spark_session.py in parquet_flask/io_logic	63	5
ingest_s3_to_cdms.py in parquet_flask/cdms_lambda_func/ingest_s3_to_cdms	60	2
general_utils.py in parquet_flask/utils	57	7
index.html in parquet_flask/v1/insitu_query_swagger	55	-
config.py in parquet_flask/utils	53	4
sub_collection_statistics_endpoint.py in parquet_flask/v1	53	2
s3.tf in terraform/cdms-parquet-tf	50	-
parallel_json_validator.py in parquet_flask/utils	49	9
ddb.tf in terraform/cdms-parquet-tf	47	-
aws_cred.py in parquet_flask/aws	44	8
execute_lambda.py in parquet_flask/cdms_lambda_func/audit_tool	44	1
metadata_tbl_es.py in parquet_flask/io_logic	42	7
replace_json_s3.py in parquet_flask/v1	42	2
hpa.yaml in k8s_spark/parquet.spark.helm/templates	42	-
es_abstract.py in parquet_flask/aws	41	12
cdms_constants.py in parquet_flask/io_logic	40	-
ingest_json_s3.py in parquet_flask/v1	38	2
cmd-paruqet.tf in terraform	36	-
__main__.py in parquet_flask	33	1
statistics_retriever_wrapper.py in parquet_flask/parquet_stat_extractor	33	2

Files With Most Units (Top 50)

File	# lines	# units
query_v2.py in parquet_flask/io_logic	186	34
partitioned_parquet_path.py in parquet_flask/io_logic	127	25
s3_stat_extractor.py in parquet_flask/cdms_lambda_func/index_to_es	130	23
statistics_retriever.py in parquet_flask/parquet_stat_extractor	136	22
aws_ddb.py in parquet_flask/aws	215	22
parquet_query_condition_management_v3.py in parquet_flask/io_logic	198	21
ingest_aws_json.py in parquet_flask/v1	176	20
parquet_query_condition_management_v4.py in parquet_flask/io_logic	137	17
es_middleware.py in parquet_flask/aws	175	16
query_v4.py in parquet_flask/io_logic	173	13
es_abstract.py in parquet_flask/aws	41	12
aws_s3.py in parquet_flask/aws	95	11
raw_query.py in parquet_flask/io_logic	77	10
query_data_doms_custom_pagination.py in parquet_flask/v1	120	10
file_utils.py in parquet_flask/utils	65	9
parallel_json_validator.py in parquet_flask/utils	49	9
cdms_schema.py in parquet_flask/io_logic	145	8
sub_collection_statistics.py in parquet_flask/io_logic	173	8
aws_cred.py in parquet_flask/aws	44	8
general_utils.py in parquet_flask/utils	57	7
metadata_tbl_io.py in parquet_flask/io_logic	26	7
metadata_tbl_es.py in parquet_flask/io_logic	42	7
metadata_tbl_interface.py in parquet_flask/io_logic	20	6
ingest_new_file.py in parquet_flask/io_logic	113	6
parquet_file_es_indexer.py in parquet_flask/cdms_lambda_func/index_to_es	70	6
retrieve_spark_session.py in parquet_flask/io_logic	63	5
parquet_paths_es_retriever.py in parquet_flask/io_logic	75	5
s3_2_sqs.py in parquet_flask/cdms_lambda_func/s3_records	96	5
query_data_doms.py in parquet_flask/v1	100	5
audit_tool.py in parquet_cli/audit_tool	265	5
config.py in parquet_flask/utils	53	4
time_utils.py in parquet_flask/utils	15	4
sanitize_record.py in parquet_flask/io_logic	73	4
s3_event_validator_abstract.py in parquet_flask/cdms_lambda_func/s3_records	13	4
authenticator_filebased.py in parquet_flask/authenticator	27	3
authenticator_aws_secret_manager.py in parquet_flask/authenticator	31	3
parquet_stat_extractor.py in parquet_flask/cdms_lambda_func/index_to_es	28	3
lambda_logger_generator.py in parquet_flask/cdms_lambda_func	25	3
query_data.py in parquet_flask/v1	32	3
__main__.py in parquet_cli/ingest_s3	68	3
authenticator_abstract.py in parquet_flask/authenticator	9	2
authenticator_pass_through.py in parquet_flask/authenticator	7	2
statistics_retriever_wrapper.py in parquet_flask/parquet_stat_extractor	33	2
local_statistics_retriever.py in parquet_flask/parquet_stat_extractor	27	2
local_spark_session.py in parquet_flask/parquet_stat_extractor	11	2
replace_file.py in parquet_flask/io_logic	32	2
aws_sns.py in parquet_flask/aws	13	2
aws_secret_manager.py in parquet_flask/aws	29	2
aws_sqs.py in parquet_flask/aws	12	2
ingest_s3_to_cdms.py in parquet_flask/cdms_lambda_func/ingest_s3_to_cdms	60	2

Files With Long Lines (Top 30)

There are 30 files with lines longer than 120 characters. In total, there are 85 long lines.

File	# lines	# units	# long lines
cdms.demo.2021.12.09.ipynb in documentations/jupyter.notebooks	1089	-	13
query_v4.py in parquet_flask/io_logic	173	13	10
parquet_query_condition_management_v3.py in parquet_flask/io_logic	198	21	7
__main__.py in parquet_cli/ingest_s3	68	3	5
retrieve_spark_session.py in parquet_flask/io_logic	63	5	4
parquet_query_condition_management_v4.py in parquet_flask/io_logic	137	17	4
query_data_doms.py in parquet_flask/v1	100	5	4
cdms_schema.py in parquet_flask/io_logic	145	8	3
ingest_new_file.py in parquet_flask/io_logic	113	6	3
query_data_doms_custom_pagination.py in parquet_flask/v1	120	10	3
index.html in parquet_flask/v1/insitu_query_swagger	55	-	3
audit_tool.py in parquet_cli/audit_tool	265	5	3
spatial_utils.py in parquet_flask/utils	17	1	2
raw_query.py in parquet_flask/io_logic	77	10	2
parquet_paths_es_retriever.py in parquet_flask/io_logic	75	5	2
parquet_file_es_indexer.py in parquet_flask/cdms_lambda_func/index_to_es	70	6	2
s3_2_sqs.py in parquet_flask/cdms_lambda_func/s3_records	96	5	2
file_utils.py in parquet_flask/utils	65	9	1
statistics_retriever.py in parquet_flask/parquet_stat_extractor	136	22	1
sanitize_record.py in parquet_flask/io_logic	73	4	1
aws_cred.py in parquet_flask/aws	44	8	1
aws_ddb.py in parquet_flask/aws	215	22	1
parquet_stat_extractor.py in parquet_flask/cdms_lambda_func/index_to_es	28	3	1
ingest_s3_to_cdms.py in parquet_flask/cdms_lambda_func/ingest_s3_to_cdms	60	2	1
insitu_query_swagger.py in parquet_flask/v1	12	2	1
authenticator_decorator.py in parquet_flask/v1	19	1	1
ingest_aws_json.py in parquet_flask/v1	176	20	1
sub_collection_statistics_endpoint.py in parquet_flask/v1	53	2	1
rotate_keys.bash in root	15	-	1
trigger.s3.ingest.py in one_offs	19	-	1

Correlations

File Size vs. Commits (all time): 112 points

		1089.0	lines of code min: 1.0 average: 59.57 25th percentile: 13.0 median: 31.5 75th percentile: 69.5 max: 1089.0
0	27.0
commits (all time) min: 1.0 \| average: 6.48 \| 25th percentile: 3.0 \| median: 4.0 \| 75th percentile: 7.75 \| max: 27.0

File Size vs. Contributors (all time): 112 points

		1089.0	lines of code min: 1.0 average: 59.57 25th percentile: 13.0 median: 31.5 75th percentile: 69.5 max: 1089.0
0	7.0
contributors (all time) min: 1.0 \| average: 3.08 \| 25th percentile: 2.0 \| median: 3.0 \| 75th percentile: 3.0 \| max: 7.0

File Size vs. Commits (30 days): 0 points

No data for "commits (30d)" vs. "lines of code".

File Size vs. Contributors (30 days): 0 points

No data for "contributors (30d)" vs. "lines of code".

File Size vs. Commits (90 days): 0 points

No data for "commits (90d)" vs. "lines of code".

File Size vs. Contributors (90 days): 0 points

No data for "contributors (90d)" vs. "lines of code".