GoogleCloudPlatform / datacatalog-connectors-hive

Intro

File size measurements show the distribution of size of files.
Files are classified in four categories based on their size (lines of code): 1-100 (very small files), 101-200 (small files), 201-500 (medium size files), 501-1000 (long files), 1001+(very long files).
It is a good practice to keep files small. Long files may become "bloaters", code that have increased to such gargantuan proportions that they are hard to work with.

Learn more...

File Size Overall

There are 69 files with 3,027 lines of code.

0 very long files (0 lines of code)
0 long files (0 lines of code)
0 medium size files (0 lines of codeclsfd_ftr_w_mp_ins)
8 small files (1,082 lines of code)
61 very small files (1,945 lines of code)

Legend:

1001+

501-1000

201-500

101-200

1-100

explore: grouped by folders | grouped by size | sunburst | 3D view

File Size per Extension

1001+

501-1000

201-500

101-200

1-100

File Size per Logical Decomposition

primary

1001+

501-1000

201-500

101-200

1-100

Longest Files (Top 50)

File	# lines	# units
datacatalog_tag_template_factory.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas/prepare	200	16
datacatalog_tag_factory.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas/prepare	192	14
datacatalog_synchronizer.py in google-datacatalog-hive-connector/src/google/datacatalog_connectors/hive/sync	127	8
metadata_event_synchronizer.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas/sync	126	10
apache_atlas2datacatalog_cli.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas	115	11
metadata_event_scraper.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas/scrape	113	6
metadata_synchronizer.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas/sync	108	13
datacatalog_entry_factory.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas/prepare	101	8
metadata_sync_event_scraper.py in google-datacatalog-hive-connector/src/google/datacatalog_connectors/hive/scrape	99	8
apache_atlas_facade.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas/scrape	97	8
datacatalog_entry_factory.py in google-datacatalog-hive-connector/src/google/datacatalog_connectors/hive/prepare	96	6
HiveMetastoreListener.java in hive-metastore-listener/src/main/java/com/google/datacatalog_connectors/hive/metastore	93	7
metadata_scraper.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas/scrape	92	8
assembled_entry_factory.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas/prepare	89	4
cleanup_datacatalog.py in google-datacatalog-apache-atlas-connector/tools	67	3
cloudbuild.connector.yaml in google-datacatalog-apache-atlas-connector	64	-
cloudbuild.connector.yaml in google-datacatalog-hive-connector	64	-
metadata_database_scraper.py in google-datacatalog-hive-connector/src/google/datacatalog_connectors/hive/scrape	64	3
TableMetadata.java in hive-metastore-listener/src/main/java/com/google/datacatalog_connectors/hive/metastore/domain	60	16
datacatalog_cli.py in google-datacatalog-hive-connector/src/google/datacatalog_connectors/hive	59	3
HiveMetadataBuilder.java in hive-metastore-listener/src/main/java/com/google/datacatalog_connectors/hive/metastore	55	4
PubSubWrapper.java in hive-metastore-listener/src/main/java/com/google/datacatalog_connectors/hive/metastore/gateways	54	4
cleanup_datacatalog.py in google-datacatalog-hive-connector/tools	54	2
metadata_event_enricher.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas/scrape	49	5
metadata_enricher.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas/scrape	49	4
DatabaseMetadata.java in hive-metastore-listener/src/main/java/com/google/datacatalog_connectors/hive/metastore/domain	39	10
assembled_entry_factory.py in google-datacatalog-hive-connector/src/google/datacatalog_connectors/hive/prepare	39	4
table.py in google-datacatalog-hive-connector/src/google/datacatalog_connectors/hive/entities	36	1
setup.py in google-datacatalog-hive-connector	36	-
entry_relationship_mapper.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas/prepare	34	4
AlterTableEventRequest.java in hive-metastore-listener/src/main/java/com/google/datacatalog_connectors/hive/metastore/domain	33	8
setup.py in google-datacatalog-apache-atlas-connector	32	-
app.py in google-datacatalog-hive-connector	29	1
DropDatabaseEventRequest.java in hive-metastore-listener/src/main/java/com/google/datacatalog_connectors/hive/metastore/domain	28	7
CreateDatabaseEventRequest.java in hive-metastore-listener/src/main/java/com/google/datacatalog_connectors/hive/metastore/domain	28	7
constant.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas/prepare	28	-
CreateTableEventRequest.java in hive-metastore-listener/src/main/java/com/google/datacatalog_connectors/hive/metastore/domain	25	6
DropTableEventRequest.java in hive-metastore-listener/src/main/java/com/google/datacatalog_connectors/hive/metastore/domain	25	6
FieldSchemaMetadata.java in hive-metastore-listener/src/main/java/com/google/datacatalog_connectors/hive/metastore/domain	24	6
hive2datacatalog_csv_extractor.py in google-datacatalog-hive-connector/tools/hive_csv_extractor	22	2
datacatalog_attribute_normalizer.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas/prepare	21	3
column.py in google-datacatalog-hive-connector/src/google/datacatalog_connectors/hive/entities	21	1
table_storage.py in google-datacatalog-hive-connector/src/google/datacatalog_connectors/hive/entities	19	1
StorageDescriptorMetadata.java in hive-metastore-listener/src/main/java/com/google/datacatalog_connectors/hive/metastore/domain	18	4
database.py in google-datacatalog-hive-connector/src/google/datacatalog_connectors/hive/entities	18	1
table_params.py in google-datacatalog-hive-connector/src/google/datacatalog_connectors/hive/entities	18	1
hive2datacatalog_message_event_client_sample.py in google-datacatalog-hive-connector/tools	17	1
apache_atlas_event_facade.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas/scrape	16	2
cloudbuild.hook.yaml in google-datacatalog-hive-connector	15	-
__init__.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas/scrape	14	-

Files With Most Units (Top 43)

File	# lines	# units
TableMetadata.java in hive-metastore-listener/src/main/java/com/google/datacatalog_connectors/hive/metastore/domain	60	16
datacatalog_tag_template_factory.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas/prepare	200	16
datacatalog_tag_factory.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas/prepare	192	14
metadata_synchronizer.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas/sync	108	13
apache_atlas2datacatalog_cli.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas	115	11
DatabaseMetadata.java in hive-metastore-listener/src/main/java/com/google/datacatalog_connectors/hive/metastore/domain	39	10
metadata_event_synchronizer.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas/sync	126	10
AlterTableEventRequest.java in hive-metastore-listener/src/main/java/com/google/datacatalog_connectors/hive/metastore/domain	33	8
apache_atlas_facade.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas/scrape	97	8
metadata_scraper.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas/scrape	92	8
datacatalog_entry_factory.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas/prepare	101	8
metadata_sync_event_scraper.py in google-datacatalog-hive-connector/src/google/datacatalog_connectors/hive/scrape	99	8
datacatalog_synchronizer.py in google-datacatalog-hive-connector/src/google/datacatalog_connectors/hive/sync	127	8
HiveMetastoreListener.java in hive-metastore-listener/src/main/java/com/google/datacatalog_connectors/hive/metastore	93	7
DropDatabaseEventRequest.java in hive-metastore-listener/src/main/java/com/google/datacatalog_connectors/hive/metastore/domain	28	7
CreateDatabaseEventRequest.java in hive-metastore-listener/src/main/java/com/google/datacatalog_connectors/hive/metastore/domain	28	7
CreateTableEventRequest.java in hive-metastore-listener/src/main/java/com/google/datacatalog_connectors/hive/metastore/domain	25	6
DropTableEventRequest.java in hive-metastore-listener/src/main/java/com/google/datacatalog_connectors/hive/metastore/domain	25	6
FieldSchemaMetadata.java in hive-metastore-listener/src/main/java/com/google/datacatalog_connectors/hive/metastore/domain	24	6
metadata_event_scraper.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas/scrape	113	6
datacatalog_entry_factory.py in google-datacatalog-hive-connector/src/google/datacatalog_connectors/hive/prepare	96	6
metadata_event_enricher.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas/scrape	49	5
StorageDescriptorMetadata.java in hive-metastore-listener/src/main/java/com/google/datacatalog_connectors/hive/metastore/domain	18	4
HiveMetadataBuilder.java in hive-metastore-listener/src/main/java/com/google/datacatalog_connectors/hive/metastore	55	4
PubSubWrapper.java in hive-metastore-listener/src/main/java/com/google/datacatalog_connectors/hive/metastore/gateways	54	4
metadata_enricher.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas/scrape	49	4
entry_relationship_mapper.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas/prepare	34	4
assembled_entry_factory.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas/prepare	89	4
assembled_entry_factory.py in google-datacatalog-hive-connector/src/google/datacatalog_connectors/hive/prepare	39	4
cleanup_datacatalog.py in google-datacatalog-apache-atlas-connector/tools	67	3
datacatalog_attribute_normalizer.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas/prepare	21	3
metadata_database_scraper.py in google-datacatalog-hive-connector/src/google/datacatalog_connectors/hive/scrape	64	3
datacatalog_cli.py in google-datacatalog-hive-connector/src/google/datacatalog_connectors/hive	59	3
apache_atlas_event_facade.py in google-datacatalog-apache-atlas-connector/src/google/datacatalog_connectors/apache_atlas/scrape	16	2
cleanup_datacatalog.py in google-datacatalog-hive-connector/tools	54	2
hive2datacatalog_csv_extractor.py in google-datacatalog-hive-connector/tools/hive_csv_extractor	22	2
hive2datacatalog_message_event_client_sample.py in google-datacatalog-hive-connector/tools	17	1
table_storage.py in google-datacatalog-hive-connector/src/google/datacatalog_connectors/hive/entities	19	1
database.py in google-datacatalog-hive-connector/src/google/datacatalog_connectors/hive/entities	18	1
table_params.py in google-datacatalog-hive-connector/src/google/datacatalog_connectors/hive/entities	18	1
column.py in google-datacatalog-hive-connector/src/google/datacatalog_connectors/hive/entities	21	1
table.py in google-datacatalog-hive-connector/src/google/datacatalog_connectors/hive/entities	36	1
app.py in google-datacatalog-hive-connector	29	1

Files With Long Lines (Top 3)

There are 3 files with lines longer than 120 characters. In total, there are 3 long lines.

File	# lines	# units	# long lines
cloudbuild.connector.yaml in google-datacatalog-apache-atlas-connector	64	-	1
cloudbuild.connector.yaml in google-datacatalog-hive-connector	64	-	1
cloudbuild.hook.yaml in google-datacatalog-hive-connector	15	-	1

Correlations

File Size vs. Commits (all time): 56 points

		200.0	lines of code min: 1.0 average: 45.38 25th percentile: 8.0 median: 25.0 75th percentile: 66.25 max: 200.0
0	7.0
commits (all time) min: 1.0 \| average: 1.46 \| 25th percentile: 1.0 \| median: 1.0 \| 75th percentile: 1.75 \| max: 7.0

File Size vs. Contributors (all time): 56 points

		200.0	lines of code min: 1.0 average: 45.38 25th percentile: 8.0 median: 25.0 75th percentile: 66.25 max: 200.0
0	1.0
contributors (all time) min: 1.0 \| average: 1.0 \| 25th percentile: 1.0 \| median: 1.0 \| 75th percentile: 1.0 \| max: 1.0

File Size vs. Commits (30 days): 0 points

No data for "commits (30d)" vs. "lines of code".

File Size vs. Contributors (30 days): 0 points

No data for "contributors (30d)" vs. "lines of code".

File Size vs. Commits (90 days): 0 points

No data for "commits (90d)" vs. "lines of code".

File Size vs. Contributors (90 days): 0 points

No data for "contributors (90d)" vs. "lines of code".