GoogleCloudPlatform / dataproc-templates
File Age & Freshness

File age measurements show the distribution of file ages (days since the first commit) and the file freshness (days since the latest commit).

Summary
File Change History Overall
File Age Distribution Overall
Days since first update
  • There are 172 files with 22,266 lines of code in files.
    • 159 files that are 366+ days old (21,120 lines of code)
    • 12 files that are 181-365 days old (1,016 lines of code)
    • 0 files that are 91-180 days old (0 lines of code)
    • 1 files that are 31-90 days old (130 lines of code)
    • 0 files that are 1-30 days old (0 lines of code)
94% | 4% | 0% | <1% | 0%
Legend:
366+
181-365
91-180
31-90
1-30

explore: grouped by folders | grouped by age
File Freshness Distribution Overall
Days since last update
  • There are 172 files with 22,266 lines of code in files.
    • 112 files have been last changed 366+ days ago (7,967 lines of code)
    • 50 files have been last changed 181-365 days ago (12,574 lines of code)
    • 5 files have been last changed 91-180 days ago (601 lines of code)
    • 5 files have been last changed 31-90 days ago (1,124 lines of code)
    • 0 files have been last changed 1-30 days ago (0 lines of code)
35% | 56% | 2% | 5% | 0%
Legend:
366+
181-365
91-180
31-90
1-30

explore: grouped by folders | grouped by freshness
File Change History per File Extension
py, java, md, yaml, ipynb, sh, xml, txt, cfg, gitignore, json, in, ini, properties
File Age Distribution per Extension
Days since first update
366+
181-365
91-180
31-90
1-30
ipynb100% | 0% | 0% | 0% | 0%
java93% | 6% | 0% | 0% | 0%
py90% | 8% | 0% | 1% | 0%
xml100% | 0% | 0% | 0% | 0%
yaml100% | 0% | 0% | 0% | 0%
in100% | 0% | 0% | 0% | 0%
cfg100% | 0% | 0% | 0% | 0%
File Freshness Distribution per Extension
Days since last update
366+
181-365
91-180
31-90
1-30
py61% | 12% | 8% | 16% | 0%
java51% | 48% | 0% | 0% | 0%
xml100% | 0% | 0% | 0% | 0%
in100% | 0% | 0% | 0% | 0%
yaml5% | 94% | 0% | 0% | 0%
cfg100% | 0% | 0% | 0% | 0%
ipynb0% | 100% | 0% | 0% | 0%
File Change History per Logical Decomposition
primary
primary (file age distribution)
Days since first update
366+
181-365
91-180
31-90
1-30
notebooks100% | 0% | 0% | 0% | 0%
java93% | 6% | 0% | 0% | 0%
python87% | 10% | 0% | 2% | 0%
airflow100% | 0% | 0% | 0% | 0%
ROOT100% | 0% | 0% | 0% | 0%
primary (file freshness distribution)
Days since last update
366+
181-365
91-180
31-90
1-30
java51% | 48% | 0% | 0% | 0%
python50% | 16% | 11% | 21% | 0%
notebooks14% | 85% | 0% | 0% | 0%
airflow100% | 0% | 0% | 0% | 0%
ROOT0% | 100% | 0% | 0% | 0%
Oldest Files (Top 50)
File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
template_constants.py
in python/dataproc_templates/util
 848 4 2022-04-05 2025-03-04 124 44 ppaglilla@google.com 105878445+vanshaj-bhatia@us...
main.py
in python
 98 2 2022-04-05 2025-03-04 83 37 ppaglilla@google.com 105878445+vanshaj-bhatia@us...
gcs_to_bigquery.py
in python/dataproc_templates/gcs
 93 2 2022-04-05 2023-04-25 29 17 ppaglilla@google.com 105878445+vanshaj-bhatia@us...
argument_parsing.py
in python/dataproc_templates/util
 68 4 2022-04-05 2024-06-24 19 14 ppaglilla@google.com 163002505+rohilla-anuj@user...
setup.py
in python
 58 3 2022-04-05 2024-10-10 22 17 ppaglilla@google.com 105878445+vanshaj-bhatia@us...
template_name.py
in python/dataproc_templates
 46 2 2022-04-05 2025-03-04 78 37 ppaglilla@google.com 105878445+vanshaj-bhatia@us...
base_template.py
in python/dataproc_templates
 18 4 2022-04-05 2022-04-26 5 3 ppaglilla@google.com ppaglilla@google.com
__init__.py
in python/dataproc_templates
 2 - 2022-04-05 2022-04-26 2 2 ppaglilla@google.com agarwalsh@google.com
__init__.py
in python/dataproc_templates/util
 2 - 2022-04-05 2023-01-03 6 5 ppaglilla@google.com vanshajbhatia@google.com
__init__.py
in python/dataproc_templates/gcs
 2 - 2022-04-05 2023-01-03 8 7 ppaglilla@google.com vanshajbhatia@google.com
bigquery_to_gcs.py
in python/dataproc_templates/bigquery
 86 2 2022-04-07 2024-01-18 24 18 surjitsh@google.com 149017703+shubhampathakk@us...
__init__.py
in python/dataproc_templates/bigquery
 2 - 2022-04-07 2025-03-04 3 3 surjitsh@google.com 105878445+vanshaj-bhatia@us...
DataplexGCStoBQ.java
in java/src/main/java/com/google/cloud/dataproc/templates/dataplex
 380 14 2022-04-18 2024-10-08 44 25 nilofr@google.com 57837394+rajc242@users.nore...
TemplateConstants.java
in java/src/main/java/com/google/cloud/dataproc/templates/util
 378 - 2022-04-18 2024-10-08 122 39 nilofr@google.com 57837394+rajc242@users.nore...
PubSubToBQ.java
in java/src/main/java/com/google/cloud/dataproc/templates/pubsub
 186 4 2022-04-18 2023-05-11 22 18 nilofr@google.com 106058340+hhasija@users.nor...
DataProcTemplate.java
in java/src/main/java/com/google/cloud/dataproc/templates/main
 177 6 2022-04-18 2024-10-26 94 32 nilofr@google.com 106058340+hhasija@users.nor...
GCStoBigquery.java
in java/src/main/java/com/google/cloud/dataproc/templates/gcs
 130 3 2022-04-18 2023-05-11 34 22 nilofr@google.com 106058340+hhasija@users.nor...
GeneralTemplate.java
in java/src/main/java/com/google/cloud/dataproc/templates/general
 129 9 2022-04-18 2023-06-12 21 13 nilofr@google.com vaibsinghal@google.com
S3ToBigQuery.java
in java/src/main/java/com/google/cloud/dataproc/templates/s3
 128 3 2022-04-18 2023-05-11 26 19 nilofr@google.com 106058340+hhasija@users.nor...
GCSToSpannerConfig.java
in java/src/main/java/com/google/cloud/dataproc/templates/gcs
 124 15 2022-04-18 2024-11-03 15 12 nilofr@google.com 106058340+hhasija@users.nor...
JDBCToBigQuery.java
in java/src/main/java/com/google/cloud/dataproc/templates/jdbc
 123 4 2022-04-18 2024-10-08 44 21 nilofr@google.com 57837394+rajc242@users.nore...
GeneralTemplateConfig.java
in java/src/main/java/com/google/cloud/dataproc/templates/config
 106 9 2022-04-18 2024-10-08 3 3 nilofr@google.com 57837394+rajc242@users.nore...
BigQueryToGCS.java
in java/src/main/java/com/google/cloud/dataproc/templates/bigquery
 92 3 2022-04-18 2024-09-05 31 23 nilofr@google.com 123699534+edwinobgoogle@use...
HiveToGCS.java
in java/src/main/java/com/google/cloud/dataproc/templates/hive
 86 3 2022-04-18 2023-05-11 36 22 nilofr@google.com 106058340+hhasija@users.nor...
GCSToSpanner.java
in java/src/main/java/com/google/cloud/dataproc/templates/gcs
 83 5 2022-04-18 2024-11-03 23 16 nilofr@google.com 106058340+hhasija@users.nor...
HiveToBigQuery.java
in java/src/main/java/com/google/cloud/dataproc/templates/hive
 79 3 2022-04-18 2024-10-08 30 19 nilofr@google.com 57837394+rajc242@users.nore...
SpannerToGCS.java
in java/src/main/java/com/google/cloud/dataproc/templates/databases
 68 4 2022-04-18 2024-09-24 30 17 nilofr@google.com 57837394+rajc242@users.nore...
SpannerJdbcDialect.java
in java/src/main/java/com/google/cloud/dataproc/dialects
 66 4 2022-04-18 2023-01-03 6 5 nilofr@google.com vanshajbhatia@google.com
JDBCToGCS.java
in java/src/main/java/com/google/cloud/dataproc/templates/jdbc
 64 4 2022-04-18 2023-05-11 37 18 nilofr@google.com 106058340+hhasija@users.nor...
ValidationUtil.java
in java/src/main/java/com/google/cloud/dataproc/templates/util
 59 3 2022-04-18 2022-04-26 2 2 nilofr@google.com agarwalsh@google.com
BaseTemplate.java
in java/src/main/java/com/google/cloud/dataproc/templates
 52 1 2022-04-18 2024-10-26 83 28 nilofr@google.com 106058340+hhasija@users.nor...
OutputConfig.java
in java/src/main/java/com/google/cloud/dataproc/templates/config
 47 9 2022-04-18 2024-10-08 3 3 nilofr@google.com 57837394+rajc242@users.nore...
PropertyUtil.java
in java/src/main/java/com/google/cloud/dataproc/templates/util
 47 4 2022-04-18 2022-04-26 2 2 nilofr@google.com agarwalsh@google.com
InputConfig.java
in java/src/main/java/com/google/cloud/dataproc/templates/config
 37 7 2022-04-18 2022-04-26 2 2 nilofr@google.com agarwalsh@google.com
WordCount.java
in java/src/main/java/com/google/cloud/dataproc/templates/word
 34 2 2022-04-18 2023-05-11 17 14 nilofr@google.com 106058340+hhasija@users.nor...
logback.xml
in java/src/main/resources
 30 - 2022-04-18 2023-01-03 9 10 nilofr@google.com vanshajbhatia@google.com
logback-test.xml
in java/src/main/resources
 30 - 2022-04-18 2023-01-03 9 10 nilofr@google.com vanshajbhatia@google.com
TemplateUtil.java
in java/src/main/java/com/google/cloud/dataproc/templates/util
 22 1 2022-04-18 2024-10-08 3 3 nilofr@google.com 57837394+rajc242@users.nore...
QueryConfig.java
in java/src/main/java/com/google/cloud/dataproc/templates/config
 16 3 2022-04-18 2022-04-26 2 2 nilofr@google.com agarwalsh@google.com
DataprocTemplateException.java
in java/src/main/java/com/google/cloud/dataproc/templates/util
 12 3 2022-04-18 2023-01-03 5 5 nilofr@google.com vanshajbhatia@google.com
tracking.py
in python/dataproc_templates/util
 16 1 2022-04-26 2023-01-03 10 6 agarwalsh@google.com vanshajbhatia@google.com
PubSubToGCS.java
in java/src/main/java/com/google/cloud/dataproc/templates/pubsub
 184 6 2022-05-03 2023-07-31 24 18 jigeorge@google.com 105878445+vanshaj-bhatia@us...
hive_to_bigquery.py
in python/dataproc_templates/hive
 105 2 2022-05-03 2023-01-03 10 8 surjitsh@google.com vanshajbhatia@google.com
__init__.py
in python/dataproc_templates/hive
 2 - 2022-05-03 2022-05-11 3 1 surjitsh@google.com surjitsh@google.com
hive_to_gcs.py
in python/dataproc_templates/hive
 108 2 2022-05-04 2023-04-25 35 24 surjitsh@google.com 105878445+vanshaj-bhatia@us...
GCSToJDBCConfig.java
in java/src/main/java/com/google/cloud/dataproc/templates/gcs
 120 13 2022-05-25 2023-03-16 23 14 hhasija@google.com moukhtar@google.com
GCSToJDBC.java
in java/src/main/java/com/google/cloud/dataproc/templates/gcs
 96 6 2022-05-25 2023-05-11 27 14 hhasija@google.com 106058340+hhasija@users.nor...
gcs_to_bigtable.py
in python/dataproc_templates/gcs
 98 2 2022-05-27 2024-12-02 30 16 nilofr@google.com 57837394+rajc242@users.nore...
hbase_to_gcs.py
in python/dataproc_templates/hbase
 76 2 2022-06-14 2023-04-25 22 15 surjitsh@google.com 105878445+vanshaj-bhatia@us...
__init__.py
in python/dataproc_templates/hbase
 1 - 2022-06-14 2023-01-03 6 5 surjitsh@google.com vanshajbhatia@google.com
Files Not Recently Changed (Top 50)
File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
__init__.py
in python/dataproc_templates
 2 - 2022-04-05 2022-04-26 2 2 ppaglilla@google.com agarwalsh@google.com
QueryConfig.java
in java/src/main/java/com/google/cloud/dataproc/templates/config
 16 3 2022-04-18 2022-04-26 2 2 nilofr@google.com agarwalsh@google.com
base_template.py
in python/dataproc_templates
 18 4 2022-04-05 2022-04-26 5 3 ppaglilla@google.com ppaglilla@google.com
InputConfig.java
in java/src/main/java/com/google/cloud/dataproc/templates/config
 37 7 2022-04-18 2022-04-26 2 2 nilofr@google.com agarwalsh@google.com
PropertyUtil.java
in java/src/main/java/com/google/cloud/dataproc/templates/util
 47 4 2022-04-18 2022-04-26 2 2 nilofr@google.com agarwalsh@google.com
ValidationUtil.java
in java/src/main/java/com/google/cloud/dataproc/templates/util
 59 3 2022-04-18 2022-04-26 2 2 nilofr@google.com agarwalsh@google.com
__init__.py
in python/dataproc_templates/hive
 2 - 2022-05-03 2022-05-11 3 1 surjitsh@google.com surjitsh@google.com
__init__.py
in python/dataproc_templates/snowflake
 1 - 2022-08-19 2023-01-03 7 6 varunikagupta@google.com vanshajbhatia@google.com
__init__.py
in python/dataproc_templates/hbase
 1 - 2022-06-14 2023-01-03 6 5 surjitsh@google.com vanshajbhatia@google.com
__init__.py
in python/dataproc_templates/redshift
 1 - 2022-08-29 2023-01-03 6 6 shivamsomani@google.com vanshajbhatia@google.com
__init__.py
in python/dataproc_templates/mongo
 1 - 2022-08-03 2023-01-03 5 4 hhasija@google.com vanshajbhatia@google.com
__init__.py
in python/dataproc_templates/gcs
 2 - 2022-04-05 2023-01-03 8 7 ppaglilla@google.com vanshajbhatia@google.com
__init__.py
in python/dataproc_templates/util
 2 - 2022-04-05 2023-01-03 6 5 ppaglilla@google.com vanshajbhatia@google.com
DataprocTemplateException.java
in java/src/main/java/com/google/cloud/dataproc/templates/util
 12 3 2022-04-18 2023-01-03 5 5 nilofr@google.com vanshajbhatia@google.com
tracking.py
in python/dataproc_templates/util
 16 1 2022-04-26 2023-01-03 10 6 agarwalsh@google.com vanshajbhatia@google.com
ReadSchemaUtil.java
in java/src/main/java/com/google/cloud/dataproc/templates/util
 22 1 2022-07-19 2023-01-03 6 6 98432795+nikhil6790@users.n... vanshajbhatia@google.com
hbase-site.xml
in python/dataproc_templates/hbase
 28 - 2022-06-15 2023-01-03 6 5 surjitsh@google.com vanshajbhatia@google.com
hbase-site.xml
in java/src/main/resources
 28 - 2022-06-29 2023-01-03 9 7 anishks@google.com vanshajbhatia@google.com
logback-test.xml
in java/src/main/resources
 30 - 2022-04-18 2023-01-03 9 10 nilofr@google.com vanshajbhatia@google.com
logback.xml
in java/src/main/resources
 30 - 2022-04-18 2023-01-03 9 10 nilofr@google.com vanshajbhatia@google.com
47 1 2022-09-22 2023-01-03 6 6 106058340+hhasija@users.nor... vanshajbhatia@google.com
50 1 2022-09-22 2023-01-03 6 6 106058340+hhasija@users.nor... vanshajbhatia@google.com
SpannerJdbcDialect.java
in java/src/main/java/com/google/cloud/dataproc/dialects
 66 4 2022-04-18 2023-01-03 6 5 nilofr@google.com vanshajbhatia@google.com
hive_to_bigquery.py
in python/dataproc_templates/hive
 105 2 2022-05-03 2023-01-03 10 8 surjitsh@google.com vanshajbhatia@google.com
__init__.py
in python/dataproc_templates/hive/util
 1 - 2023-01-17 2023-03-16 5 6 shubu@google.com moukhtar@google.com
cfg
setup.cfg
in python
 2 - 2023-01-18 2023-03-16 5 5 117453385+ankuljain09@users... moukhtar@google.com
__init__.py
in python/dataproc_templates/cassandra
 2 - 2022-11-08 2023-03-16 10 8 anishks@google.com moukhtar@google.com
in
MANIFEST.in
in python
 18 - 2023-01-18 2023-03-16 5 5 117453385+ankuljain09@users... moukhtar@google.com
RedshiftToGCSConfig.java
in java/src/main/java/com/google/cloud/dataproc/templates/databases
 90 12 2022-09-22 2023-03-16 11 11 hhasija@google.com moukhtar@google.com
CassandraToBqConfig.java
in java/src/main/java/com/google/cloud/dataproc/templates/databases
 108 12 2022-09-22 2023-03-16 13 12 anishks@google.com moukhtar@google.com
CassandraToGCSConfig.java
in java/src/main/java/com/google/cloud/dataproc/templates/databases
 116 13 2022-09-21 2023-03-16 15 13 anishks@google.com moukhtar@google.com
GCSToJDBCConfig.java
in java/src/main/java/com/google/cloud/dataproc/templates/gcs
 120 13 2022-05-25 2023-03-16 23 14 hhasija@google.com moukhtar@google.com
SnowflakeToGCSConfig.java
in java/src/main/java/com/google/cloud/dataproc/templates/snowflake
 162 18 2022-07-30 2023-03-16 18 12 vanshajbhatia@google.com moukhtar@google.com
JDBCToGCSConfig.java
in java/src/main/java/com/google/cloud/dataproc/templates/jdbc
 206 24 2022-07-25 2023-03-16 30 18 vanshajbhatia@google.com moukhtar@google.com
__init__.py
in python/dataproc_templates/s3
 1 - 2023-02-21 2023-03-30 7 7 tanyawarrier@google.com hemr@google.com
__init__.py
in python/dataproc_templates/azure
 1 - 2023-02-09 2023-03-30 7 10 moukhtar@google.com hemr@google.com
__init__.py
in python/dataproc_templates/kafka
 2 - 2023-02-20 2023-03-30 8 8 anshumanwins@google.com hemr@google.com
hive_ddl_extractor.py
in python/dataproc_templates/hive/util
 63 2 2023-01-17 2023-03-30 19 17 shubu@google.com hemr@google.com
hbase_to_gcs.py
in python/dataproc_templates/hbase
 76 2 2022-06-14 2023-04-25 22 15 surjitsh@google.com 105878445+vanshaj-bhatia@us...
gcs_to_bigquery.py
in python/dataproc_templates/gcs
 93 2 2022-04-05 2023-04-25 29 17 ppaglilla@google.com 105878445+vanshaj-bhatia@us...
text_to_bigquery.py
in python/dataproc_templates/gcs
 106 2 2022-06-21 2023-04-25 20 13 shradhatyagi@google.com 105878445+vanshaj-bhatia@us...
hive_to_gcs.py
in python/dataproc_templates/hive
 108 2 2022-05-04 2023-04-25 35 24 surjitsh@google.com 105878445+vanshaj-bhatia@us...
cassandra_to_bigquery.py
in python/dataproc_templates/cassandra
 115 2 2022-12-05 2023-04-25 20 13 anishks@google.com 105878445+vanshaj-bhatia@us...
s3_to_bigquery.py
in python/dataproc_templates/s3
 125 2 2023-02-21 2023-04-25 17 12 tanyawarrier@google.com 105878445+vanshaj-bhatia@us...
cassandra_to_gcs.py
in python/dataproc_templates/cassandra
 125 2 2023-01-25 2023-04-25 17 12 118509792+saumyasinha-googl... 105878445+vanshaj-bhatia@us...
gcs_to_gcs.py
in python/dataproc_templates/gcs
 137 2 2022-08-02 2023-04-25 19 12 varunikagupta@google.com 105878445+vanshaj-bhatia@us...
JDBCToJDBCConfig.java
in java/src/main/java/com/google/cloud/dataproc/templates/jdbc
 207 25 2023-03-07 2023-05-02 8 7 poojabasker@google.com tanyawarrier@google.com
__init__.py
in python/dataproc_templates/pubsublite
 2 - 2023-03-07 2023-05-11 13 9 saumyasinha@google.com vanshajbhatia@google.com
WordCount.java
in java/src/main/java/com/google/cloud/dataproc/templates/word
 34 2 2022-04-18 2023-05-11 17 14 nilofr@google.com 106058340+hhasija@users.nor...
dataframe_writer_wrappers.py
in python/dataproc_templates/util
 56 2 2023-03-14 2023-05-11 15 10 nilofr@google.com vanshajbhatia@google.com
Most Recently Created Files (Top 50)
File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
bigquery_to_memorystore.py
in python/dataproc_templates/bigquery
 130 2 2025-03-04 2025-03-04 1 1 105878445+vanshaj-bhatia@us... 105878445+vanshaj-bhatia@us...
BigQueryToJDBCConfig.java
in java/src/main/java/com/google/cloud/dataproc/templates/bigquery
 98 12 2024-10-26 2024-10-26 1 1 106058340+hhasija@users.nor... 106058340+hhasija@users.nor...
BigQueryToJDBC.java
in java/src/main/java/com/google/cloud/dataproc/templates/bigquery
 56 5 2024-10-26 2024-10-26 1 1 106058340+hhasija@users.nor... 106058340+hhasija@users.nor...
GCStoBigTableConfig.java
in java/src/main/java/com/google/cloud/dataproc/templates/gcs
 107 6 2024-09-24 2024-09-24 1 1 57837394+rajc242@users.nore... 57837394+rajc242@users.nore...
SpannerPostgresJDBCDialect.java
in java/src/main/java/com/google/cloud/dataproc/dialects
 52 3 2024-09-24 2024-09-24 1 1 57837394+rajc242@users.nore... 57837394+rajc242@users.nore...
MongoToBQConfig.java
in java/src/main/java/com/google/cloud/dataproc/templates/databases
 105 3 2024-09-16 2024-09-16 1 1 57837394+rajc242@users.nore... 57837394+rajc242@users.nore...
MongoToBQ.java
in java/src/main/java/com/google/cloud/dataproc/templates/databases
 56 4 2024-09-16 2024-09-16 1 1 57837394+rajc242@users.nore... 57837394+rajc242@users.nore...
elasticsearch_to_bigtable.py
in python/dataproc_templates/elasticsearch
 144 2 2024-06-24 2024-11-09 3 1 163002505+rohilla-anuj@user... 163002505+rohilla-anuj@user...
elasticsearch_to_bq.py
in python/dataproc_templates/elasticsearch
 141 2 2024-06-24 2024-11-20 3 1 163002505+rohilla-anuj@user... 163002505+rohilla-anuj@user...
elasticsearch_to_gcs.py
in python/dataproc_templates/elasticsearch
 141 2 2024-06-24 2024-11-09 2 1 163002505+rohilla-anuj@user... 163002505+rohilla-anuj@user...
elasticsearch_transformations.py
in python/dataproc_templates/util
 96 6 2024-06-24 2024-06-24 1 1 163002505+rohilla-anuj@user... 163002505+rohilla-anuj@user...
__init__.py
in python/dataproc_templates/elasticsearch
 1 - 2024-06-24 2024-06-24 1 1 163002505+rohilla-anuj@user... 163002505+rohilla-anuj@user...
secret_manager.py
in python/dataproc_templates/util
 19 2 2024-06-02 2024-06-02 1 1 149653140+itsabhisharma23@u... 149653140+itsabhisharma23@u...
KafkaToGCSDstream.java
in java/src/main/java/com/google/cloud/dataproc/templates/kafka
 161 3 2023-12-22 2024-01-08 5 2 chakreshpatel@google.com 105878445+vanshaj-bhatia@us...
KafkaToBQDstream.java
in java/src/main/java/com/google/cloud/dataproc/templates/kafka
 164 3 2023-12-18 2024-01-02 5 2 chakreshpatel@google.com chakresh84@gmail.com
mongo_to_bq.py
in python/dataproc_templates/mongo
 98 2 2023-10-30 2023-11-27 4 4 satpreet@google.com 105878445+vanshaj-bhatia@us...
postgresql-to-bigquery-notebook.ipynb
in notebooks/postgresql2bq
 1139 - 2023-06-13 2024-09-05 15 10 gabriela.corona03@gmail.com 57837394+rajc242@users.nore...
102 2 2023-06-13 2023-07-04 6 6 gabriela.corona03@gmail.com vaibsinghal@google.com
__init__.py
in notebooks/postgresql2bq
 1 - 2023-06-13 2023-07-04 6 6 gabriela.corona03@gmail.com vaibsinghal@google.com
sql_translation.py
in notebooks/util
 48 2 2023-05-24 2023-07-12 8 6 105909213+shubhamgoogle@use... neil@thirdchimp.net
4 - 2023-05-24 2023-06-12 4 5 105909213+shubhamgoogle@use... vaibsinghal@google.com
__init__.py
in notebooks/oracle2postgres
 1 - 2023-05-24 2023-07-12 5 5 vaibsinghal@google.com neil@thirdchimp.net
OracleToPostgres_parameterize_script.py
in notebooks/oracle2postgres
 133 2 2023-05-18 2023-07-31 11 6 vaibsinghal@google.com 105878445+vanshaj-bhatia@us...
83 2 2023-05-13 2023-07-12 9 3 tanyawarrier@google.com neil@thirdchimp.net
__init__.py
in notebooks/hive2bq
 1 - 2023-05-13 2023-07-12 4 3 tanyawarrier@google.com neil@thirdchimp.net
110 2 2023-05-12 2023-07-31 12 5 tanyawarrier@google.com 105878445+vanshaj-bhatia@us...
__init__.py
in notebooks/oracle2bq
 1 - 2023-05-12 2023-07-04 5 4 tanyawarrier@google.com vaibsinghal@google.com
run_notebook.py
in notebooks
 27 1 2023-05-05 2023-07-12 25 10 nilofr@google.com neil@thirdchimp.net
notebook_constants.py
in notebooks/parameterize_script/util
 115 - 2023-05-03 2023-07-31 29 9 tanyawarrier@google.com 105878445+vanshaj-bhatia@us...
MySqlToSpanner_parameterize_script.py
in notebooks/mysql2spanner
 110 2 2023-05-03 2023-07-31 19 8 tanyawarrier@google.com 105878445+vanshaj-bhatia@us...
argument_parsing.py
in notebooks/parameterize_script/util
 40 2 2023-05-03 2023-07-04 14 6 tanyawarrier@google.com vaibsinghal@google.com
base_parameterize_script.py
in notebooks/parameterize_script
 33 4 2023-05-03 2023-07-04 13 6 tanyawarrier@google.com vaibsinghal@google.com
script_name.py
in notebooks/parameterize_script
 19 2 2023-05-03 2023-07-12 23 9 tanyawarrier@google.com neil@thirdchimp.net
__init__.py
in notebooks/parameterize_script
 2 - 2023-05-03 2023-05-23 4 4 tanyawarrier@google.com neil@thirdchimp.net
__init__.py
in notebooks/mysql2spanner
 1 - 2023-05-03 2023-07-04 9 6 tanyawarrier@google.com vaibsinghal@google.com
__init__.py
in notebooks/parameterize_script/util
 1 - 2023-05-03 2023-06-28 10 6 tanyawarrier@google.com 119853011+poojabasker20@use...
OracleToPostgres_notebook.ipynb
in notebooks/oracle2postgres
 978 - 2023-04-26 2024-09-03 21 12 122343397+vsinghal202@users... 57837394+rajc242@users.nore...
PubSubLiteToBigTable.java
in java/src/main/java/com/google/cloud/dataproc/templates/pubsublite
 146 3 2023-04-17 2024-10-10 10 9 balajiss@google.com 57837394+rajc242@users.nore...
azure_blob_storage_to_bigquery.py
in python/dataproc_templates/azure
 129 2 2023-03-20 2023-05-11 11 13 moukhtar@google.com vanshajbhatia@google.com
mysql_input_manager.py
in notebooks/util/jdbc/engines
 139 8 2023-03-16 2023-07-31 5 2 neil@thirdchimp.net 105878445+vanshaj-bhatia@us...
pubsublite_to_bigtable.py
in python/dataproc_templates/pubsublite
 175 4 2023-03-14 2023-05-11 10 5 tanyawarrier@google.com vanshajbhatia@google.com
dataframe_reader_wrappers.py
in python/dataproc_templates/util
 77 2 2023-03-14 2024-11-09 12 10 nilofr@google.com 163002505+rohilla-anuj@user...
dataframe_writer_wrappers.py
in python/dataproc_templates/util
 56 2 2023-03-14 2023-05-11 15 10 nilofr@google.com vanshajbhatia@google.com
TextToBigquery.java
in java/src/main/java/com/google/cloud/dataproc/templates/gcs
 110 3 2023-03-13 2024-10-10 12 11 hhasija@google.com 57837394+rajc242@users.nore...
jdbc_input_manager_interface.py
in notebooks/util/jdbc
 235 27 2023-03-10 2023-07-31 7 2 neil@thirdchimp.net 105878445+vanshaj-bhatia@us...
oracle_input_manager.py
in notebooks/util/jdbc/engines
 161 9 2023-03-10 2023-07-31 7 2 neil@thirdchimp.net 105878445+vanshaj-bhatia@us...
jdbc_input_manager.py
in notebooks/util/jdbc
 18 1 2023-03-10 2023-07-31 4 2 neil@thirdchimp.net 105878445+vanshaj-bhatia@us...
__init__.py
in notebooks/util/jdbc
 1 - 2023-03-10 2023-07-31 3 2 neil@thirdchimp.net 105878445+vanshaj-bhatia@us...
__init__.py
in notebooks/util/jdbc/engines
 1 - 2023-03-10 2023-07-31 3 2 neil@thirdchimp.net 105878445+vanshaj-bhatia@us...
JDBCToJDBCConfig.java
in java/src/main/java/com/google/cloud/dataproc/templates/jdbc
 207 25 2023-03-07 2023-05-02 8 7 poojabasker@google.com tanyawarrier@google.com
Most Recently Changed Files (Top 50)
File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
template_constants.py
in python/dataproc_templates/util
 848 4 2022-04-05 2025-03-04 124 44 ppaglilla@google.com 105878445+vanshaj-bhatia@us...
bigquery_to_memorystore.py
in python/dataproc_templates/bigquery
 130 2 2025-03-04 2025-03-04 1 1 105878445+vanshaj-bhatia@us... 105878445+vanshaj-bhatia@us...
main.py
in python
 98 2 2022-04-05 2025-03-04 83 37 ppaglilla@google.com 105878445+vanshaj-bhatia@us...
template_name.py
in python/dataproc_templates
 46 2 2022-04-05 2025-03-04 78 37 ppaglilla@google.com 105878445+vanshaj-bhatia@us...
__init__.py
in python/dataproc_templates/bigquery
 2 - 2022-04-07 2025-03-04 3 3 surjitsh@google.com 105878445+vanshaj-bhatia@us...
gcs_to_bigtable.py
in python/dataproc_templates/gcs
 98 2 2022-05-27 2024-12-02 30 16 nilofr@google.com 57837394+rajc242@users.nore...
elasticsearch_to_bq.py
in python/dataproc_templates/elasticsearch
 141 2 2024-06-24 2024-11-20 3 1 163002505+rohilla-anuj@user... 163002505+rohilla-anuj@user...
elasticsearch_to_bigtable.py
in python/dataproc_templates/elasticsearch
 144 2 2024-06-24 2024-11-09 3 1 163002505+rohilla-anuj@user... 163002505+rohilla-anuj@user...
elasticsearch_to_gcs.py
in python/dataproc_templates/elasticsearch
 141 2 2024-06-24 2024-11-09 2 1 163002505+rohilla-anuj@user... 163002505+rohilla-anuj@user...
dataframe_reader_wrappers.py
in python/dataproc_templates/util
 77 2 2023-03-14 2024-11-09 12 10 nilofr@google.com 163002505+rohilla-anuj@user...
GCSToSpannerConfig.java
in java/src/main/java/com/google/cloud/dataproc/templates/gcs
 124 15 2022-04-18 2024-11-03 15 12 nilofr@google.com 106058340+hhasija@users.nor...
GCSToSpanner.java
in java/src/main/java/com/google/cloud/dataproc/templates/gcs
 83 5 2022-04-18 2024-11-03 23 16 nilofr@google.com 106058340+hhasija@users.nor...
DataProcTemplate.java
in java/src/main/java/com/google/cloud/dataproc/templates/main
 177 6 2022-04-18 2024-10-26 94 32 nilofr@google.com 106058340+hhasija@users.nor...
BigQueryToJDBCConfig.java
in java/src/main/java/com/google/cloud/dataproc/templates/bigquery
 98 12 2024-10-26 2024-10-26 1 1 106058340+hhasija@users.nor... 106058340+hhasija@users.nor...
BigQueryToJDBC.java
in java/src/main/java/com/google/cloud/dataproc/templates/bigquery
 56 5 2024-10-26 2024-10-26 1 1 106058340+hhasija@users.nor... 106058340+hhasija@users.nor...
BaseTemplate.java
in java/src/main/java/com/google/cloud/dataproc/templates
 52 1 2022-04-18 2024-10-26 83 28 nilofr@google.com 106058340+hhasija@users.nor...
63 - 2023-01-25 2024-10-24 13 13 surjitsh@google.com surjitsh@google.com
PubSubLiteToBigTable.java
in java/src/main/java/com/google/cloud/dataproc/templates/pubsublite
 146 3 2023-04-17 2024-10-10 10 9 balajiss@google.com 57837394+rajc242@users.nore...
TextToBigquery.java
in java/src/main/java/com/google/cloud/dataproc/templates/gcs
 110 3 2023-03-13 2024-10-10 12 11 hhasija@google.com 57837394+rajc242@users.nore...
setup.py
in python
 58 3 2022-04-05 2024-10-10 22 17 ppaglilla@google.com 105878445+vanshaj-bhatia@us...
DataplexGCStoBQ.java
in java/src/main/java/com/google/cloud/dataproc/templates/dataplex
 380 14 2022-04-18 2024-10-08 44 25 nilofr@google.com 57837394+rajc242@users.nore...
TemplateConstants.java
in java/src/main/java/com/google/cloud/dataproc/templates/util
 378 - 2022-04-18 2024-10-08 122 39 nilofr@google.com 57837394+rajc242@users.nore...
DataplexEntityUtil.java
in java/src/main/java/com/google/cloud/dataproc/templates/util/Dataplex
 239 14 2022-10-17 2024-10-08 9 8 whaite@google.com 57837394+rajc242@users.nore...
KafkaToBQ.java
in java/src/main/java/com/google/cloud/dataproc/templates/kafka
 152 4 2022-06-17 2024-10-08 28 17 vanshajbhatia@google.com 57837394+rajc242@users.nore...
JDBCToBigQuery.java
in java/src/main/java/com/google/cloud/dataproc/templates/jdbc
 123 4 2022-04-18 2024-10-08 44 21 nilofr@google.com 57837394+rajc242@users.nore...
GeneralTemplateConfig.java
in java/src/main/java/com/google/cloud/dataproc/templates/config
 106 9 2022-04-18 2024-10-08 3 3 nilofr@google.com 57837394+rajc242@users.nore...
HiveToBigQuery.java
in java/src/main/java/com/google/cloud/dataproc/templates/hive
 79 3 2022-04-18 2024-10-08 30 19 nilofr@google.com 57837394+rajc242@users.nore...
CassandraToBQ.java
in java/src/main/java/com/google/cloud/dataproc/templates/databases
 61 4 2022-09-19 2024-10-08 27 16 anishks@google.com 57837394+rajc242@users.nore...
OutputConfig.java
in java/src/main/java/com/google/cloud/dataproc/templates/config
 47 9 2022-04-18 2024-10-08 3 3 nilofr@google.com 57837394+rajc242@users.nore...
DataplexAssetUtil.java
in java/src/main/java/com/google/cloud/dataproc/templates/util/Dataplex
 40 5 2022-10-17 2024-10-08 9 8 whaite@google.com 57837394+rajc242@users.nore...
DataplexAPIUtil.java
in java/src/main/java/com/google/cloud/dataproc/templates/util/Dataplex
 27 1 2022-10-17 2024-10-08 9 8 whaite@google.com 57837394+rajc242@users.nore...
TemplateUtil.java
in java/src/main/java/com/google/cloud/dataproc/templates/util
 22 1 2022-04-18 2024-10-08 3 3 nilofr@google.com 57837394+rajc242@users.nore...
JDBCToSpannerConfig.java
in java/src/main/java/com/google/cloud/dataproc/templates/jdbc
 191 26 2022-10-05 2024-09-24 21 17 hhasija@google.com 57837394+rajc242@users.nore...
SpannerToGCSConfig.java
in java/src/main/java/com/google/cloud/dataproc/templates/databases
 178 21 2022-09-21 2024-09-24 11 11 vanshajbhatia@google.com 57837394+rajc242@users.nore...
GCStoBigTableConfig.java
in java/src/main/java/com/google/cloud/dataproc/templates/gcs
 107 6 2024-09-24 2024-09-24 1 1 57837394+rajc242@users.nore... 57837394+rajc242@users.nore...
JDBCToSpanner.java
in java/src/main/java/com/google/cloud/dataproc/templates/jdbc
 99 5 2022-10-05 2024-09-24 24 17 hhasija@google.com 57837394+rajc242@users.nore...
GCStoBigTable.java
in java/src/main/java/com/google/cloud/dataproc/templates/gcs
 89 5 2022-12-09 2024-09-24 16 11 balajiss@google.com 57837394+rajc242@users.nore...
SpannerToGCS.java
in java/src/main/java/com/google/cloud/dataproc/templates/databases
 68 4 2022-04-18 2024-09-24 30 17 nilofr@google.com 57837394+rajc242@users.nore...
SpannerPostgresJDBCDialect.java
in java/src/main/java/com/google/cloud/dataproc/dialects
 52 3 2024-09-24 2024-09-24 1 1 57837394+rajc242@users.nore... 57837394+rajc242@users.nore...
MongoToBQConfig.java
in java/src/main/java/com/google/cloud/dataproc/templates/databases
 105 3 2024-09-16 2024-09-16 1 1 57837394+rajc242@users.nore... 57837394+rajc242@users.nore...
MongoToBQ.java
in java/src/main/java/com/google/cloud/dataproc/templates/databases
 56 4 2024-09-16 2024-09-16 1 1 57837394+rajc242@users.nore... 57837394+rajc242@users.nore...
postgresql-to-bigquery-notebook.ipynb
in notebooks/postgresql2bq
 1139 - 2023-06-13 2024-09-05 15 10 gabriela.corona03@gmail.com 57837394+rajc242@users.nore...
BigQueryToGCS.java
in java/src/main/java/com/google/cloud/dataproc/templates/bigquery
 92 3 2022-04-18 2024-09-05 31 23 nilofr@google.com 123699534+edwinobgoogle@use...
version.py
in python
 1 - 2023-01-18 2024-09-05 23 14 117453385+ankuljain09@users... agarwalsh@google.com
OracleToPostgres_notebook.ipynb
in notebooks/oracle2postgres
 978 - 2023-04-26 2024-09-03 21 12 122343397+vsinghal202@users... 57837394+rajc242@users.nore...
HiveToBigquery_notebook.ipynb
in notebooks/hive2bq
 932 - 2022-10-01 2024-09-03 32 21 agarwalsh@google.com 57837394+rajc242@users.nore...
mssql-to-postgres-notebook.ipynb
in notebooks/mssql2postgresql
 919 - 2022-10-01 2024-09-03 34 20 agarwalsh@google.com 57837394+rajc242@users.nore...
911 - 2022-10-24 2024-09-03 36 23 varunikagupta@google.com 57837394+rajc242@users.nore...
MySqlToSpanner_notebook.ipynb
in notebooks/mysql2spanner
 903 - 2022-10-01 2024-09-03 46 23 agarwalsh@google.com 57837394+rajc242@users.nore...
OracleToSpanner_notebook.ipynb
in notebooks/oracle2spanner
 894 - 2022-10-14 2024-09-03 46 25 surjitsh@google.com 57837394+rajc242@users.nore...