duplicated block id: 1
size: 62 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (695:756)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (713:774)

duplicated block id: 2
size: 56 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (708:763)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (701:756)

duplicated block id: 3
size: 56 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (708:763)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (719:774)

duplicated block id: 4
size: 44 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (643:686)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (835:878)

duplicated block id: 5
size: 44 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (180:223)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (194:237)

duplicated block id: 6
size: 36 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (897:932)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1104:1139)

duplicated block id: 7
size: 35 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (121:155)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (135:169)

duplicated block id: 8
size: 35 cleaned lines of code
in 2 files:
 - notebooks/util/jdbc/engines/mysql_input_manager.py (69:107)
 - notebooks/util/jdbc/engines/oracle_input_manager.py (76:116)

duplicated block id: 9
size: 35 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (898:932)
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (877:911)

duplicated block id: 10
size: 35 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (877:911)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1105:1139)

duplicated block id: 11
size: 32 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (170:201)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (182:213)

duplicated block id: 12
size: 31 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (166:196)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (171:201)

duplicated block id: 13
size: 31 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (874:904)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (866:896)

duplicated block id: 14
size: 30 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/gcs/GCSToSpanner.java (73:106)
 - java/src/main/java/com/google/cloud/dataproc/templates/jdbc/JDBCToSpanner.java (76:108)

duplicated block id: 15
size: 30 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (1:30)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (1:30)

duplicated block id: 16
size: 28 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (475:502)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (399:426)

duplicated block id: 17
size: 28 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (898:925)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (869:896)

duplicated block id: 18
size: 28 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (869:896)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1105:1132)

duplicated block id: 19
size: 28 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (720:747)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (729:756)

duplicated block id: 20
size: 28 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (721:748)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (924:951)

duplicated block id: 21
size: 27 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (877:903)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (855:881)

duplicated block id: 22
size: 27 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (528:554)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (855:881)

duplicated block id: 23
size: 27 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (528:554)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (868:894)

duplicated block id: 24
size: 27 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (952:978)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (868:894)

duplicated block id: 25
size: 27 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (730:756)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (924:950)

duplicated block id: 26
size: 27 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (855:881)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (868:894)

duplicated block id: 27
size: 27 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (877:903)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (952:978)

duplicated block id: 28
size: 27 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (175:201)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (182:208)

duplicated block id: 29
size: 27 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (893:919)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (952:978)

duplicated block id: 30
size: 27 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (893:919)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (855:881)

duplicated block id: 31
size: 27 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (893:919)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (868:894)

duplicated block id: 32
size: 27 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (528:554)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (952:978)

duplicated block id: 33
size: 27 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (893:919)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (877:903)

duplicated block id: 34
size: 27 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (855:881)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (952:978)

duplicated block id: 35
size: 27 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (877:903)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (868:894)

duplicated block id: 36
size: 27 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (528:554)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (893:919)

duplicated block id: 37
size: 27 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (528:554)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (877:903)

duplicated block id: 38
size: 26 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (301:326)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (317:342)

duplicated block id: 39
size: 25 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (1:25)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (1:25)

duplicated block id: 40
size: 25 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (1:25)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (1:25)

duplicated block id: 41
size: 25 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (398:422)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (399:423)

duplicated block id: 42
size: 25 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (398:422)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (475:499)

duplicated block id: 43
size: 25 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (660:684)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (762:786)

duplicated block id: 44
size: 24 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (535:558)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (558:581)

duplicated block id: 45
size: 24 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (790:813)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (808:831)

duplicated block id: 46
size: 24 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:30)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:30)

duplicated block id: 47
size: 24 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (790:813)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (897:920)

duplicated block id: 48
size: 24 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (897:920)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (808:831)

duplicated block id: 49
size: 24 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (203:226)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (207:230)

duplicated block id: 50
size: 23 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (59:81)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (71:93)

duplicated block id: 51
size: 22 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (143:164)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (137:158)

duplicated block id: 52
size: 22 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (647:668)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (861:882)

duplicated block id: 53
size: 22 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (129:150)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (137:158)

duplicated block id: 54
size: 22 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (669:690)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (676:697)

duplicated block id: 55
size: 22 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (175:196)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (194:215)

duplicated block id: 56
size: 22 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (152:173)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (160:181)

duplicated block id: 57
size: 22 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (194:215)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (187:208)

duplicated block id: 58
size: 22 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (278:299)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (293:314)

duplicated block id: 59
size: 21 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (452:472)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (531:551)

duplicated block id: 60
size: 21 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (1:21)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (1:21)

duplicated block id: 61
size: 21 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (1:21)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (1:21)

duplicated block id: 62
size: 21 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (82:102)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (88:108)

duplicated block id: 63
size: 21 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (1:21)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (1:21)

duplicated block id: 64
size: 21 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (488:508)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (558:578)

duplicated block id: 65
size: 21 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (488:508)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (535:555)

duplicated block id: 66
size: 21 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (140:160)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (183:203)

duplicated block id: 67
size: 21 cleaned lines of code
in 2 files:
 - airflow/dags/submit_pyspark_dataproc_template.py (47:73)
 - airflow/dags/submit_spark_dataproc_template.py (50:76)

duplicated block id: 68
size: 20 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (893:912)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1113:1132)

duplicated block id: 69
size: 20 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (489:508)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (625:644)

duplicated block id: 70
size: 20 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (7:26)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (7:26)

duplicated block id: 71
size: 20 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (528:547)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1113:1132)

duplicated block id: 72
size: 20 cleaned lines of code
in 2 files:
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (868:887)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1113:1132)

duplicated block id: 73
size: 20 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (514:533)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (532:551)

duplicated block id: 74
size: 20 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (625:644)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (559:578)

duplicated block id: 75
size: 20 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (906:925)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (952:971)

duplicated block id: 76
size: 20 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (7:26)
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (7:26)

duplicated block id: 77
size: 20 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (885:904)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (952:971)

duplicated block id: 78
size: 20 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (906:925)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (855:874)

duplicated block id: 79
size: 20 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (71:90)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (69:88)

duplicated block id: 80
size: 20 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (885:904)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (855:874)

duplicated block id: 81
size: 20 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (7:26)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (7:26)

duplicated block id: 82
size: 20 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (7:26)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (7:26)

duplicated block id: 83
size: 20 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (528:547)
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (906:925)

duplicated block id: 84
size: 20 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (885:904)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (868:887)

duplicated block id: 85
size: 20 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (952:971)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1113:1132)

duplicated block id: 86
size: 20 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (885:904)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (893:912)

duplicated block id: 87
size: 20 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (8:27)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (12:31)

duplicated block id: 88
size: 20 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (514:533)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (453:472)

duplicated block id: 89
size: 20 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (536:555)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (625:644)

duplicated block id: 90
size: 20 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (906:925)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (893:912)

duplicated block id: 91
size: 20 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (528:547)
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (885:904)

duplicated block id: 92
size: 20 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (7:26)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (7:26)

duplicated block id: 93
size: 20 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (906:925)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (868:887)

duplicated block id: 94
size: 20 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (7:26)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (7:26)

duplicated block id: 95
size: 20 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (855:874)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1113:1132)

duplicated block id: 96
size: 19 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (220:238)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (226:244)

duplicated block id: 97
size: 19 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (92:110)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (89:107)

duplicated block id: 98
size: 19 cleaned lines of code
in 2 files:
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (8:26)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (12:30)

duplicated block id: 99
size: 19 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (8:26)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (12:30)

duplicated block id: 100
size: 19 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (50:68)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (50:68)

duplicated block id: 101
size: 19 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (12:30)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (8:26)

duplicated block id: 102
size: 19 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (50:68)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (50:68)

duplicated block id: 103
size: 19 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (7:25)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (7:25)

duplicated block id: 104
size: 19 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (81:103)
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (130:152)

duplicated block id: 105
size: 19 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (8:26)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (12:30)

duplicated block id: 106
size: 19 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (7:25)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (7:25)

duplicated block id: 107
size: 19 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (12:30)
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (8:26)

duplicated block id: 108
size: 19 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (7:25)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (7:25)

duplicated block id: 109
size: 19 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (12:30)
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (8:26)

duplicated block id: 110
size: 19 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (12:30)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (8:26)

duplicated block id: 111
size: 19 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/databases/CassandraToBQ.java (53:76)
 - java/src/main/java/com/google/cloud/dataproc/templates/databases/CassandraToGCS.java (52:74)

duplicated block id: 112
size: 19 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (7:25)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (7:25)

duplicated block id: 113
size: 19 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (7:25)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (7:25)

duplicated block id: 114
size: 19 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (7:25)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (7:25)

duplicated block id: 115
size: 19 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (50:68)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (50:68)

duplicated block id: 116
size: 18 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (841:858)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (757:774)

duplicated block id: 117
size: 18 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (739:756)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (720:737)

duplicated block id: 118
size: 18 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (676:693)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (861:878)

duplicated block id: 119
size: 18 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (739:756)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (841:858)

duplicated block id: 120
size: 18 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (669:686)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (647:664)

duplicated block id: 121
size: 18 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (8:25)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (12:29)

duplicated block id: 122
size: 18 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (739:756)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (713:730)

duplicated block id: 123
size: 18 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (730:747)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (731:748)

duplicated block id: 124
size: 18 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (676:693)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (647:664)

duplicated block id: 125
size: 18 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (132:149)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (165:182)

duplicated block id: 126
size: 18 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (730:747)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (720:737)

duplicated block id: 127
size: 18 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (12:29)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (8:25)

duplicated block id: 128
size: 18 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/kafka/KafkaToBQDstream.java (104:125)
 - java/src/main/java/com/google/cloud/dataproc/templates/kafka/KafkaToGCSDstream.java (106:127)

duplicated block id: 129
size: 18 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (713:730)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (933:950)

duplicated block id: 130
size: 18 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (746:763)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (841:858)

duplicated block id: 131
size: 18 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (720:737)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (933:950)

duplicated block id: 132
size: 18 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (8:25)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (12:29)

duplicated block id: 133
size: 18 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (730:747)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (713:730)

duplicated block id: 134
size: 18 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (739:756)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (731:748)

duplicated block id: 135
size: 18 cleaned lines of code
in 2 files:
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (731:748)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (933:950)

duplicated block id: 136
size: 18 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (12:29)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (8:25)

duplicated block id: 137
size: 17 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (203:219)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (221:237)

duplicated block id: 138
size: 17 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (146:162)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (151:167)

duplicated block id: 139
size: 17 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (132:148)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (157:173)

duplicated block id: 140
size: 17 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (750:766)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (957:973)

duplicated block id: 141
size: 17 cleaned lines of code
in 2 files:
 - java/src/main/resources/hbase-site.xml (1:59)
 - python/dataproc_templates/hbase/hbase-site.xml (1:59)

duplicated block id: 142
size: 17 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (86:102)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (89:105)

duplicated block id: 143
size: 17 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/gcs/GCSToSpannerConfig.java (103:133)
 - java/src/main/java/com/google/cloud/dataproc/templates/jdbc/JDBCToSpannerConfig.java (200:230)

duplicated block id: 144
size: 17 cleaned lines of code
in 2 files:
 - java/src/main/resources/logback-test.xml (20:49)
 - java/src/main/resources/logback.xml (20:49)

duplicated block id: 145
size: 17 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (528:544)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (696:712)

duplicated block id: 146
size: 16 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (329:344)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (328:343)

duplicated block id: 147
size: 16 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (367:382)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (381:396)

duplicated block id: 148
size: 16 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (435:450)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (476:491)

duplicated block id: 149
size: 16 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (506:521)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (531:546)

duplicated block id: 150
size: 16 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (253:268)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (292:307)

duplicated block id: 151
size: 16 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (278:293)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (375:390)

duplicated block id: 152
size: 16 cleaned lines of code
in 2 files:
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (188:205)
 - python/dataproc_templates/jdbc/jdbc_to_jdbc.py (240:256)

duplicated block id: 153
size: 16 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (368:383)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (364:379)

duplicated block id: 154
size: 15 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (151:165)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (189:203)

duplicated block id: 155
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (71:85)
 - python/dataproc_templates/redshift/redshift_to_gcs.py (99:113)

duplicated block id: 156
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (78:92)
 - python/dataproc_templates/hbase/hbase_to_gcs.py (61:75)

duplicated block id: 157
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_bigquery.py (59:73)
 - python/dataproc_templates/jdbc/jdbc_to_jdbc.py (148:162)

duplicated block id: 158
size: 15 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (514:528)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (494:508)

duplicated block id: 159
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (71:85)
 - python/dataproc_templates/hbase/hbase_to_gcs.py (61:75)

duplicated block id: 160
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (90:104)
 - python/dataproc_templates/cassandra/cassandra_to_bigquery.py (59:73)

duplicated block id: 161
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hive/hive_to_bigquery.py (74:88)
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (138:152)

duplicated block id: 162
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/redshift/redshift_to_gcs.py (99:113)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (121:136)

duplicated block id: 163
size: 15 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (304:318)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (291:305)

duplicated block id: 164
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (90:104)
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (138:152)

duplicated block id: 165
size: 15 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (7:21)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (7:21)

duplicated block id: 166
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (78:92)
 - python/dataproc_templates/gcs/gcs_to_mongo.py (80:94)

duplicated block id: 167
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_bigquery.py (59:73)
 - python/dataproc_templates/gcs/gcs_to_gcs.py (107:122)

duplicated block id: 168
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/text_to_bigquery.py (68:82)
 - python/dataproc_templates/hive/hive_to_bigquery.py (74:88)

duplicated block id: 169
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (90:104)
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (69:83)

duplicated block id: 170
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (78:92)
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (90:104)

duplicated block id: 171
size: 15 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsub/PubSubToBigTable.java (73:90)
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsub/PubSubToGCS.java (74:91)

duplicated block id: 172
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/text_to_bigquery.py (68:82)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (121:136)

duplicated block id: 173
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_gcs.py (107:122)
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (69:83)

duplicated block id: 174
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (69:83)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (121:136)

duplicated block id: 175
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_bigquery.py (59:73)
 - python/dataproc_templates/redshift/redshift_to_gcs.py (99:113)

duplicated block id: 176
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (71:85)
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (69:83)

duplicated block id: 177
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/text_to_bigquery.py (68:82)
 - python/dataproc_templates/hbase/hbase_to_gcs.py (61:75)

duplicated block id: 178
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hbase/hbase_to_gcs.py (61:75)
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (138:152)

duplicated block id: 179
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/text_to_bigquery.py (68:82)
 - python/dataproc_templates/redshift/redshift_to_gcs.py (99:113)

duplicated block id: 180
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_mongo.py (80:94)
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (138:152)

duplicated block id: 181
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_bigquery.py (59:73)
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (69:83)

duplicated block id: 182
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_bigquery.py (59:73)
 - python/dataproc_templates/hive/hive_to_bigquery.py (74:88)

duplicated block id: 183
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_gcs.py (107:122)
 - python/dataproc_templates/gcs/text_to_bigquery.py (68:82)

duplicated block id: 184
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (138:152)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (121:136)

duplicated block id: 185
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (71:85)
 - python/dataproc_templates/gcs/gcs_to_mongo.py (80:94)

duplicated block id: 186
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_bigquery.py (59:73)
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (138:152)

duplicated block id: 187
size: 15 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (7:21)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (7:21)

duplicated block id: 188
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_mongo.py (80:94)
 - python/dataproc_templates/redshift/redshift_to_gcs.py (99:113)

duplicated block id: 189
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (90:104)
 - python/dataproc_templates/jdbc/jdbc_to_jdbc.py (148:162)

duplicated block id: 190
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (71:85)
 - python/dataproc_templates/gcs/gcs_to_gcs.py (107:122)

duplicated block id: 191
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (90:104)
 - python/dataproc_templates/hbase/hbase_to_gcs.py (61:75)

duplicated block id: 192
size: 15 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsub/PubSubToBQ.java (80:97)
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsub/PubSubToGCS.java (74:91)

duplicated block id: 193
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_mongo.py (80:94)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (121:136)

duplicated block id: 194
size: 15 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (759:773)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (836:850)

duplicated block id: 195
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (78:92)
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (138:152)

duplicated block id: 196
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hbase/hbase_to_gcs.py (61:75)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (121:136)

duplicated block id: 197
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_gcs.py (107:122)
 - python/dataproc_templates/gcs/gcs_to_mongo.py (80:94)

duplicated block id: 198
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/text_to_bigquery.py (68:82)
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (138:152)

duplicated block id: 199
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_gcs.py (107:122)
 - python/dataproc_templates/redshift/redshift_to_gcs.py (99:113)

duplicated block id: 200
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/jdbc/jdbc_to_jdbc.py (148:162)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (121:136)

duplicated block id: 201
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_gcs.py (107:122)
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (138:152)

duplicated block id: 202
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (69:83)
 - python/dataproc_templates/gcs/text_to_bigquery.py (68:82)

duplicated block id: 203
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (71:85)
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (138:152)

duplicated block id: 204
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_gcs.py (107:122)
 - python/dataproc_templates/jdbc/jdbc_to_jdbc.py (148:162)

duplicated block id: 205
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (78:92)
 - python/dataproc_templates/jdbc/jdbc_to_jdbc.py (148:162)

duplicated block id: 206
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (90:104)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (121:136)

duplicated block id: 207
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (69:83)
 - python/dataproc_templates/hbase/hbase_to_gcs.py (61:75)

duplicated block id: 208
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (69:83)
 - python/dataproc_templates/gcs/gcs_to_mongo.py (80:94)

duplicated block id: 209
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (90:104)
 - python/dataproc_templates/hive/hive_to_bigquery.py (74:88)

duplicated block id: 210
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (71:85)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (121:136)

duplicated block id: 211
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (78:92)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (121:136)

duplicated block id: 212
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (69:83)
 - python/dataproc_templates/hive/hive_to_bigquery.py (74:88)

duplicated block id: 213
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_bigquery.py (59:73)
 - python/dataproc_templates/hbase/hbase_to_gcs.py (61:75)

duplicated block id: 214
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_bigquery.py (59:73)
 - python/dataproc_templates/gcs/text_to_bigquery.py (68:82)

duplicated block id: 215
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (71:85)
 - python/dataproc_templates/gcs/text_to_bigquery.py (68:82)

duplicated block id: 216
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_bigquery.py (59:73)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (121:136)

duplicated block id: 217
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (138:152)
 - python/dataproc_templates/redshift/redshift_to_gcs.py (99:113)

duplicated block id: 218
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hive/hive_to_bigquery.py (74:88)
 - python/dataproc_templates/jdbc/jdbc_to_jdbc.py (148:162)

duplicated block id: 219
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (138:152)
 - python/dataproc_templates/jdbc/jdbc_to_jdbc.py (148:162)

duplicated block id: 220
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_bigquery.py (59:73)
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (71:85)

duplicated block id: 221
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (78:92)
 - python/dataproc_templates/redshift/redshift_to_gcs.py (99:113)

duplicated block id: 222
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hbase/hbase_to_gcs.py (61:75)
 - python/dataproc_templates/redshift/redshift_to_gcs.py (99:113)

duplicated block id: 223
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hbase/hbase_to_gcs.py (61:75)
 - python/dataproc_templates/hive/hive_to_bigquery.py (74:88)

duplicated block id: 224
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_bigquery.py (59:73)
 - python/dataproc_templates/gcs/gcs_to_mongo.py (80:94)

duplicated block id: 225
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (78:92)
 - python/dataproc_templates/gcs/text_to_bigquery.py (68:82)

duplicated block id: 226
size: 15 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/jdbc/JDBCToGCSConfig.java (197:213)
 - java/src/main/java/com/google/cloud/dataproc/templates/jdbc/JDBCToSpannerConfig.java (237:253)

duplicated block id: 227
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (69:83)
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (138:152)

duplicated block id: 228
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (90:104)
 - python/dataproc_templates/gcs/gcs_to_gcs.py (107:122)

duplicated block id: 229
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (90:104)
 - python/dataproc_templates/gcs/gcs_to_mongo.py (80:94)

duplicated block id: 230
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (78:92)
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (71:85)

duplicated block id: 231
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hive/hive_to_bigquery.py (74:88)
 - python/dataproc_templates/redshift/redshift_to_gcs.py (99:113)

duplicated block id: 232
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (90:104)
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (71:85)

duplicated block id: 233
size: 15 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsub/PubSubToBQ.java (80:97)
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsub/PubSubToBigTable.java (73:90)

duplicated block id: 234
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (69:83)
 - python/dataproc_templates/redshift/redshift_to_gcs.py (99:113)

duplicated block id: 235
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (90:104)
 - python/dataproc_templates/gcs/text_to_bigquery.py (68:82)

duplicated block id: 236
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_mongo.py (80:94)
 - python/dataproc_templates/hive/hive_to_bigquery.py (74:88)

duplicated block id: 237
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (78:92)
 - python/dataproc_templates/hive/hive_to_bigquery.py (74:88)

duplicated block id: 238
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hive/hive_to_bigquery.py (74:88)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (121:136)

duplicated block id: 239
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_mongo.py (80:94)
 - python/dataproc_templates/gcs/text_to_bigquery.py (68:82)

duplicated block id: 240
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_mongo.py (80:94)
 - python/dataproc_templates/jdbc/jdbc_to_jdbc.py (148:162)

duplicated block id: 241
size: 15 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/databases/CassandraToBqConfig.java (63:80)
 - java/src/main/java/com/google/cloud/dataproc/templates/databases/CassandraToGCSConfig.java (67:84)

duplicated block id: 242
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_gcs.py (107:122)
 - python/dataproc_templates/hive/hive_to_bigquery.py (74:88)

duplicated block id: 243
size: 15 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (532:546)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (494:508)

duplicated block id: 244
size: 15 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (7:21)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (7:21)

duplicated block id: 245
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/jdbc/jdbc_to_jdbc.py (148:162)
 - python/dataproc_templates/redshift/redshift_to_gcs.py (99:113)

duplicated block id: 246
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (78:92)
 - python/dataproc_templates/cassandra/cassandra_to_bigquery.py (59:73)

duplicated block id: 247
size: 15 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (453:467)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (494:508)

duplicated block id: 248
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (71:85)
 - python/dataproc_templates/jdbc/jdbc_to_jdbc.py (148:162)

duplicated block id: 249
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hbase/hbase_to_gcs.py (61:75)
 - python/dataproc_templates/jdbc/jdbc_to_jdbc.py (148:162)

duplicated block id: 250
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (78:92)
 - python/dataproc_templates/gcs/gcs_to_gcs.py (107:122)

duplicated block id: 251
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_mongo.py (80:94)
 - python/dataproc_templates/hbase/hbase_to_gcs.py (61:75)

duplicated block id: 252
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (78:92)
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (69:83)

duplicated block id: 253
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/text_to_bigquery.py (68:82)
 - python/dataproc_templates/jdbc/jdbc_to_jdbc.py (148:162)

duplicated block id: 254
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (71:85)
 - python/dataproc_templates/hive/hive_to_bigquery.py (74:88)

duplicated block id: 255
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (69:83)
 - python/dataproc_templates/jdbc/jdbc_to_jdbc.py (148:162)

duplicated block id: 256
size: 15 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (78:92)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (72:86)

duplicated block id: 257
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_gcs.py (107:122)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (121:136)

duplicated block id: 258
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_gcs.py (107:122)
 - python/dataproc_templates/hbase/hbase_to_gcs.py (61:75)

duplicated block id: 259
size: 15 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (90:104)
 - python/dataproc_templates/redshift/redshift_to_gcs.py (99:113)

duplicated block id: 260
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hive/hive_to_bigquery.py (74:87)
 - python/dataproc_templates/mongo/mongo_to_gcs.py (79:92)

duplicated block id: 261
size: 14 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (435:448)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (512:525)

duplicated block id: 262
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (130:143)
 - python/dataproc_templates/redshift/redshift_to_gcs.py (99:112)

duplicated block id: 263
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (74:87)
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (130:143)

duplicated block id: 264
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/mongo/mongo_to_gcs.py (79:92)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (121:134)

duplicated block id: 265
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (110:123)
 - python/dataproc_templates/gcs/gcs_to_mongo.py (80:93)

duplicated block id: 266
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_mongo.py (80:93)
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (130:143)

duplicated block id: 267
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (74:87)
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (81:94)

duplicated block id: 268
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (110:123)
 - python/dataproc_templates/jdbc/jdbc_to_jdbc.py (148:161)

duplicated block id: 269
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (78:91)
 - python/dataproc_templates/mongo/mongo_to_gcs.py (79:92)

duplicated block id: 270
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (71:84)
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (81:94)

duplicated block id: 271
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/text_to_bigquery.py (68:81)
 - python/dataproc_templates/mongo/mongo_to_gcs.py (79:92)

duplicated block id: 272
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/jdbc/jdbc_to_jdbc.py (148:161)
 - python/dataproc_templates/mongo/mongo_to_gcs.py (79:92)

duplicated block id: 273
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (74:87)
 - python/dataproc_templates/cassandra/cassandra_to_bigquery.py (59:72)

duplicated block id: 274
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_bigquery.py (59:72)
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (110:123)

duplicated block id: 275
size: 14 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (350:363)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (362:375)

duplicated block id: 276
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (110:123)
 - python/dataproc_templates/redshift/redshift_to_gcs.py (99:112)

duplicated block id: 277
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (78:91)
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (81:94)

duplicated block id: 278
size: 14 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (12:25)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (8:21)

duplicated block id: 279
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (81:94)
 - python/dataproc_templates/gcs/gcs_to_mongo.py (80:93)

duplicated block id: 280
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (74:87)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (121:134)

duplicated block id: 281
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (74:87)
 - python/dataproc_templates/hive/hive_to_bigquery.py (74:87)

duplicated block id: 282
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (74:87)
 - python/dataproc_templates/gcs/text_to_bigquery.py (68:81)

duplicated block id: 283
size: 14 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (219:232)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (212:225)

duplicated block id: 284
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_bq.py (103:116)
 - python/dataproc_templates/mongo/mongo_to_bq.py (76:90)

duplicated block id: 285
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (69:82)
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (130:143)

duplicated block id: 286
size: 14 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (512:525)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (476:489)

duplicated block id: 287
size: 14 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (474:487)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (553:566)

duplicated block id: 288
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (110:123)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (121:134)

duplicated block id: 289
size: 14 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_parameterize_script.py (114:133)
 - notebooks/postgresql2bq/PostgreSqlToBigQuery_parameterize_script.py (105:122)

duplicated block id: 290
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (90:103)
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (130:143)

duplicated block id: 291
size: 14 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (339:352)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (399:412)

duplicated block id: 292
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (74:87)
 - python/dataproc_templates/redshift/redshift_to_gcs.py (99:112)

duplicated block id: 293
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (71:84)
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (110:123)

duplicated block id: 294
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (78:91)
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (74:87)

duplicated block id: 295
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hive/hive_to_bigquery.py (74:87)
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (130:143)

duplicated block id: 296
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_bigquery.py (59:72)
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (81:94)

duplicated block id: 297
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (138:151)
 - python/dataproc_templates/mongo/mongo_to_gcs.py (79:92)

duplicated block id: 298
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (110:123)
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (81:94)

duplicated block id: 299
size: 14 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (205:218)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (212:225)

duplicated block id: 300
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (81:94)
 - python/dataproc_templates/hive/hive_to_bigquery.py (74:87)

duplicated block id: 301
size: 14 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (253:266)
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (305:318)

duplicated block id: 302
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (110:123)
 - python/dataproc_templates/hbase/hbase_to_gcs.py (61:74)

duplicated block id: 303
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_bigquery.py (59:72)
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (130:143)

duplicated block id: 304
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_gcs.py (107:120)
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (130:143)

duplicated block id: 305
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (81:94)
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (69:82)

duplicated block id: 306
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_bigquery.py (59:72)
 - python/dataproc_templates/mongo/mongo_to_gcs.py (79:92)

duplicated block id: 307
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (90:103)
 - python/dataproc_templates/mongo/mongo_to_gcs.py (79:92)

duplicated block id: 308
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (78:91)
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (130:143)

duplicated block id: 309
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (81:94)
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (138:151)

duplicated block id: 310
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (110:123)
 - python/dataproc_templates/gcs/text_to_bigquery.py (68:81)

duplicated block id: 311
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (74:87)
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (71:84)

duplicated block id: 312
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (90:103)
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (110:123)

duplicated block id: 313
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (130:143)
 - python/dataproc_templates/jdbc/jdbc_to_jdbc.py (148:161)

duplicated block id: 314
size: 14 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (101:114)
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (77:90)

duplicated block id: 315
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (74:87)
 - python/dataproc_templates/gcs/gcs_to_gcs.py (107:120)

duplicated block id: 316
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (81:94)
 - python/dataproc_templates/gcs/text_to_bigquery.py (68:81)

duplicated block id: 317
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (81:94)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (121:134)

duplicated block id: 318
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hbase/hbase_to_gcs.py (61:74)
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (130:143)

duplicated block id: 319
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (110:123)
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (69:82)

duplicated block id: 320
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (74:87)
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (69:82)

duplicated block id: 321
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (74:87)
 - python/dataproc_templates/hbase/hbase_to_gcs.py (61:74)

duplicated block id: 322
size: 14 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (366:379)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (426:439)

duplicated block id: 323
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (74:87)
 - python/dataproc_templates/mongo/mongo_to_gcs.py (79:92)

duplicated block id: 324
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (74:87)
 - python/dataproc_templates/gcs/gcs_to_mongo.py (80:93)

duplicated block id: 325
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (110:123)
 - python/dataproc_templates/hive/hive_to_bigquery.py (74:87)

duplicated block id: 326
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (110:123)
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (130:143)

duplicated block id: 327
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (69:82)
 - python/dataproc_templates/mongo/mongo_to_gcs.py (79:92)

duplicated block id: 328
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (74:87)
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (90:103)

duplicated block id: 329
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (78:91)
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (110:123)

duplicated block id: 330
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (130:143)
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (138:151)

duplicated block id: 331
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_mongo.py (80:93)
 - python/dataproc_templates/mongo/mongo_to_gcs.py (79:92)

duplicated block id: 332
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (130:143)
 - python/dataproc_templates/mongo/mongo_to_gcs.py (79:92)

duplicated block id: 333
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (90:103)
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (81:94)

duplicated block id: 334
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (81:94)
 - python/dataproc_templates/gcs/gcs_to_gcs.py (107:120)

duplicated block id: 335
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (71:84)
 - python/dataproc_templates/mongo/mongo_to_gcs.py (79:92)

duplicated block id: 336
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (74:87)
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (138:151)

duplicated block id: 337
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (135:152)
 - python/dataproc_templates/s3/s3_to_bigquery.py (101:118)

duplicated block id: 338
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (86:103)
 - python/dataproc_templates/s3/s3_to_bigquery.py (101:118)

duplicated block id: 339
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (130:143)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (121:134)

duplicated block id: 340
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/text_to_bigquery.py (68:81)
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (130:143)

duplicated block id: 341
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hbase/hbase_to_gcs.py (61:74)
 - python/dataproc_templates/mongo/mongo_to_gcs.py (79:92)

duplicated block id: 342
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (81:94)
 - python/dataproc_templates/jdbc/jdbc_to_jdbc.py (148:161)

duplicated block id: 343
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (74:87)
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (110:123)

duplicated block id: 344
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_gcs.py (107:120)
 - python/dataproc_templates/mongo/mongo_to_gcs.py (79:92)

duplicated block id: 345
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (110:123)
 - python/dataproc_templates/mongo/mongo_to_gcs.py (79:92)

duplicated block id: 346
size: 14 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (424:437)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (429:442)

duplicated block id: 347
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (110:123)
 - python/dataproc_templates/gcs/gcs_to_gcs.py (107:120)

duplicated block id: 348
size: 14 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (8:21)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (12:25)

duplicated block id: 349
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (81:94)
 - python/dataproc_templates/hbase/hbase_to_gcs.py (61:74)

duplicated block id: 350
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (81:94)
 - python/dataproc_templates/mongo/mongo_to_gcs.py (79:92)

duplicated block id: 351
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/mongo/mongo_to_gcs.py (79:92)
 - python/dataproc_templates/redshift/redshift_to_gcs.py (99:112)

duplicated block id: 352
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (110:123)
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (138:151)

duplicated block id: 353
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (74:87)
 - python/dataproc_templates/jdbc/jdbc_to_jdbc.py (148:161)

duplicated block id: 354
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (81:94)
 - python/dataproc_templates/redshift/redshift_to_gcs.py (99:112)

duplicated block id: 355
size: 14 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (71:84)
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (130:143)

duplicated block id: 356
size: 13 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (173:185)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (246:258)

duplicated block id: 357
size: 13 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (827:839)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (744:756)

duplicated block id: 358
size: 13 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (726:738)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (827:839)

duplicated block id: 359
size: 13 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (246:258)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (244:256)

duplicated block id: 360
size: 13 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (157:169)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (171:183)

duplicated block id: 361
size: 13 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (81:93)
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (60:72)

duplicated block id: 362
size: 13 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (556:568)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (536:548)

duplicated block id: 363
size: 13 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (171:183)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (165:177)

duplicated block id: 364
size: 13 cleaned lines of code
in 2 files:
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (628:640)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (647:659)

duplicated block id: 365
size: 13 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (246:258)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (248:260)

duplicated block id: 366
size: 13 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (833:845)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (843:855)

duplicated block id: 367
size: 13 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_parameterize_script.py (123:147)
 - notebooks/oracle2postgres/OracleToPostgres_parameterize_script.py (140:162)

duplicated block id: 368
size: 13 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (631:643)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (639:651)

duplicated block id: 369
size: 13 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (173:185)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (244:256)

duplicated block id: 370
size: 13 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (733:745)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (827:839)

duplicated block id: 371
size: 13 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (102:114)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (72:84)

duplicated block id: 372
size: 13 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (173:185)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (248:260)

duplicated block id: 373
size: 13 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (644:656)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (747:759)

duplicated block id: 374
size: 13 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (248:260)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (244:256)

duplicated block id: 375
size: 13 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (132:144)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (171:183)

duplicated block id: 376
size: 12 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (384:395)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (831:842)

duplicated block id: 377
size: 12 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (115:126)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (171:182)

duplicated block id: 378
size: 12 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (594:605)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (778:789)

duplicated block id: 379
size: 12 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (115:126)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (125:136)

duplicated block id: 380
size: 12 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:281)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:584)

duplicated block id: 381
size: 12 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (115:126)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (138:149)

duplicated block id: 382
size: 12 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (296:307)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (379:390)

duplicated block id: 383
size: 12 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (464:475)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1050:1061)

duplicated block id: 384
size: 12 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (428:439)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (364:375)

duplicated block id: 385
size: 12 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (621:632)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (639:650)

duplicated block id: 386
size: 12 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (695:706)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (797:808)

duplicated block id: 387
size: 12 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (125:136)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (171:182)

duplicated block id: 388
size: 12 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (116:127)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (155:166)

duplicated block id: 389
size: 12 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (282:293)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (296:307)

duplicated block id: 390
size: 12 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (810:821)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (821:832)

duplicated block id: 391
size: 12 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (257:268)
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (282:293)

duplicated block id: 392
size: 12 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (824:835)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (845:856)

duplicated block id: 393
size: 12 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (797:808)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (713:724)

duplicated block id: 394
size: 12 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (352:363)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (428:439)

duplicated block id: 395
size: 12 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (489:500)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (577:588)

duplicated block id: 396
size: 12 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (203:214)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (214:225)

duplicated block id: 397
size: 12 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (352:363)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (368:379)

duplicated block id: 398
size: 12 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (257:268)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (379:390)

duplicated block id: 399
size: 12 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/databases/SpannerToGCSConfig.java (174:185)
 - java/src/main/java/com/google/cloud/dataproc/templates/jdbc/JDBCToGCSConfig.java (217:228)

duplicated block id: 400
size: 12 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (125:136)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (138:149)

duplicated block id: 401
size: 11 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (295:305)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (459:469)

duplicated block id: 402
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (385:395)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (475:485)

duplicated block id: 403
size: 11 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (929:939)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (845:855)

duplicated block id: 404
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (385:395)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (399:409)

duplicated block id: 405
size: 11 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (295:305)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (520:530)

duplicated block id: 406
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (528:538)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (516:526)

duplicated block id: 407
size: 11 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (58:68)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (56:66)

duplicated block id: 408
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (797:807)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (897:907)

duplicated block id: 409
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (297:307)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (304:314)

duplicated block id: 410
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (385:395)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (398:408)

duplicated block id: 411
size: 11 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (511:521)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (599:609)

duplicated block id: 412
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (92:102)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (110:120)

duplicated block id: 413
size: 11 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (76:86)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (75:85)

duplicated block id: 414
size: 11 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_gcs.py (111:122)
 - python/dataproc_templates/mongo/mongo_to_bq.py (80:92)

duplicated block id: 415
size: 11 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (75:85)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (74:84)

duplicated block id: 416
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (556:566)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (599:609)

duplicated block id: 417
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (810:820)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (803:813)

duplicated block id: 418
size: 11 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (110:120)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (95:105)

duplicated block id: 419
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (463:473)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (468:478)

duplicated block id: 420
size: 11 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (75:85)
 - python/dataproc_templates/mongo/mongo_to_bq.py (80:92)

duplicated block id: 421
size: 11 cleaned lines of code
in 2 files:
 - python/dataproc_templates/jdbc/jdbc_to_jdbc.py (152:162)
 - python/dataproc_templates/mongo/mongo_to_bq.py (80:92)

duplicated block id: 422
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (775:785)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (786:796)

duplicated block id: 423
size: 11 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (768:778)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (786:796)

duplicated block id: 424
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (589:599)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (852:862)

duplicated block id: 425
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (797:807)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (808:818)

duplicated block id: 426
size: 11 cleaned lines of code
in 2 files:
 - python/dataproc_templates/mongo/mongo_to_bq.py (80:92)
 - python/dataproc_templates/redshift/redshift_to_gcs.py (103:113)

duplicated block id: 427
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (254:264)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (248:258)

duplicated block id: 428
size: 11 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (824:834)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (929:939)

duplicated block id: 429
size: 11 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (869:879)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (786:796)

duplicated block id: 430
size: 11 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (139:150)
 - python/dataproc_templates/s3/s3_to_bigquery.py (146:157)

duplicated block id: 431
size: 11 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (58:68)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (56:66)

duplicated block id: 432
size: 11 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (98:108)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (110:120)

duplicated block id: 433
size: 11 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/text_to_bigquery.py (72:82)
 - python/dataproc_templates/mongo/mongo_to_bq.py (80:92)

duplicated block id: 434
size: 11 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (584:594)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (680:690)

duplicated block id: 435
size: 11 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hbase/hbase_to_gcs.py (65:75)
 - python/dataproc_templates/mongo/mongo_to_bq.py (80:92)

duplicated block id: 436
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (835:845)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (824:834)

duplicated block id: 437
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (439:449)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (444:454)

duplicated block id: 438
size: 11 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (304:314)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (280:290)

duplicated block id: 439
size: 11 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_bigquery.py (63:73)
 - python/dataproc_templates/mongo/mongo_to_bq.py (80:92)

duplicated block id: 440
size: 11 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (295:305)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (538:548)

duplicated block id: 441
size: 11 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/kafka/KafkaToBQDstream.java (88:102)
 - java/src/main/java/com/google/cloud/dataproc/templates/kafka/KafkaToGCSDstream.java (89:103)

duplicated block id: 442
size: 11 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_mongo.py (84:94)
 - python/dataproc_templates/mongo/mongo_to_bq.py (80:92)

duplicated block id: 443
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (58:68)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (56:66)

duplicated block id: 444
size: 11 cleaned lines of code
in 2 files:
 - notebooks/util/jdbc/engines/mysql_input_manager.py (46:58)
 - notebooks/util/jdbc/engines/oracle_input_manager.py (52:65)

duplicated block id: 445
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (107:117)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (130:140)

duplicated block id: 446
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (775:785)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (869:879)

duplicated block id: 447
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (139:149)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (155:165)

duplicated block id: 448
size: 11 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (73:83)
 - python/dataproc_templates/mongo/mongo_to_bq.py (80:92)

duplicated block id: 449
size: 11 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (82:92)
 - python/dataproc_templates/mongo/mongo_to_bq.py (80:92)

duplicated block id: 450
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (211:221)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (288:298)

duplicated block id: 451
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (516:526)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (696:706)

duplicated block id: 452
size: 11 cleaned lines of code
in 2 files:
 - python/dataproc_templates/mongo/mongo_to_bq.py (80:92)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (125:136)

duplicated block id: 453
size: 11 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (289:299)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (280:290)

duplicated block id: 454
size: 11 cleaned lines of code
in 2 files:
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (172:182)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (155:165)

duplicated block id: 455
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (810:820)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (910:920)

duplicated block id: 456
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (797:807)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (790:800)

duplicated block id: 457
size: 11 cleaned lines of code
in 2 files:
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (142:152)
 - python/dataproc_templates/mongo/mongo_to_bq.py (80:92)

duplicated block id: 458
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (835:845)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (929:939)

duplicated block id: 459
size: 11 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (599:609)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (536:546)

duplicated block id: 460
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (546:556)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (718:728)

duplicated block id: 461
size: 11 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (761:771)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (675:685)

duplicated block id: 462
size: 11 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (768:778)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (869:879)

duplicated block id: 463
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (125:135)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (163:173)

duplicated block id: 464
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (115:125)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (163:173)

duplicated block id: 465
size: 11 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (565:575)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (583:593)

duplicated block id: 466
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (126:136)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (155:165)

duplicated block id: 467
size: 11 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hive/hive_to_bigquery.py (78:88)
 - python/dataproc_templates/mongo/mongo_to_bq.py (80:92)

duplicated block id: 468
size: 11 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (94:104)
 - python/dataproc_templates/mongo/mongo_to_bq.py (80:92)

duplicated block id: 469
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (216:226)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (226:236)

duplicated block id: 470
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (775:785)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (768:778)

duplicated block id: 471
size: 11 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (556:566)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (511:521)

duplicated block id: 472
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hbase/hbase_to_gcs.py (49:58)
 - python/dataproc_templates/mongo/mongo_to_gcs.py (61:70)

duplicated block id: 473
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (61:70)
 - python/dataproc_templates/gcs/gcs_to_bigtable.py (50:59)

duplicated block id: 474
size: 10 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsub/PubSubToBigTable.java (136:150)
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsublite/PubSubLiteToBigTable.java (107:121)

duplicated block id: 475
size: 10 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (431:440)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (563:572)

duplicated block id: 476
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (53:62)
 - python/dataproc_templates/hbase/hbase_to_gcs.py (49:58)

duplicated block id: 477
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_bq.py (107:116)
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (85:94)

duplicated block id: 478
size: 10 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (750:759)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (861:870)

duplicated block id: 479
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_bq.py (107:116)
 - python/dataproc_templates/gcs/text_to_bigquery.py (72:81)

duplicated block id: 480
size: 10 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (83:92)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (99:108)

duplicated block id: 481
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (126:135)
 - python/dataproc_templates/mongo/mongo_to_gcs.py (61:70)

duplicated block id: 482
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_bq.py (107:116)
 - python/dataproc_templates/redshift/redshift_to_gcs.py (103:112)

duplicated block id: 483
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_bq.py (107:116)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (125:134)

duplicated block id: 484
size: 10 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (352:361)
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (823:832)

duplicated block id: 485
size: 10 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (719:728)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (516:525)

duplicated block id: 486
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigtable.py (50:59)
 - python/dataproc_templates/gcs/gcs_to_mongo.py (48:57)

duplicated block id: 487
size: 10 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (282:291)
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (309:318)

duplicated block id: 488
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (49:58)
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (92:101)

duplicated block id: 489
size: 10 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (309:318)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (379:388)

duplicated block id: 490
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_bq.py (107:116)
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (114:123)

duplicated block id: 491
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (92:101)
 - python/dataproc_templates/redshift/redshift_to_gcs.py (87:96)

duplicated block id: 492
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hbase/hbase_to_gcs.py (49:58)
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (126:135)

duplicated block id: 493
size: 10 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (349:358)
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (333:342)

duplicated block id: 494
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/mongo/mongo_to_gcs.py (61:70)
 - python/dataproc_templates/redshift/redshift_to_gcs.py (87:96)

duplicated block id: 495
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigtable.py (50:59)
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (49:58)

duplicated block id: 496
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (75:84)
 - python/dataproc_templates/elasticsearch/elasticsearch_to_bq.py (107:116)

duplicated block id: 497
size: 10 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (756:765)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (764:773)

duplicated block id: 498
size: 10 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (530:539)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (509:518)

duplicated block id: 499
size: 10 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (126:135)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (127:136)

duplicated block id: 500
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (82:91)
 - python/dataproc_templates/elasticsearch/elasticsearch_to_bq.py (107:116)

duplicated block id: 501
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (53:62)
 - python/dataproc_templates/mongo/mongo_to_gcs.py (61:70)

duplicated block id: 502
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (61:70)
 - python/dataproc_templates/gcs/gcs_to_mongo.py (48:57)

duplicated block id: 503
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (85:94)
 - python/dataproc_templates/mongo/mongo_to_bq.py (80:90)

duplicated block id: 504
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hbase/hbase_to_gcs.py (49:58)
 - python/dataproc_templates/redshift/redshift_to_gcs.py (87:96)

duplicated block id: 505
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_gcs.py (94:104)
 - python/dataproc_templates/hive/hive_to_gcs.py (67:76)

duplicated block id: 506
size: 10 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (756:765)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (739:748)

duplicated block id: 507
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (61:70)
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (49:58)

duplicated block id: 508
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_bq.py (107:116)
 - python/dataproc_templates/gcs/gcs_to_gcs.py (111:120)

duplicated block id: 509
size: 10 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (676:685)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (750:759)

duplicated block id: 510
size: 10 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (756:765)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (841:850)

duplicated block id: 511
size: 10 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (746:755)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (963:972)

duplicated block id: 512
size: 10 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (841:850)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (963:972)

duplicated block id: 513
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_bq.py (107:116)
 - python/dataproc_templates/hbase/hbase_to_gcs.py (65:74)

duplicated block id: 514
size: 10 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (756:765)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (757:766)

duplicated block id: 515
size: 10 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (674:683)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (685:694)

duplicated block id: 516
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_bq.py (107:116)
 - python/dataproc_templates/mongo/mongo_to_gcs.py (83:92)

duplicated block id: 517
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/mongo/mongo_to_bq.py (80:90)
 - python/dataproc_templates/mongo/mongo_to_gcs.py (83:92)

duplicated block id: 518
size: 10 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (719:728)
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (528:537)

duplicated block id: 519
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (49:58)
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (126:135)

duplicated block id: 520
size: 10 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (106:115)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (70:79)

duplicated block id: 521
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (78:87)
 - python/dataproc_templates/elasticsearch/elasticsearch_to_bq.py (107:116)

duplicated block id: 522
size: 10 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (121:130)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (154:163)

duplicated block id: 523
size: 10 cleaned lines of code
in 2 files:
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (757:766)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (963:972)

duplicated block id: 524
size: 10 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (764:773)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (757:766)

duplicated block id: 525
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_bq.py (107:116)
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (134:143)

duplicated block id: 526
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_bq.py (107:116)
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (73:82)

duplicated block id: 527
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_bq.py (107:116)
 - python/dataproc_templates/jdbc/jdbc_to_jdbc.py (152:161)

duplicated block id: 528
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (92:101)
 - python/dataproc_templates/hbase/hbase_to_gcs.py (49:58)

duplicated block id: 529
size: 10 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (719:728)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (696:705)

duplicated block id: 530
size: 10 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (114:123)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (127:136)

duplicated block id: 531
size: 10 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/jdbc/JDBCToGCSConfig.java (129:146)
 - java/src/main/java/com/google/cloud/dataproc/templates/jdbc/JDBCToSpannerConfig.java (148:165)

duplicated block id: 532
size: 10 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (739:748)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (963:972)

duplicated block id: 533
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (49:58)
 - python/dataproc_templates/hbase/hbase_to_gcs.py (49:58)

duplicated block id: 534
size: 10 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (669:678)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (750:759)

duplicated block id: 535
size: 10 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsub/PubSubToBQ.java (203:212)
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsub/PubSubToBigTable.java (184:193)

duplicated block id: 536
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (53:62)
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (126:135)

duplicated block id: 537
size: 10 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (764:773)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (746:755)

duplicated block id: 538
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (126:135)
 - python/dataproc_templates/redshift/redshift_to_gcs.py (87:96)

duplicated block id: 539
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (134:143)
 - python/dataproc_templates/mongo/mongo_to_bq.py (80:90)

duplicated block id: 540
size: 10 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (129:138)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (172:181)

duplicated block id: 541
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (92:101)
 - python/dataproc_templates/mongo/mongo_to_gcs.py (61:70)

duplicated block id: 542
size: 10 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (630:639)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (602:611)

duplicated block id: 543
size: 10 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (660:669)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (676:685)

duplicated block id: 544
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (94:103)
 - python/dataproc_templates/elasticsearch/elasticsearch_to_bq.py (107:116)

duplicated block id: 545
size: 10 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (105:114)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (140:149)

duplicated block id: 546
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (92:101)
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (126:135)

duplicated block id: 547
size: 10 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (332:341)
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (319:328)

duplicated block id: 548
size: 10 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (126:135)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (114:123)

duplicated block id: 549
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (53:62)
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (92:101)

duplicated block id: 550
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_bq.py (107:116)
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (142:151)

duplicated block id: 551
size: 10 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (424:433)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (501:510)

duplicated block id: 552
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (49:58)
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (53:62)

duplicated block id: 553
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (49:58)
 - python/dataproc_templates/mongo/mongo_to_gcs.py (61:70)

duplicated block id: 554
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (53:62)
 - python/dataproc_templates/redshift/redshift_to_gcs.py (87:96)

duplicated block id: 555
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_bigquery.py (63:72)
 - python/dataproc_templates/elasticsearch/elasticsearch_to_bq.py (107:116)

duplicated block id: 556
size: 10 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (764:773)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (739:748)

duplicated block id: 557
size: 10 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (558:567)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (734:743)

duplicated block id: 558
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (49:58)
 - python/dataproc_templates/redshift/redshift_to_gcs.py (87:96)

duplicated block id: 559
size: 10 cleaned lines of code
in 2 files:
 - airflow/dags/submit_pyspark_dataproc_template.py (25:36)
 - airflow/dags/submit_spark_dataproc_template.py (25:36)

duplicated block id: 560
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_bq.py (107:116)
 - python/dataproc_templates/gcs/gcs_to_mongo.py (84:93)

duplicated block id: 561
size: 10 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (756:765)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (746:755)

duplicated block id: 562
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_bq.py (107:116)
 - python/dataproc_templates/hive/hive_to_bigquery.py (78:87)

duplicated block id: 563
size: 10 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (59:68)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (60:69)

duplicated block id: 564
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (49:58)
 - python/dataproc_templates/gcs/gcs_to_mongo.py (48:57)

duplicated block id: 565
size: 10 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (764:773)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (963:972)

duplicated block id: 566
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (114:123)
 - python/dataproc_templates/mongo/mongo_to_bq.py (80:90)

duplicated block id: 567
size: 10 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (78:87)
 - python/dataproc_templates/mongo/mongo_to_bq.py (80:90)

duplicated block id: 568
size: 10 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (164:173)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (155:164)

duplicated block id: 569
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hive/hive_to_gcs.py (85:93)
 - python/dataproc_templates/mongo/mongo_to_bq.py (82:92)

duplicated block id: 570
size: 9 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (82:90)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (70:78)

duplicated block id: 571
size: 9 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_parameterize_script.py (82:91)
 - notebooks/postgresql2bq/PostgreSqlToBigQuery_parameterize_script.py (105:114)

duplicated block id: 572
size: 9 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/jdbc/JDBCToGCS.java (82:94)
 - java/src/main/java/com/google/cloud/dataproc/templates/jdbc/JDBCToSpanner.java (120:132)

duplicated block id: 573
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (77:85)
 - python/dataproc_templates/hive/hive_to_gcs.py (85:93)

duplicated block id: 574
size: 9 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (703:711)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (923:931)

duplicated block id: 575
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_gcs.py (112:120)
 - python/dataproc_templates/s3/s3_to_bigquery.py (101:109)

duplicated block id: 576
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (74:82)
 - python/dataproc_templates/s3/s3_to_bigquery.py (101:109)

duplicated block id: 577
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hive/hive_to_gcs.py (85:93)
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (144:152)

duplicated block id: 578
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hive/hive_to_gcs.py (68:76)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (145:154)

duplicated block id: 579
size: 9 cleaned lines of code
in 2 files:
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (676:684)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (874:882)

duplicated block id: 580
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hive/hive_to_gcs.py (85:93)
 - python/dataproc_templates/redshift/redshift_to_gcs.py (105:113)

duplicated block id: 581
size: 9 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (710:718)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (923:931)

duplicated block id: 582
size: 9 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (49:57)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (57:65)

duplicated block id: 583
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (84:92)
 - python/dataproc_templates/hive/hive_to_gcs.py (85:93)

duplicated block id: 584
size: 9 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (388:396)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (389:397)

duplicated block id: 585
size: 9 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:138)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:167)

duplicated block id: 586
size: 9 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (699:707)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (686:694)

duplicated block id: 587
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hive/hive_to_gcs.py (85:93)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (127:136)

duplicated block id: 588
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_gcs.py (113:122)
 - python/dataproc_templates/hive/hive_to_gcs.py (85:93)

duplicated block id: 589
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/redshift/redshift_to_gcs.py (104:112)
 - python/dataproc_templates/s3/s3_to_bigquery.py (101:109)

duplicated block id: 590
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/mongo/mongo_to_bq.py (81:90)
 - python/dataproc_templates/s3/s3_to_bigquery.py (101:109)

duplicated block id: 591
size: 9 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (780:788)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (798:806)

duplicated block id: 592
size: 9 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (715:723)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (734:742)

duplicated block id: 593
size: 9 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (295:303)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (500:508)

duplicated block id: 594
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (115:123)
 - python/dataproc_templates/s3/s3_to_bigquery.py (101:109)

duplicated block id: 595
size: 9 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (787:795)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (780:788)

duplicated block id: 596
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (79:87)
 - python/dataproc_templates/s3/s3_to_bigquery.py (101:109)

duplicated block id: 597
size: 9 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (225:233)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (239:247)

duplicated block id: 598
size: 9 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (49:57)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (50:58)

duplicated block id: 599
size: 9 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (699:707)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (675:683)

duplicated block id: 600
size: 9 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (70:78)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (76:84)

duplicated block id: 601
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_gcs.py (95:104)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (145:154)

duplicated block id: 602
size: 9 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_parameterize_script.py (113:122)
 - notebooks/oracle2postgres/OracleToPostgres_parameterize_script.py (117:125)

duplicated block id: 603
size: 9 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (88:96)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (99:107)

duplicated block id: 604
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (143:151)
 - python/dataproc_templates/s3/s3_to_bigquery.py (101:109)

duplicated block id: 605
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hive/hive_to_bigquery.py (79:87)
 - python/dataproc_templates/s3/s3_to_bigquery.py (101:109)

duplicated block id: 606
size: 9 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (453:461)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (458:466)

duplicated block id: 607
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (61:69)
 - python/dataproc_templates/gcs/gcs_to_bigtable.py (52:60)

duplicated block id: 608
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/s3/s3_to_bigquery.py (101:109)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (126:134)

duplicated block id: 609
size: 9 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (347:355)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (385:393)

duplicated block id: 610
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_bigquery.py (65:73)
 - python/dataproc_templates/hive/hive_to_gcs.py (85:93)

duplicated block id: 611
size: 9 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (49:57)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (50:58)

duplicated block id: 612
size: 9 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (617:625)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (634:642)

duplicated block id: 613
size: 9 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (780:788)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (887:895)

duplicated block id: 614
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_mongo.py (85:93)
 - python/dataproc_templates/s3/s3_to_bigquery.py (101:109)

duplicated block id: 615
size: 9 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (762:770)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (874:882)

duplicated block id: 616
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (96:104)
 - python/dataproc_templates/hive/hive_to_gcs.py (85:93)

duplicated block id: 617
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_bq.py (108:116)
 - python/dataproc_templates/s3/s3_to_bigquery.py (101:109)

duplicated block id: 618
size: 9 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (321:329)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (329:337)

duplicated block id: 619
size: 9 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (465:473)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (389:397)

duplicated block id: 620
size: 9 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (347:355)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (832:840)

duplicated block id: 621
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_mongo.py (86:94)
 - python/dataproc_templates/hive/hive_to_gcs.py (85:93)

duplicated block id: 622
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hive/hive_to_bigquery.py (80:88)
 - python/dataproc_templates/hive/hive_to_gcs.py (85:93)

duplicated block id: 623
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (75:83)
 - python/dataproc_templates/hive/hive_to_gcs.py (85:93)

duplicated block id: 624
size: 9 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (321:329)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (328:336)

duplicated block id: 625
size: 9 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (239:247)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (231:239)

duplicated block id: 626
size: 9 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (787:795)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (798:806)

duplicated block id: 627
size: 9 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/dialects/SpannerJdbcDialect.java (86:97)
 - java/src/main/java/com/google/cloud/dataproc/dialects/SpannerPostgresJDBCDialect.java (63:74)

duplicated block id: 628
size: 9 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsub/PubSubToBQ.java (117:125)
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsub/PubSubToGCS.java (158:166)

duplicated block id: 629
size: 9 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (59:67)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (58:66)

duplicated block id: 630
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (95:103)
 - python/dataproc_templates/s3/s3_to_bigquery.py (101:109)

duplicated block id: 631
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/text_to_bigquery.py (73:81)
 - python/dataproc_templates/s3/s3_to_bigquery.py (101:109)

duplicated block id: 632
size: 9 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (787:795)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (887:895)

duplicated block id: 633
size: 9 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (82:90)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (99:107)

duplicated block id: 634
size: 9 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (853:861)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1085:1093)

duplicated block id: 635
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hbase/hbase_to_gcs.py (67:75)
 - python/dataproc_templates/hive/hive_to_gcs.py (85:93)

duplicated block id: 636
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (83:91)
 - python/dataproc_templates/s3/s3_to_bigquery.py (101:109)

duplicated block id: 637
size: 9 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (457:465)
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (769:777)

duplicated block id: 638
size: 9 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (59:67)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (60:68)

duplicated block id: 639
size: 9 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (81:89)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (61:69)

duplicated block id: 640
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/text_to_bigquery.py (74:82)
 - python/dataproc_templates/hive/hive_to_gcs.py (85:93)

duplicated block id: 641
size: 9 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (414:422)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (419:427)

duplicated block id: 642
size: 9 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsub/PubSubToBQ.java (117:125)
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsub/PubSubToBigTable.java (114:122)

duplicated block id: 643
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/jdbc/jdbc_to_jdbc.py (153:161)
 - python/dataproc_templates/s3/s3_to_bigquery.py (101:109)

duplicated block id: 644
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (158:166)
 - python/dataproc_templates/jdbc/jdbc_to_jdbc.py (168:176)

duplicated block id: 645
size: 9 cleaned lines of code
in 2 files:
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (721:729)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (923:931)

duplicated block id: 646
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (76:84)
 - python/dataproc_templates/s3/s3_to_bigquery.py (101:109)

duplicated block id: 647
size: 9 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (49:57)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (50:58)

duplicated block id: 648
size: 9 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_parameterize_script.py (82:91)
 - notebooks/oracle2bq/OracleToBigQuery_parameterize_script.py (114:123)

duplicated block id: 649
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hbase/hbase_to_gcs.py (66:74)
 - python/dataproc_templates/s3/s3_to_bigquery.py (101:109)

duplicated block id: 650
size: 9 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (887:895)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (798:806)

duplicated block id: 651
size: 9 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsub/PubSubToBigTable.java (114:122)
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsub/PubSubToGCS.java (158:166)

duplicated block id: 652
size: 9 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (388:396)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (465:473)

duplicated block id: 653
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hive/hive_to_gcs.py (85:93)
 - python/dataproc_templates/jdbc/jdbc_to_jdbc.py (154:162)

duplicated block id: 654
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_bigquery.py (64:72)
 - python/dataproc_templates/s3/s3_to_bigquery.py (101:109)

duplicated block id: 655
size: 9 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (59:67)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (60:68)

duplicated block id: 656
size: 9 cleaned lines of code
in 2 files:
 - python/dataproc_templates/mongo/mongo_to_gcs.py (84:92)
 - python/dataproc_templates/s3/s3_to_bigquery.py (101:109)

duplicated block id: 657
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (138:145)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (184:191)

duplicated block id: 658
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (721:728)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (704:711)

duplicated block id: 659
size: 8 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsub/PubSubToBQ.java (194:201)
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsub/PubSubToGCS.java (125:132)

duplicated block id: 660
size: 8 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/jdbc/JDBCToJDBC.java (81:88)
 - java/src/main/java/com/google/cloud/dataproc/templates/jdbc/JDBCToJDBC.java (93:100)

duplicated block id: 661
size: 8 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (118:125)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (127:134)

duplicated block id: 662
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hive/hive_to_gcs.py (69:76)
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (128:135)

duplicated block id: 663
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (94:101)
 - python/dataproc_templates/hive/hive_to_gcs.py (69:76)

duplicated block id: 664
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (375:382)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (388:395)

duplicated block id: 665
size: 8 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (261:268)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (366:373)

duplicated block id: 666
size: 8 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (788:795)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (704:711)

duplicated block id: 667
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/mongo/mongo_to_gcs.py (63:70)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (146:154)

duplicated block id: 668
size: 8 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/gcs/GCSToSpannerConfig.java (156:164)
 - java/src/main/java/com/google/cloud/dataproc/templates/jdbc/JDBCToSpannerConfig.java (137:145)

duplicated block id: 669
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (442:449)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (578:585)

duplicated block id: 670
size: 8 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/kafka/KafkaToBQ.java (142:149)
 - java/src/main/java/com/google/cloud/dataproc/templates/kafka/KafkaToBQDstream.java (195:202)

duplicated block id: 671
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (693:700)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (788:795)

duplicated block id: 672
size: 8 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (81:88)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (61:68)

duplicated block id: 673
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_gcs.py (96:104)
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (128:135)

duplicated block id: 674
size: 8 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (275:282)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (355:362)

duplicated block id: 675
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (482:489)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (634:641)

duplicated block id: 676
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (51:58)
 - python/dataproc_templates/hive/hive_to_gcs.py (69:76)

duplicated block id: 677
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hive/hive_to_gcs.py (69:76)
 - python/dataproc_templates/s3/s3_to_bigquery.py (64:72)

duplicated block id: 678
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (300:307)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (366:373)

duplicated block id: 679
size: 8 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (836:843)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (851:858)

duplicated block id: 680
size: 8 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (81:88)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (61:68)

duplicated block id: 681
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (665:672)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (677:684)

duplicated block id: 682
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigtable.py (52:59)
 - python/dataproc_templates/gcs/gcs_to_gcs.py (54:61)

duplicated block id: 683
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/mongo/mongo_to_gcs.py (63:70)
 - python/dataproc_templates/s3/s3_to_bigquery.py (64:72)

duplicated block id: 684
size: 8 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (811:818)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1076:1083)

duplicated block id: 685
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (570:577)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (574:581)

duplicated block id: 686
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (491:498)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (647:654)

duplicated block id: 687
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (51:58)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (146:154)

duplicated block id: 688
size: 8 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:367)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:662)

duplicated block id: 689
size: 8 cleaned lines of code
in 2 files:
 - notebooks/util/jdbc/engines/mysql_input_manager.py (128:135)
 - notebooks/util/jdbc/engines/mysql_input_manager.py (165:172)

duplicated block id: 690
size: 8 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:137)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:198)

duplicated block id: 691
size: 8 cleaned lines of code
in 2 files:
 - notebooks/util/jdbc/engines/mysql_input_manager.py (21:28)
 - notebooks/util/jdbc/engines/oracle_input_manager.py (22:29)

duplicated block id: 692
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (514:521)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (678:685)

duplicated block id: 693
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (162:169)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (205:212)

duplicated block id: 694
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (138:145)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (172:179)

duplicated block id: 695
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (693:700)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (704:711)

duplicated block id: 696
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hbase/hbase_to_gcs.py (51:58)
 - python/dataproc_templates/hive/hive_to_gcs.py (69:76)

duplicated block id: 697
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (451:458)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (591:598)

duplicated block id: 698
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (116:123)
 - python/dataproc_templates/hive/hive_to_gcs.py (85:92)

duplicated block id: 699
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (835:842)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (843:850)

duplicated block id: 700
size: 8 cleaned lines of code
in 2 files:
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (502:509)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (577:584)

duplicated block id: 701
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (648:655)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (664:671)

duplicated block id: 702
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/redshift/redshift_to_gcs.py (89:96)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (146:154)

duplicated block id: 703
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (479:486)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (614:621)

duplicated block id: 704
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (414:421)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (495:502)

duplicated block id: 705
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (61:68)
 - python/dataproc_templates/gcs/gcs_to_gcs.py (54:61)

duplicated block id: 706
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (128:135)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (146:154)

duplicated block id: 707
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (479:486)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (526:533)

duplicated block id: 708
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (55:62)
 - python/dataproc_templates/hive/hive_to_gcs.py (69:76)

duplicated block id: 709
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (441:448)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (433:440)

duplicated block id: 710
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (665:672)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (763:770)

duplicated block id: 711
size: 8 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (103:110)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (77:84)

duplicated block id: 712
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (874:881)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (844:851)

duplicated block id: 713
size: 8 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (321:328)
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (310:317)

duplicated block id: 714
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_gcs.py (54:61)
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (51:58)

duplicated block id: 715
size: 8 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (112:119)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (126:133)

duplicated block id: 716
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (652:659)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (664:671)

duplicated block id: 717
size: 8 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (286:293)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (366:373)

duplicated block id: 718
size: 8 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (502:509)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (590:597)

duplicated block id: 719
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (275:282)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (307:314)

duplicated block id: 720
size: 8 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (103:110)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (76:83)

duplicated block id: 721
size: 8 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (57:64)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (49:56)

duplicated block id: 722
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/mongo/mongo_to_bq.py (122:131)
 - python/dataproc_templates/mongo/mongo_to_gcs.py (116:125)

duplicated block id: 723
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (275:282)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (292:299)

duplicated block id: 724
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (61:68)
 - python/dataproc_templates/gcs/gcs_to_mongo.py (50:57)

duplicated block id: 725
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (166:173)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (185:192)

duplicated block id: 726
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (721:728)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (722:729)

duplicated block id: 727
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (866:873)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (844:851)

duplicated block id: 728
size: 8 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (426:433)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (383:390)

duplicated block id: 729
size: 8 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/databases/SpannerToGCS.java (60:68)
 - java/src/main/java/com/google/cloud/dataproc/templates/jdbc/JDBCToSpanner.java (81:89)

duplicated block id: 730
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (473:480)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (621:628)

duplicated block id: 731
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (73:80)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (78:85)

duplicated block id: 732
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (633:640)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (825:832)

duplicated block id: 733
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (570:577)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (551:558)

duplicated block id: 734
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_gcs.py (96:104)
 - python/dataproc_templates/s3/s3_to_bigquery.py (64:72)

duplicated block id: 735
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (693:700)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (686:693)

duplicated block id: 736
size: 8 cleaned lines of code
in 2 files:
 - notebooks/util/jdbc/engines/mysql_input_manager.py (110:119)
 - notebooks/util/jdbc/engines/oracle_input_manager.py (119:127)

duplicated block id: 737
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (49:56)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (49:56)

duplicated block id: 738
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (51:58)
 - python/dataproc_templates/gcs/gcs_to_gcs.py (96:104)

duplicated block id: 739
size: 8 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (286:293)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (426:433)

duplicated block id: 740
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (80:87)
 - python/dataproc_templates/hive/hive_to_gcs.py (85:92)

duplicated block id: 741
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (504:511)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (443:450)

duplicated block id: 742
size: 8 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/jdbc/JDBCToGCS.java (51:62)
 - java/src/main/java/com/google/cloud/dataproc/templates/jdbc/JDBCToSpanner.java (59:70)

duplicated block id: 743
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (730:737)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (704:711)

duplicated block id: 744
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (23:30)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (23:30)

duplicated block id: 745
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (55:62)
 - python/dataproc_templates/gcs/gcs_to_gcs.py (96:104)

duplicated block id: 746
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (94:101)
 - python/dataproc_templates/s3/s3_to_bigquery.py (64:72)

duplicated block id: 747
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (547:554)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (590:597)

duplicated block id: 748
size: 8 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (686:693)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (788:795)

duplicated block id: 749
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_gcs.py (54:61)
 - python/dataproc_templates/gcs/gcs_to_mongo.py (50:57)

duplicated block id: 750
size: 8 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (81:88)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (59:66)

duplicated block id: 751
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (55:62)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (146:154)

duplicated block id: 752
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (51:58)
 - python/dataproc_templates/s3/s3_to_bigquery.py (64:72)

duplicated block id: 753
size: 8 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:166)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:198)

duplicated block id: 754
size: 8 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (184:191)
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (220:227)

duplicated block id: 755
size: 8 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsub/PubSubToBigTable.java (176:183)
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsublite/PubSubLiteToBigTable.java (158:165)

duplicated block id: 756
size: 8 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:522)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:751)

duplicated block id: 757
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (721:728)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (711:718)

duplicated block id: 758
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (730:737)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (722:729)

duplicated block id: 759
size: 8 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/jdbc/JDBCToGCSConfig.java (165:178)
 - java/src/main/java/com/google/cloud/dataproc/templates/jdbc/JDBCToSpannerConfig.java (168:181)

duplicated block id: 760
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hive/hive_to_gcs.py (85:92)
 - python/dataproc_templates/mongo/mongo_to_gcs.py (85:92)

duplicated block id: 761
size: 8 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/gcs/GCSToSpannerConfig.java (80:89)
 - java/src/main/java/com/google/cloud/dataproc/templates/jdbc/JDBCToSpannerConfig.java (104:113)

duplicated block id: 762
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_gcs.py (96:104)
 - python/dataproc_templates/mongo/mongo_to_gcs.py (63:70)

duplicated block id: 763
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_gcs.py (96:104)
 - python/dataproc_templates/hbase/hbase_to_gcs.py (51:58)

duplicated block id: 764
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (644:651)
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (659:666)

duplicated block id: 765
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (49:56)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (57:64)

duplicated block id: 766
size: 8 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (79:86)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (77:84)

duplicated block id: 767
size: 8 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/databases/SpannerToGCSConfig.java (81:90)
 - java/src/main/java/com/google/cloud/dataproc/templates/jdbc/JDBCToSpannerConfig.java (107:116)

duplicated block id: 768
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (300:307)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (426:433)

duplicated block id: 769
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (73:80)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (77:84)

duplicated block id: 770
size: 8 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/databases/SpannerToGCS.java (60:68)
 - java/src/main/java/com/google/cloud/dataproc/templates/gcs/GCSToSpanner.java (79:87)

duplicated block id: 771
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (375:382)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (465:472)

duplicated block id: 772
size: 8 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (227:234)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (151:158)

duplicated block id: 773
size: 8 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (366:373)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (383:390)

duplicated block id: 774
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (665:672)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (661:668)

duplicated block id: 775
size: 8 cleaned lines of code
in 2 files:
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (49:56)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (57:64)

duplicated block id: 776
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (504:511)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (484:491)

duplicated block id: 777
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (659:666)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (836:843)

duplicated block id: 778
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (275:282)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (283:290)

duplicated block id: 779
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (49:56)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (49:56)

duplicated block id: 780
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (87:94)
 - python/dataproc_templates/hive/hive_to_gcs.py (85:92)

duplicated block id: 781
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hive/hive_to_gcs.py (69:76)
 - python/dataproc_templates/mongo/mongo_to_gcs.py (63:70)

duplicated block id: 782
size: 8 cleaned lines of code
in 2 files:
 - notebooks/util/jdbc/engines/mysql_input_manager.py (172:180)
 - notebooks/util/jdbc/engines/oracle_input_manager.py (201:209)

duplicated block id: 783
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (665:672)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (875:882)

duplicated block id: 784
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (49:56)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (49:56)

duplicated block id: 785
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (730:737)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (711:718)

duplicated block id: 786
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/s3/s3_to_bigquery.py (64:72)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (146:154)

duplicated block id: 787
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hbase/hbase_to_gcs.py (51:58)
 - python/dataproc_templates/s3/s3_to_bigquery.py (64:72)

duplicated block id: 788
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_gcs.py (96:104)
 - python/dataproc_templates/redshift/redshift_to_gcs.py (89:96)

duplicated block id: 789
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (61:68)
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (63:70)

duplicated block id: 790
size: 8 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (274:281)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (502:509)

duplicated block id: 791
size: 8 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (686:693)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (704:711)

duplicated block id: 792
size: 8 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (79:86)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (76:83)

duplicated block id: 793
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hive/hive_to_gcs.py (85:92)
 - python/dataproc_templates/s3/s3_to_bigquery.py (102:109)

duplicated block id: 794
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (547:554)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (502:509)

duplicated block id: 795
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (55:62)
 - python/dataproc_templates/s3/s3_to_bigquery.py (64:72)

duplicated block id: 796
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (481:488)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (471:478)

duplicated block id: 797
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (116:123)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (117:124)

duplicated block id: 798
size: 8 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (261:268)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (426:433)

duplicated block id: 799
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (94:101)
 - python/dataproc_templates/gcs/gcs_to_gcs.py (96:104)

duplicated block id: 800
size: 8 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (57:64)
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (49:56)

duplicated block id: 801
size: 8 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (171:178)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (185:192)

duplicated block id: 802
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (644:651)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (851:858)

duplicated block id: 803
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (61:68)
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (51:58)

duplicated block id: 804
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (692:699)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (883:890)

duplicated block id: 805
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (73:80)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (76:83)

duplicated block id: 806
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (128:135)
 - python/dataproc_templates/s3/s3_to_bigquery.py (64:72)

duplicated block id: 807
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (800:807)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1019:1026)

duplicated block id: 808
size: 8 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (79:86)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (78:85)

duplicated block id: 809
size: 8 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (23:30)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (23:30)

duplicated block id: 810
size: 8 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (57:64)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (57:64)

duplicated block id: 811
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hbase/hbase_to_gcs.py (51:58)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (146:154)

duplicated block id: 812
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hive/hive_to_gcs.py (85:92)
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (136:143)

duplicated block id: 813
size: 8 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (123:130)
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (99:106)

duplicated block id: 814
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/redshift/redshift_to_gcs.py (89:96)
 - python/dataproc_templates/s3/s3_to_bigquery.py (64:72)

duplicated block id: 815
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (583:590)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (763:770)

duplicated block id: 816
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (94:101)
 - python/dataproc_templates/snowflake/snowflake_to_gcs.py (146:154)

duplicated block id: 817
size: 8 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (103:110)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (78:85)

duplicated block id: 818
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (138:145)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (177:184)

duplicated block id: 819
size: 8 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (612:619)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (800:807)

duplicated block id: 820
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_bq.py (109:116)
 - python/dataproc_templates/hive/hive_to_gcs.py (85:92)

duplicated block id: 821
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hive/hive_to_gcs.py (69:76)
 - python/dataproc_templates/redshift/redshift_to_gcs.py (89:96)

duplicated block id: 822
size: 8 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (63:70)
 - python/dataproc_templates/gcs/gcs_to_gcs.py (54:61)

duplicated block id: 823
size: 8 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (57:64)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (49:56)

duplicated block id: 824
size: 8 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (526:533)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (614:621)

duplicated block id: 825
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)

duplicated block id: 826
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 827
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 828
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (463:469)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (504:510)

duplicated block id: 829
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)

duplicated block id: 830
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (477:483)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (518:524)

duplicated block id: 831
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (411:417)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (535:541)

duplicated block id: 832
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)

duplicated block id: 833
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)

duplicated block id: 834
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)

duplicated block id: 835
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)

duplicated block id: 836
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)

duplicated block id: 837
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 838
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)

duplicated block id: 839
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 840
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 841
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 842
size: 7 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (49:55)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (49:55)

duplicated block id: 843
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 844
size: 7 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (586:592)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (633:639)

duplicated block id: 845
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)

duplicated block id: 846
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 847
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 848
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 849
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)

duplicated block id: 850
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)

duplicated block id: 851
size: 7 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (822:828)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1086:1092)

duplicated block id: 852
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 853
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)

duplicated block id: 854
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (783:789)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (778:784)

duplicated block id: 855
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)

duplicated block id: 856
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 857
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)

duplicated block id: 858
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)

duplicated block id: 859
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 860
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)

duplicated block id: 861
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (49:55)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (50:56)

duplicated block id: 862
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)

duplicated block id: 863
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)

duplicated block id: 864
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 865
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)

duplicated block id: 866
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)

duplicated block id: 867
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)

duplicated block id: 868
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 869
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 870
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 871
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)

duplicated block id: 872
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)

duplicated block id: 873
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (442:448)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (503:509)

duplicated block id: 874
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 875
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)

duplicated block id: 876
size: 7 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (122:132)
 - python/dataproc_templates/gcs/text_to_bigquery.py (103:113)

duplicated block id: 877
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)

duplicated block id: 878
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 879
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (275:281)
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (442:448)

duplicated block id: 880
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)

duplicated block id: 881
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)

duplicated block id: 882
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 883
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)

duplicated block id: 884
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)

duplicated block id: 885
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)

duplicated block id: 886
size: 7 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (50:56)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (49:55)

duplicated block id: 887
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 888
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)

duplicated block id: 889
size: 7 cleaned lines of code
in 2 files:
 - notebooks/util/jdbc/engines/oracle_input_manager.py (56:62)
 - notebooks/util/jdbc/jdbc_input_manager_interface.py (55:61)

duplicated block id: 890
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)

duplicated block id: 891
size: 7 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsub/PubSubToBQ.java (194:200)
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsublite/PubSubLiteToBigTable.java (158:164)

duplicated block id: 892
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)

duplicated block id: 893
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)

duplicated block id: 894
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 895
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (242:248)
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (289:295)

duplicated block id: 896
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)

duplicated block id: 897
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)

duplicated block id: 898
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (178:184)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (229:235)

duplicated block id: 899
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)

duplicated block id: 900
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)

duplicated block id: 901
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 902
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)

duplicated block id: 903
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 904
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)

duplicated block id: 905
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)

duplicated block id: 906
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 907
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 908
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)

duplicated block id: 909
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 910
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)

duplicated block id: 911
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 912
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)

duplicated block id: 913
size: 7 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (540:546)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (577:583)

duplicated block id: 914
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (130:136)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (142:148)

duplicated block id: 915
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)

duplicated block id: 916
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 917
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 918
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)

duplicated block id: 919
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)

duplicated block id: 920
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)

duplicated block id: 921
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 922
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 923
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)

duplicated block id: 924
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 925
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)

duplicated block id: 926
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 927
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)

duplicated block id: 928
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 929
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 930
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 931
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 932
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)

duplicated block id: 933
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)

duplicated block id: 934
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 935
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 936
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)

duplicated block id: 937
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 938
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)

duplicated block id: 939
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)

duplicated block id: 940
size: 7 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (248:254)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (262:268)

duplicated block id: 941
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)

duplicated block id: 942
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)

duplicated block id: 943
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (49:55)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (50:56)

duplicated block id: 944
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)

duplicated block id: 945
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)

duplicated block id: 946
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)

duplicated block id: 947
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)

duplicated block id: 948
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 949
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)

duplicated block id: 950
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)

duplicated block id: 951
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)

duplicated block id: 952
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)

duplicated block id: 953
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)

duplicated block id: 954
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (117:123)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (142:148)

duplicated block id: 955
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)

duplicated block id: 956
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 957
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (320:326)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (463:469)

duplicated block id: 958
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)

duplicated block id: 959
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 960
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)

duplicated block id: 961
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)

duplicated block id: 962
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)

duplicated block id: 963
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)

duplicated block id: 964
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)

duplicated block id: 965
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)

duplicated block id: 966
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (767:773)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (760:766)

duplicated block id: 967
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)

duplicated block id: 968
size: 7 cleaned lines of code
in 2 files:
 - python/dataproc_templates/cassandra/cassandra_to_bigquery.py (141:148)
 - python/dataproc_templates/cassandra/cassandra_to_gcs.py (156:164)

duplicated block id: 969
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)

duplicated block id: 970
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 971
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)

duplicated block id: 972
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)

duplicated block id: 973
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)

duplicated block id: 974
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (883:889)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (858:864)

duplicated block id: 975
size: 7 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/kafka/KafkaToBQ.java (127:133)
 - java/src/main/java/com/google/cloud/dataproc/templates/kafka/KafkaToBQDstream.java (180:186)

duplicated block id: 976
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)

duplicated block id: 977
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)

duplicated block id: 978
size: 7 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/gcs/GCStoBigquery.java (89:96)
 - java/src/main/java/com/google/cloud/dataproc/templates/s3/S3ToBigQuery.java (73:80)

duplicated block id: 979
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)

duplicated block id: 980
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)

duplicated block id: 981
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)

duplicated block id: 982
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)

duplicated block id: 983
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)

duplicated block id: 984
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)

duplicated block id: 985
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (57:63)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (50:56)

duplicated block id: 986
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)

duplicated block id: 987
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (883:889)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (942:948)

duplicated block id: 988
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 989
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)

duplicated block id: 990
size: 7 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/gcs/GCSToJDBCConfig.java (120:130)
 - java/src/main/java/com/google/cloud/dataproc/templates/gcs/GCSToSpannerConfig.java (111:121)

duplicated block id: 991
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 992
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)

duplicated block id: 993
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 994
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)

duplicated block id: 995
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)

duplicated block id: 996
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 997
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 998
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)

duplicated block id: 999
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)

duplicated block id: 1000
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)

duplicated block id: 1001
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 1002
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 1003
size: 7 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsub/PubSubToBQ.java (194:200)
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsub/PubSubToBigTable.java (176:182)

duplicated block id: 1004
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)

duplicated block id: 1005
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)

duplicated block id: 1006
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)

duplicated block id: 1007
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)

duplicated block id: 1008
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)

duplicated block id: 1009
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (274:280)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (522:528)

duplicated block id: 1010
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)

duplicated block id: 1011
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (775:781)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (767:773)

duplicated block id: 1012
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)

duplicated block id: 1013
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (434:440)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (503:509)

duplicated block id: 1014
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)

duplicated block id: 1015
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (619:625)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (626:632)

duplicated block id: 1016
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)

duplicated block id: 1017
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)

duplicated block id: 1018
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)

duplicated block id: 1019
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)

duplicated block id: 1020
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)

duplicated block id: 1021
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)

duplicated block id: 1022
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)

duplicated block id: 1023
size: 7 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsub/PubSubToGCS.java (125:131)
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsublite/PubSubLiteToBigTable.java (158:164)

duplicated block id: 1024
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)

duplicated block id: 1025
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)

duplicated block id: 1026
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)

duplicated block id: 1027
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 1028
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)

duplicated block id: 1029
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)

duplicated block id: 1030
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 1031
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)

duplicated block id: 1032
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)

duplicated block id: 1033
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)

duplicated block id: 1034
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)

duplicated block id: 1035
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)

duplicated block id: 1036
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)

duplicated block id: 1037
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 1038
size: 7 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/gcs/GCSToJDBCConfig.java (120:130)
 - java/src/main/java/com/google/cloud/dataproc/templates/jdbc/JDBCToSpannerConfig.java (208:218)

duplicated block id: 1039
size: 7 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (49:55)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (49:55)

duplicated block id: 1040
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)

duplicated block id: 1041
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 1042
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)

duplicated block id: 1043
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)

duplicated block id: 1044
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)

duplicated block id: 1045
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)

duplicated block id: 1046
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)

duplicated block id: 1047
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 1048
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 1049
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 1050
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 1051
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)

duplicated block id: 1052
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)

duplicated block id: 1053
size: 7 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (461:467)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (577:583)

duplicated block id: 1054
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)

duplicated block id: 1055
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 1056
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 1057
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)

duplicated block id: 1058
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 1059
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (812:818)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1035:1041)

duplicated block id: 1060
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)

duplicated block id: 1061
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)

duplicated block id: 1062
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 1063
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)

duplicated block id: 1064
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (177:183)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (224:230)

duplicated block id: 1065
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)

duplicated block id: 1066
size: 7 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (427:433)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (468:474)

duplicated block id: 1067
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)

duplicated block id: 1068
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)

duplicated block id: 1069
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)

duplicated block id: 1070
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)

duplicated block id: 1071
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 1072
size: 7 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (50:56)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (57:63)

duplicated block id: 1073
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (49:55)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (50:56)

duplicated block id: 1074
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (57:63)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (50:56)

duplicated block id: 1075
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 1076
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)

duplicated block id: 1077
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)

duplicated block id: 1078
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 1079
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)

duplicated block id: 1080
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 1081
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 1082
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (749:755)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (758:764)

duplicated block id: 1083
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)

duplicated block id: 1084
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)

duplicated block id: 1085
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (49:55)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (50:56)

duplicated block id: 1086
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)

duplicated block id: 1087
size: 7 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/gcs/GCStoBigTable.java (78:84)
 - java/src/main/java/com/google/cloud/dataproc/templates/gcs/GCStoBigquery.java (92:98)

duplicated block id: 1088
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 1089
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)

duplicated block id: 1090
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 1091
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)

duplicated block id: 1092
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)

duplicated block id: 1093
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)

duplicated block id: 1094
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)

duplicated block id: 1095
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (434:440)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (578:584)

duplicated block id: 1096
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)

duplicated block id: 1097
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)

duplicated block id: 1098
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)

duplicated block id: 1099
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)

duplicated block id: 1100
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)

duplicated block id: 1101
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)

duplicated block id: 1102
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)

duplicated block id: 1103
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)

duplicated block id: 1104
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 1105
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)

duplicated block id: 1106
size: 7 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (173:179)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (262:268)

duplicated block id: 1107
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)

duplicated block id: 1108
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (107:113)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (130:136)

duplicated block id: 1109
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)

duplicated block id: 1110
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)

duplicated block id: 1111
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 1112
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 1113
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)

duplicated block id: 1114
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)

duplicated block id: 1115
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 1116
size: 7 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (504:510)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (468:474)

duplicated block id: 1117
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)

duplicated block id: 1118
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)

duplicated block id: 1119
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)

duplicated block id: 1120
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)

duplicated block id: 1121
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 1122
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)

duplicated block id: 1123
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 1124
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)

duplicated block id: 1125
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)

duplicated block id: 1126
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)

duplicated block id: 1127
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)

duplicated block id: 1128
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)

duplicated block id: 1129
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)

duplicated block id: 1130
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)

duplicated block id: 1131
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 1132
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)

duplicated block id: 1133
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 1134
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)

duplicated block id: 1135
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 1136
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)

duplicated block id: 1137
size: 7 cleaned lines of code
in 2 files:
 - notebooks/util/jdbc/engines/mysql_input_manager.py (50:56)
 - notebooks/util/jdbc/jdbc_input_manager_interface.py (55:61)

duplicated block id: 1138
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 1139
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)

duplicated block id: 1140
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)

duplicated block id: 1141
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 1142
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)

duplicated block id: 1143
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)

duplicated block id: 1144
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 1145
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)

duplicated block id: 1146
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (107:113)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (117:123)

duplicated block id: 1147
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)

duplicated block id: 1148
size: 7 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (839:845)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (675:681)

duplicated block id: 1149
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)

duplicated block id: 1150
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (685:691)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (696:702)

duplicated block id: 1151
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)

duplicated block id: 1152
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (607:613)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (613:619)

duplicated block id: 1153
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)

duplicated block id: 1154
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)

duplicated block id: 1155
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)

duplicated block id: 1156
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 1157
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)

duplicated block id: 1158
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (49:55)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (50:56)

duplicated block id: 1159
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)

duplicated block id: 1160
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)

duplicated block id: 1161
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)

duplicated block id: 1162
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)

duplicated block id: 1163
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)

duplicated block id: 1164
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)

duplicated block id: 1165
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)

duplicated block id: 1166
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)

duplicated block id: 1167
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 1168
size: 7 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (50:56)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (57:63)

duplicated block id: 1169
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)

duplicated block id: 1170
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)

duplicated block id: 1171
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)

duplicated block id: 1172
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)

duplicated block id: 1173
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)

duplicated block id: 1174
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 1175
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)

duplicated block id: 1176
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)

duplicated block id: 1177
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)

duplicated block id: 1178
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 1179
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)

duplicated block id: 1180
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)

duplicated block id: 1181
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (463:469)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (427:433)

duplicated block id: 1182
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)

duplicated block id: 1183
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)

duplicated block id: 1184
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)

duplicated block id: 1185
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)

duplicated block id: 1186
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)

duplicated block id: 1187
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)

duplicated block id: 1188
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)

duplicated block id: 1189
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)

duplicated block id: 1190
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)

duplicated block id: 1191
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)

duplicated block id: 1192
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)

duplicated block id: 1193
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)

duplicated block id: 1194
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)

duplicated block id: 1195
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)

duplicated block id: 1196
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)

duplicated block id: 1197
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)

duplicated block id: 1198
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 1199
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 1200
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 1201
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)

duplicated block id: 1202
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (783:789)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (760:766)

duplicated block id: 1203
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)

duplicated block id: 1204
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)

duplicated block id: 1205
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 1206
size: 7 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (129:135)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (142:148)

duplicated block id: 1207
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 1208
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 1209
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 1210
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)

duplicated block id: 1211
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)

duplicated block id: 1212
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 1213
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 1214
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 1215
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)

duplicated block id: 1216
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)

duplicated block id: 1217
size: 7 cleaned lines of code
in 2 files:
 - python/dataproc_templates/kafka/kafka_to_gcs.py (83:95)
 - python/dataproc_templates/pubsublite/pubsublite_to_gcs.py (93:103)

duplicated block id: 1218
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 1219
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)

duplicated block id: 1220
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 1221
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 1222
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 1223
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 1224
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (477:483)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (482:488)

duplicated block id: 1225
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 1226
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 1227
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)

duplicated block id: 1228
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 1229
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 1230
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)

duplicated block id: 1231
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)

duplicated block id: 1232
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)

duplicated block id: 1233
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)

duplicated block id: 1234
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)

duplicated block id: 1235
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)

duplicated block id: 1236
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)

duplicated block id: 1237
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 1238
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)

duplicated block id: 1239
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)

duplicated block id: 1240
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)

duplicated block id: 1241
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)

duplicated block id: 1242
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)

duplicated block id: 1243
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)

duplicated block id: 1244
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)

duplicated block id: 1245
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)

duplicated block id: 1246
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)

duplicated block id: 1247
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 1248
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)

duplicated block id: 1249
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)

duplicated block id: 1250
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)

duplicated block id: 1251
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)

duplicated block id: 1252
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)

duplicated block id: 1253
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)

duplicated block id: 1254
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)

duplicated block id: 1255
size: 7 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (297:303)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (577:583)

duplicated block id: 1256
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)

duplicated block id: 1257
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)

duplicated block id: 1258
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)

duplicated block id: 1259
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)

duplicated block id: 1260
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)

duplicated block id: 1261
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)

duplicated block id: 1262
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)

duplicated block id: 1263
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)

duplicated block id: 1264
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)

duplicated block id: 1265
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)

duplicated block id: 1266
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)

duplicated block id: 1267
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)

duplicated block id: 1268
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)

duplicated block id: 1269
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)

duplicated block id: 1270
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)

duplicated block id: 1271
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)

duplicated block id: 1272
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)

duplicated block id: 1273
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)

duplicated block id: 1274
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)

duplicated block id: 1275
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)

duplicated block id: 1276
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)

duplicated block id: 1277
size: 7 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (406:412)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (345:351)

duplicated block id: 1278
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 1279
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)

duplicated block id: 1280
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (178:184)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (223:229)

duplicated block id: 1281
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)

duplicated block id: 1282
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)

duplicated block id: 1283
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 1284
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)

duplicated block id: 1285
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 1286
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)

duplicated block id: 1287
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)

duplicated block id: 1288
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 1289
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 1290
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (275:281)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (434:440)

duplicated block id: 1291
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)

duplicated block id: 1292
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 1293
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 1294
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)

duplicated block id: 1295
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)

duplicated block id: 1296
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 1297
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)

duplicated block id: 1298
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)

duplicated block id: 1299
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 1300
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)

duplicated block id: 1301
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 1302
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)

duplicated block id: 1303
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)

duplicated block id: 1304
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)

duplicated block id: 1305
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 1306
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (274:280)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (461:467)

duplicated block id: 1307
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)

duplicated block id: 1308
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 1309
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 1310
size: 7 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (240:246)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (246:252)

duplicated block id: 1311
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)

duplicated block id: 1312
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 1313
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 1314
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (783:789)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (767:773)

duplicated block id: 1315
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)

duplicated block id: 1316
size: 7 cleaned lines of code
in 2 files:
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (858:864)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1103:1109)

duplicated block id: 1317
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (178:184)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (219:225)

duplicated block id: 1318
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)

duplicated block id: 1319
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)

duplicated block id: 1320
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)

duplicated block id: 1321
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (423:429)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (551:557)

duplicated block id: 1322
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 1323
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 1324
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)

duplicated block id: 1325
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 1326
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)

duplicated block id: 1327
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 1328
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)

duplicated block id: 1329
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 1330
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 1331
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)

duplicated block id: 1332
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 1333
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 1334
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 1335
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 1336
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)

duplicated block id: 1337
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)

duplicated block id: 1338
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 1339
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 1340
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 1341
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)

duplicated block id: 1342
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)

duplicated block id: 1343
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 1344
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)

duplicated block id: 1345
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 1346
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (854:860)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (822:828)

duplicated block id: 1347
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)

duplicated block id: 1348
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)

duplicated block id: 1349
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)

duplicated block id: 1350
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)

duplicated block id: 1351
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)

duplicated block id: 1352
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)

duplicated block id: 1353
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 1354
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)

duplicated block id: 1355
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)

duplicated block id: 1356
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)

duplicated block id: 1357
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)

duplicated block id: 1358
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (49:55)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (50:56)

duplicated block id: 1359
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 1360
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (50:56)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (57:63)

duplicated block id: 1361
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)

duplicated block id: 1362
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)

duplicated block id: 1363
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 1364
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)

duplicated block id: 1365
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)

duplicated block id: 1366
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)

duplicated block id: 1367
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (477:483)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (441:447)

duplicated block id: 1368
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)

duplicated block id: 1369
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 1370
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)

duplicated block id: 1371
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)

duplicated block id: 1372
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (633:639)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (701:707)

duplicated block id: 1373
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 1374
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 1375
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)

duplicated block id: 1376
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 1377
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)

duplicated block id: 1378
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 1379
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)

duplicated block id: 1380
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 1381
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 1382
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)

duplicated block id: 1383
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 1384
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)

duplicated block id: 1385
size: 7 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (773:779)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (690:696)

duplicated block id: 1386
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 1387
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 1388
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)

duplicated block id: 1389
size: 7 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (942:948)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (858:864)

duplicated block id: 1390
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)

duplicated block id: 1391
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)

duplicated block id: 1392
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 1393
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 1394
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)

duplicated block id: 1395
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)

duplicated block id: 1396
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 1397
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 1398
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 1399
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)

duplicated block id: 1400
size: 7 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (605:611)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (825:831)

duplicated block id: 1401
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 1402
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 1403
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 1404
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)

duplicated block id: 1405
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)

duplicated block id: 1406
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)

duplicated block id: 1407
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 1408
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 1409
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 1410
size: 7 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (474:480)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (514:520)

duplicated block id: 1411
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 1412
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 1413
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 1414
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 1415
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)

duplicated block id: 1416
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)

duplicated block id: 1417
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 1418
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)

duplicated block id: 1419
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (775:781)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (778:784)

duplicated block id: 1420
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 1421
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 1422
size: 7 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (839:845)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (686:692)

duplicated block id: 1423
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 1424
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)

duplicated block id: 1425
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)

duplicated block id: 1426
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)

duplicated block id: 1427
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 1428
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (845:851)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (812:818)

duplicated block id: 1429
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 1430
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)

duplicated block id: 1431
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 1432
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)

duplicated block id: 1433
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 1434
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (465:471)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (609:615)

duplicated block id: 1435
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)

duplicated block id: 1436
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 1437
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 1438
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)

duplicated block id: 1439
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 1440
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 1441
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)

duplicated block id: 1442
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 1443
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)

duplicated block id: 1444
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)

duplicated block id: 1445
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 1446
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 1447
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 1448
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 1449
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (775:781)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (783:789)

duplicated block id: 1450
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)

duplicated block id: 1451
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)

duplicated block id: 1452
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)

duplicated block id: 1453
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)

duplicated block id: 1454
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)

duplicated block id: 1455
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)

duplicated block id: 1456
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (845:851)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1077:1083)

duplicated block id: 1457
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)

duplicated block id: 1458
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 1459
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (866:872)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (836:842)

duplicated block id: 1460
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)

duplicated block id: 1461
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)

duplicated block id: 1462
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 1463
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)

duplicated block id: 1464
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 1465
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)

duplicated block id: 1466
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)

duplicated block id: 1467
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 1468
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)

duplicated block id: 1469
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)

duplicated block id: 1470
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)

duplicated block id: 1471
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)

duplicated block id: 1472
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 1473
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)

duplicated block id: 1474
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 1475
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 1476
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 1477
size: 7 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (942:948)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1103:1109)

duplicated block id: 1478
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 1479
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 1480
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 1481
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)

duplicated block id: 1482
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 1483
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)

duplicated block id: 1484
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 1485
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 1486
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 1487
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (883:889)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1103:1109)

duplicated block id: 1488
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 1489
size: 7 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (671:677)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (690:696)

duplicated block id: 1490
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 1491
size: 7 cleaned lines of code
in 2 files:
 - python/dataproc_templates/kafka/kafka_to_gcs.py (68:74)
 - python/dataproc_templates/pubsublite/pubsublite_to_gcs.py (42:48)

duplicated block id: 1492
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 1493
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (50:56)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (49:55)

duplicated block id: 1494
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 1495
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)

duplicated block id: 1496
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)

duplicated block id: 1497
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 1498
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)

duplicated block id: 1499
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)

duplicated block id: 1500
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 1501
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 1502
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)

duplicated block id: 1503
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 1504
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 1505
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 1506
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 1507
size: 7 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (346:352)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (345:351)

duplicated block id: 1508
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 1509
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 1510
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 1511
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 1512
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)

duplicated block id: 1513
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)

duplicated block id: 1514
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)

duplicated block id: 1515
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)

duplicated block id: 1516
size: 7 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (760:766)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (778:784)

duplicated block id: 1517
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)

duplicated block id: 1518
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 1519
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)

duplicated block id: 1520
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (57:63)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (50:56)

duplicated block id: 1521
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 1522
size: 7 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (129:135)
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (107:113)

duplicated block id: 1523
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 1524
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)

duplicated block id: 1525
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)

duplicated block id: 1526
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)

duplicated block id: 1527
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 1528
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)

duplicated block id: 1529
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 1530
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)

duplicated block id: 1531
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 1532
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)

duplicated block id: 1533
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)

duplicated block id: 1534
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)

duplicated block id: 1535
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 1536
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (125:131)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (177:183)

duplicated block id: 1537
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 1538
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)

duplicated block id: 1539
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)

duplicated block id: 1540
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (57:63)
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (49:55)

duplicated block id: 1541
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)

duplicated block id: 1542
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (180:186)

duplicated block id: 1543
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 1544
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)

duplicated block id: 1545
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)

duplicated block id: 1546
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 1547
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)

duplicated block id: 1548
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (775:781)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (760:766)

duplicated block id: 1549
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 1550
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)

duplicated block id: 1551
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (274:280)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (540:546)

duplicated block id: 1552
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)

duplicated block id: 1553
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 1554
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 1555
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)

duplicated block id: 1556
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)

duplicated block id: 1557
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 1558
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 1559
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)

duplicated block id: 1560
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)

duplicated block id: 1561
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)

duplicated block id: 1562
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (246:252)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (262:268)

duplicated block id: 1563
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)

duplicated block id: 1564
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 1565
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 1566
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)

duplicated block id: 1567
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 1568
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)

duplicated block id: 1569
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)

duplicated block id: 1570
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)

duplicated block id: 1571
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)

duplicated block id: 1572
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)

duplicated block id: 1573
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 1574
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)

duplicated block id: 1575
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 1576
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)

duplicated block id: 1577
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)

duplicated block id: 1578
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)

duplicated block id: 1579
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 1580
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 1581
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)

duplicated block id: 1582
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)

duplicated block id: 1583
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)

duplicated block id: 1584
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)

duplicated block id: 1585
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)

duplicated block id: 1586
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (457:463)

duplicated block id: 1587
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)

duplicated block id: 1588
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)

duplicated block id: 1589
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)

duplicated block id: 1590
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (767:773)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (778:784)

duplicated block id: 1591
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 1592
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 1593
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)

duplicated block id: 1594
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)

duplicated block id: 1595
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 1596
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)

duplicated block id: 1597
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 1598
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 1599
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)

duplicated block id: 1600
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)

duplicated block id: 1601
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 1602
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)

duplicated block id: 1603
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 1604
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)

duplicated block id: 1605
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 1606
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 1607
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)

duplicated block id: 1608
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 1609
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)

duplicated block id: 1610
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (432:438)

duplicated block id: 1611
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)

duplicated block id: 1612
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)

duplicated block id: 1613
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (472:478)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (634:640)

duplicated block id: 1614
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 1615
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)

duplicated block id: 1616
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)

duplicated block id: 1617
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (115:121)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (177:183)

duplicated block id: 1618
size: 7 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (835:841)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (956:962)

duplicated block id: 1619
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (274:280)
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (297:303)

duplicated block id: 1620
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (279:285)

duplicated block id: 1621
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 1622
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)

duplicated block id: 1623
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)

duplicated block id: 1624
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (387:393)

duplicated block id: 1625
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 1626
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 1627
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)

duplicated block id: 1628
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)

duplicated block id: 1629
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (270:276)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 1630
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 1631
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)

duplicated block id: 1632
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)

duplicated block id: 1633
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 1634
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)

duplicated block id: 1635
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)

duplicated block id: 1636
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 1637
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (573:579)

duplicated block id: 1638
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 1639
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)

duplicated block id: 1640
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 1641
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (599:605)

duplicated block id: 1642
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)

duplicated block id: 1643
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 1644
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)

duplicated block id: 1645
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (159:165)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 1646
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)

duplicated block id: 1647
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)

duplicated block id: 1648
size: 7 cleaned lines of code
in 2 files:
 - notebooks/util/jdbc/engines/mysql_input_manager.py (34:44)
 - notebooks/util/jdbc/engines/oracle_input_manager.py (35:45)

duplicated block id: 1649
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)

duplicated block id: 1650
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 1651
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)

duplicated block id: 1652
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)

duplicated block id: 1653
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 1654
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)

duplicated block id: 1655
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 1656
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (7:13)

duplicated block id: 1657
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)

duplicated block id: 1658
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)

duplicated block id: 1659
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)

duplicated block id: 1660
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 1661
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)

duplicated block id: 1662
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 1663
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 1664
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)

duplicated block id: 1665
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 1666
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 1667
size: 7 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (522:528)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (577:583)

duplicated block id: 1668
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 1669
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)

duplicated block id: 1670
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 1671
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)

duplicated block id: 1672
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 1673
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 1674
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)

duplicated block id: 1675
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)

duplicated block id: 1676
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 1677
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (7:13)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)

duplicated block id: 1678
size: 7 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (262:268)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (244:250)

duplicated block id: 1679
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 1680
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 1681
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)

duplicated block id: 1682
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (296:302)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 1683
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 1684
size: 7 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (553:559)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (514:520)

duplicated block id: 1685
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1094:1100)

duplicated block id: 1686
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)

duplicated block id: 1687
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (952:958)

duplicated block id: 1688
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (328:334)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (891:897)

duplicated block id: 1689
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (919:925)

duplicated block id: 1690
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)

duplicated block id: 1691
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)

duplicated block id: 1692
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (392:398)

duplicated block id: 1693
size: 7 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (49:55)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (57:63)

duplicated block id: 1694
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)

duplicated block id: 1695
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 1696
size: 7 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (49:55)
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (49:55)

duplicated block id: 1697
size: 7 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (839:845)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (699:705)

duplicated block id: 1698
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (629:635)

duplicated block id: 1699
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 1700
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (729:735)

duplicated block id: 1701
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (130:136)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)

duplicated block id: 1702
size: 7 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsub/PubSubToBigTable.java (176:182)
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsub/PubSubToGCS.java (125:131)

duplicated block id: 1703
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)

duplicated block id: 1704
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (109:115)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (744:750)

duplicated block id: 1705
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (515:521)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (655:661)

duplicated block id: 1706
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (686:692)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)

duplicated block id: 1707
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (542:548)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (808:814)

duplicated block id: 1708
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1027:1033)

duplicated block id: 1709
size: 7 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (50:56)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (49:55)

duplicated block id: 1710
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (467:473)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (790:796)

duplicated block id: 1711
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (191:197)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (430:436)

duplicated block id: 1712
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1042:1048)

duplicated block id: 1713
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (248:254)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1072:1078)

duplicated block id: 1714
size: 7 cleaned lines of code
in 2 files:
 - notebooks/util/jdbc/engines/mysql_input_manager.py (149:157)
 - notebooks/util/jdbc/engines/oracle_input_manager.py (176:184)

duplicated block id: 1715
size: 7 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (150:156)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1000:1006)

duplicated block id: 1716
size: 7 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (360:366)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (974:980)

duplicated block id: 1717
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (117:122)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (642:647)

duplicated block id: 1718
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (871:876)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (928:933)

duplicated block id: 1719
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (76:81)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (213:218)

duplicated block id: 1720
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (642:647)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (671:676)

duplicated block id: 1721
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (66:71)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (558:563)

duplicated block id: 1722
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (117:122)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (616:621)

duplicated block id: 1723
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (66:71)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (500:505)

duplicated block id: 1724
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (558:563)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (906:911)

duplicated block id: 1725
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (117:122)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (671:676)

duplicated block id: 1726
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (472:477)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (587:592)

duplicated block id: 1727
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (315:320)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (213:218)

duplicated block id: 1728
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (349:354)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1014:1019)

duplicated block id: 1729
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (283:288)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (771:776)

duplicated block id: 1730
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (450:455)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (213:218)

duplicated block id: 1731
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (76:81)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (299:304)

duplicated block id: 1732
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (303:308)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (262:267)

duplicated block id: 1733
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (143:152)
 - python/dataproc_templates/pubsublite/pubsublite_to_gcs.py (94:103)

duplicated block id: 1734
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (32:37)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (117:122)

duplicated block id: 1735
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (135:140)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1014:1019)

duplicated block id: 1736
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (127:132)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (677:682)

duplicated block id: 1737
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (283:288)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (713:718)

duplicated block id: 1738
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (32:37)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (146:151)

duplicated block id: 1739
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (315:320)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (299:304)

duplicated block id: 1740
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (110:119)
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (123:132)

duplicated block id: 1741
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (32:37)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (178:183)

duplicated block id: 1742
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (402:407)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (526:531)

duplicated block id: 1743
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (178:183)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (135:140)

duplicated block id: 1744
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (450:455)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (167:172)

duplicated block id: 1745
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/text_to_bigquery.py (104:113)
 - python/dataproc_templates/mongo/mongo_to_bq.py (97:106)

duplicated block id: 1746
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (426:431)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (531:536)

duplicated block id: 1747
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (283:288)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (404:409)

duplicated block id: 1748
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (283:288)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (416:421)

duplicated block id: 1749
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (213:218)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1014:1019)

duplicated block id: 1750
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (96:101)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (349:354)

duplicated block id: 1751
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (283:288)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (450:455)

duplicated block id: 1752
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (66:71)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (586:591)

duplicated block id: 1753
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (876:881)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1134:1139)

duplicated block id: 1754
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/kafka/kafka_to_bq.py (77:86)
 - python/dataproc_templates/kafka/kafka_to_gcs.py (84:95)

duplicated block id: 1755
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (200:205)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (196:201)

duplicated block id: 1756
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (301:306)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (292:297)

duplicated block id: 1757
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (124:129)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (427:432)

duplicated block id: 1758
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (123:132)
 - python/dataproc_templates/gcs/gcs_to_mongo.py (100:109)

duplicated block id: 1759
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (404:409)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (906:911)

duplicated block id: 1760
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (519:524)
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (897:902)

duplicated block id: 1761
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (303:308)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (315:320)

duplicated block id: 1762
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (117:122)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (500:505)

duplicated block id: 1763
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (146:151)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1014:1019)

duplicated block id: 1764
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (117:122)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (558:563)

duplicated block id: 1765
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (283:288)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (671:676)

duplicated block id: 1766
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (283:288)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (642:647)

duplicated block id: 1767
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (32:37)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (215:220)

duplicated block id: 1768
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (642:647)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (713:718)

duplicated block id: 1769
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (315:320)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (167:172)

duplicated block id: 1770
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (504:509)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (558:563)

duplicated block id: 1771
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (94:99)

duplicated block id: 1772
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (416:421)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (66:71)

duplicated block id: 1773
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (315:320)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (135:140)

duplicated block id: 1774
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (416:421)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (94:99)

duplicated block id: 1775
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (399:404)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (338:343)

duplicated block id: 1776
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (708:713)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (803:808)

duplicated block id: 1777
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (671:676)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (906:911)

duplicated block id: 1778
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (283:288)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (616:621)

duplicated block id: 1779
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (385:390)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (402:407)

duplicated block id: 1780
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (76:81)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (167:172)

duplicated block id: 1781
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (450:455)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (135:140)

duplicated block id: 1782
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (66:71)

duplicated block id: 1783
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (66:71)

duplicated block id: 1784
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (178:183)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (167:172)

duplicated block id: 1785
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (76:81)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (135:140)

duplicated block id: 1786
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (260:265)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (262:267)

duplicated block id: 1787
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (32:37)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (283:288)

duplicated block id: 1788
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (642:647)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (771:776)

duplicated block id: 1789
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (94:99)

duplicated block id: 1790
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (146:151)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (713:718)

duplicated block id: 1791
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (313:318)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (426:431)

duplicated block id: 1792
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (127:132)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (495:500)

duplicated block id: 1793
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (96:101)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (66:71)

duplicated block id: 1794
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (76:81)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (32:37)

duplicated block id: 1795
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (96:101)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (32:37)

duplicated block id: 1796
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (416:421)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (32:37)

duplicated block id: 1797
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (96:101)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (94:99)

duplicated block id: 1798
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (480:485)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (779:784)

duplicated block id: 1799
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (178:183)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (213:218)

duplicated block id: 1800
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (76:81)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (66:71)

duplicated block id: 1801
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (135:140)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (906:911)

duplicated block id: 1802
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (781:786)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (697:702)

duplicated block id: 1803
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (117:122)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (586:591)

duplicated block id: 1804
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (146:151)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (771:776)

duplicated block id: 1805
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigtable.py (92:101)
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (107:115)

duplicated block id: 1806
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (260:265)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (258:263)

duplicated block id: 1807
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (76:81)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (94:99)

duplicated block id: 1808
size: 6 cleaned lines of code
in 2 files:
 - notebooks/util/jdbc/jdbc_input_manager_interface.py (175:180)
 - notebooks/util/jdbc/jdbc_input_manager_interface.py (190:195)

duplicated block id: 1809
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (115:120)
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (105:110)

duplicated block id: 1810
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (693:698)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (772:777)

duplicated block id: 1811
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (283:288)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (386:391)

duplicated block id: 1812
size: 6 cleaned lines of code
in 2 files:
 - notebooks/util/jdbc/jdbc_input_manager_interface.py (175:180)
 - notebooks/util/jdbc/jdbc_input_manager_interface.py (205:210)

duplicated block id: 1813
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (416:421)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (213:218)

duplicated block id: 1814
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (146:151)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (66:71)

duplicated block id: 1815
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (178:183)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1014:1019)

duplicated block id: 1816
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (146:151)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (94:99)

duplicated block id: 1817
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (713:718)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (906:911)

duplicated block id: 1818
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (213:218)

duplicated block id: 1819
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (96:101)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (586:591)

duplicated block id: 1820
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (260:265)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (315:320)

duplicated block id: 1821
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (146:151)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (586:591)

duplicated block id: 1822
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (94:103)
 - python/dataproc_templates/kafka/kafka_to_gcs.py (84:95)

duplicated block id: 1823
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_parameterize_script.py (122:131)
 - notebooks/postgresql2bq/PostgreSqlToBigQuery_parameterize_script.py (114:122)

duplicated block id: 1824
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/text_to_bigquery.py (104:113)
 - python/dataproc_templates/hive/util/hive_ddl_extractor.py (64:78)

duplicated block id: 1825
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (96:101)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (558:563)

duplicated block id: 1826
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (146:151)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (32:37)

duplicated block id: 1827
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (558:563)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (713:718)

duplicated block id: 1828
size: 6 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_parameterize_script.py (99:108)
 - notebooks/mysql2spanner/MySqlToSpanner_parameterize_script.py (122:131)

duplicated block id: 1829
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (96:101)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (500:505)

duplicated block id: 1830
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (848:853)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (798:803)

duplicated block id: 1831
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (558:563)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (771:776)

duplicated block id: 1832
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (262:267)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (258:263)

duplicated block id: 1833
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (127:132)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (480:485)

duplicated block id: 1834
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (519:524)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (943:948)

duplicated block id: 1835
size: 6 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (298:303)
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (442:447)

duplicated block id: 1836
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (110:119)
 - python/dataproc_templates/gcs/text_to_bigquery.py (104:113)

duplicated block id: 1837
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (127:132)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (559:564)

duplicated block id: 1838
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (906:911)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (876:881)

duplicated block id: 1839
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (515:520)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (488:493)

duplicated block id: 1840
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (215:220)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (450:455)

duplicated block id: 1841
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (200:205)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (200:205)

duplicated block id: 1842
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (404:409)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (671:676)

duplicated block id: 1843
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (32:37)

duplicated block id: 1844
size: 6 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (323:328)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (589:594)

duplicated block id: 1845
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (107:115)
 - python/dataproc_templates/gcs/text_to_bigquery.py (104:113)

duplicated block id: 1846
size: 6 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/gcs/GCSToJDBCConfig.java (145:150)
 - java/src/main/java/com/google/cloud/dataproc/templates/gcs/GCSToSpannerConfig.java (140:145)

duplicated block id: 1847
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (215:220)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (404:409)

duplicated block id: 1848
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (215:220)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (416:421)

duplicated block id: 1849
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (153:158)
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (131:136)

duplicated block id: 1850
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (146:151)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (671:676)

duplicated block id: 1851
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (404:409)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (616:621)

duplicated block id: 1852
size: 6 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (730:735)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (503:508)

duplicated block id: 1853
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (94:103)
 - python/dataproc_templates/hive/util/hive_ddl_extractor.py (64:78)

duplicated block id: 1854
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hive/hive_to_bigquery.py (133:142)
 - python/dataproc_templates/jdbc/jdbc_to_jdbc.py (258:267)

duplicated block id: 1855
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (146:151)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (642:647)

duplicated block id: 1856
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (66:71)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (349:354)

duplicated block id: 1857
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (416:421)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (135:140)

duplicated block id: 1858
size: 6 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (230:235)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (148:153)

duplicated block id: 1859
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (146:151)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (616:621)

duplicated block id: 1860
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (404:409)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (642:647)

duplicated block id: 1861
size: 6 cleaned lines of code
in 2 files:
 - notebooks/util/jdbc/engines/mysql_input_manager.py (94:99)
 - notebooks/util/jdbc/engines/oracle_input_manager.py (85:90)

duplicated block id: 1862
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_parameterize_script.py (122:131)
 - notebooks/oracle2postgres/OracleToPostgres_parameterize_script.py (140:148)

duplicated block id: 1863
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (167:172)

duplicated block id: 1864
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (416:421)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (167:172)

duplicated block id: 1865
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (135:140)

duplicated block id: 1866
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (416:421)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (349:354)

duplicated block id: 1867
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (315:320)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (32:37)

duplicated block id: 1868
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (96:101)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (642:647)

duplicated block id: 1869
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (374:379)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (416:421)

duplicated block id: 1870
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (302:307)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (364:369)

duplicated block id: 1871
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (66:71)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (213:218)

duplicated block id: 1872
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (299:304)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (349:354)

duplicated block id: 1873
size: 6 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (730:735)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (550:555)

duplicated block id: 1874
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (504:509)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (535:540)

duplicated block id: 1875
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (374:379)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (450:455)

duplicated block id: 1876
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (32:37)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (76:81)

duplicated block id: 1877
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (117:122)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (771:776)

duplicated block id: 1878
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (315:320)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (66:71)

duplicated block id: 1879
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (32:37)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (96:101)

duplicated block id: 1880
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (96:101)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (671:676)

duplicated block id: 1881
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (123:132)
 - python/dataproc_templates/mongo/mongo_to_bq.py (97:106)

duplicated block id: 1882
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (315:320)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (94:99)

duplicated block id: 1883
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (677:682)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (583:588)

duplicated block id: 1884
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (504:509)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (488:493)

duplicated block id: 1885
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (96:101)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (616:621)

duplicated block id: 1886
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (283:288)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (32:37)

duplicated block id: 1887
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (535:540)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (679:684)

duplicated block id: 1888
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (117:122)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (713:718)

duplicated block id: 1889
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (374:379)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (404:409)

duplicated block id: 1890
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (558:563)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (616:621)

duplicated block id: 1891
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigtable.py (92:101)
 - python/dataproc_templates/gcs/text_to_bigquery.py (104:113)

duplicated block id: 1892
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (558:563)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (642:647)

duplicated block id: 1893
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (677:682)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (559:564)

duplicated block id: 1894
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (558:563)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (671:676)

duplicated block id: 1895
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (283:288)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (66:71)

duplicated block id: 1896
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (283:288)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (906:911)

duplicated block id: 1897
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (123:132)
 - python/dataproc_templates/s3/s3_to_bigquery.py (109:118)

duplicated block id: 1898
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (343:348)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1014:1019)

duplicated block id: 1899
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (215:220)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (343:348)

duplicated block id: 1900
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_gcs.py (154:161)
 - python/dataproc_templates/gcs/text_to_bigquery.py (128:135)

duplicated block id: 1901
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (283:288)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (315:320)

duplicated block id: 1902
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (215:220)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (315:320)

duplicated block id: 1903
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (283:288)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (94:99)

duplicated block id: 1904
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (146:151)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (558:563)

duplicated block id: 1905
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (283:288)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (343:348)

duplicated block id: 1906
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (221:226)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (239:244)

duplicated block id: 1907
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (416:421)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (299:304)

duplicated block id: 1908
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (404:409)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (713:718)

duplicated block id: 1909
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (66:71)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (299:304)

duplicated block id: 1910
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (495:500)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (559:564)

duplicated block id: 1911
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (124:129)
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (208:213)

duplicated block id: 1912
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (123:132)
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (143:152)

duplicated block id: 1913
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (146:151)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (500:505)

duplicated block id: 1914
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (404:409)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (771:776)

duplicated block id: 1915
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (215:220)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1014:1019)

duplicated block id: 1916
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (215:220)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (374:379)

duplicated block id: 1917
size: 6 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsub/PubSubToBQ.java (61:66)
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsub/PubSubToBigTable.java (53:58)

duplicated block id: 1918
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (848:853)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (887:892)

duplicated block id: 1919
size: 6 cleaned lines of code
in 2 files:
 - notebooks/util/jdbc/engines/mysql_input_manager.py (78:83)
 - notebooks/util/jdbc/engines/mysql_input_manager.py (94:99)

duplicated block id: 1920
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (283:288)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (374:379)

duplicated block id: 1921
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (315:320)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (671:676)

duplicated block id: 1922
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (191:196)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (273:278)

duplicated block id: 1923
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (586:591)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (616:621)

duplicated block id: 1924
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (283:288)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (349:354)

duplicated block id: 1925
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (96:101)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (771:776)

duplicated block id: 1926
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (823:828)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (833:838)

duplicated block id: 1927
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (586:591)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (671:676)

duplicated block id: 1928
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (374:379)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (906:911)

duplicated block id: 1929
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (343:348)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (374:379)

duplicated block id: 1930
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (123:132)
 - python/dataproc_templates/kafka/kafka_to_gcs.py (84:95)

duplicated block id: 1931
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (135:140)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (349:354)

duplicated block id: 1932
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (586:591)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (642:647)

duplicated block id: 1933
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_mongo.py (100:109)
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (143:152)

duplicated block id: 1934
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (819:824)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (827:832)

duplicated block id: 1935
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_bigtable.py (168:178)
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (172:182)

duplicated block id: 1936
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (500:505)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1014:1019)

duplicated block id: 1937
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_mongo.py (100:109)
 - python/dataproc_templates/gcs/text_to_bigquery.py (104:113)

duplicated block id: 1938
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (364:369)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (385:390)

duplicated block id: 1939
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (434:439)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (523:528)

duplicated block id: 1940
size: 6 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_parameterize_script.py (99:108)
 - notebooks/oracle2postgres/OracleToPostgres_parameterize_script.py (140:148)

duplicated block id: 1941
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (96:101)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (713:718)

duplicated block id: 1942
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (519:524)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (859:864)

duplicated block id: 1943
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_mongo.py (100:109)
 - python/dataproc_templates/mongo/mongo_to_bq.py (97:106)

duplicated block id: 1944
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (110:119)
 - python/dataproc_templates/hive/util/hive_ddl_extractor.py (64:78)

duplicated block id: 1945
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (110:119)
 - python/dataproc_templates/gcs/gcs_to_bigtable.py (92:101)

duplicated block id: 1946
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (110:119)
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (143:152)

duplicated block id: 1947
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (117:122)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (299:304)

duplicated block id: 1948
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (260:265)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (303:308)

duplicated block id: 1949
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (505:510)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (665:670)

duplicated block id: 1950
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1014:1019)

duplicated block id: 1951
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (771:776)

duplicated block id: 1952
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_mongo.py (100:109)
 - python/dataproc_templates/kafka/kafka_to_gcs.py (84:95)

duplicated block id: 1953
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (302:307)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (352:357)

duplicated block id: 1954
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (423:428)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (458:463)

duplicated block id: 1955
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (66:71)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (167:172)

duplicated block id: 1956
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (906:911)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (889:894)

duplicated block id: 1957
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (713:718)

duplicated block id: 1958
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (117:122)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (213:218)

duplicated block id: 1959
size: 6 cleaned lines of code
in 2 files:
 - notebooks/util/jdbc/engines/mysql_input_manager.py (117:129)
 - notebooks/util/jdbc/engines/mysql_input_manager.py (179:190)

duplicated block id: 1960
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (693:698)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (670:675)

duplicated block id: 1961
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (315:320)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (642:647)

duplicated block id: 1962
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (315:320)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (616:621)

duplicated block id: 1963
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (66:71)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (135:140)

duplicated block id: 1964
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (262:267)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (331:336)

duplicated block id: 1965
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (215:220)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (771:776)

duplicated block id: 1966
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hive/util/hive_ddl_extractor.py (64:78)
 - python/dataproc_templates/pubsublite/pubsublite_to_gcs.py (94:103)

duplicated block id: 1967
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (315:320)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (558:563)

duplicated block id: 1968
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (416:421)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (586:591)

duplicated block id: 1969
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (349:354)

duplicated block id: 1970
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (303:308)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (258:263)

duplicated block id: 1971
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (299:304)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (586:591)

duplicated block id: 1972
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (283:288)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (213:218)

duplicated block id: 1973
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (117:122)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1014:1019)

duplicated block id: 1974
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/jdbc/jdbc_to_gcs.py (105:110)
 - python/dataproc_templates/jdbc/jdbc_to_jdbc.py (97:102)

duplicated block id: 1975
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigtable.py (92:101)
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (143:152)

duplicated block id: 1976
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (416:421)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (558:563)

duplicated block id: 1977
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (315:320)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (586:591)

duplicated block id: 1978
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (416:421)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (500:505)

duplicated block id: 1979
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (906:911)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (973:978)

duplicated block id: 1980
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (299:304)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (500:505)

duplicated block id: 1981
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (299:304)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (558:563)

duplicated block id: 1982
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (336:341)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (589:594)

duplicated block id: 1983
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (215:220)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (713:718)

duplicated block id: 1984
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (404:409)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (586:591)

duplicated block id: 1985
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (848:853)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (780:785)

duplicated block id: 1986
size: 6 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (927:932)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (898:903)

duplicated block id: 1987
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/text_to_bigquery.py (104:113)
 - python/dataproc_templates/kafka/kafka_to_gcs.py (84:95)

duplicated block id: 1988
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (404:409)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (558:563)

duplicated block id: 1989
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (671:676)

duplicated block id: 1990
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (642:647)

duplicated block id: 1991
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (379:384)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (494:499)

duplicated block id: 1992
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (549:554)
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (927:932)

duplicated block id: 1993
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (404:409)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (500:505)

duplicated block id: 1994
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (616:621)

duplicated block id: 1995
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (332:337)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (426:431)

duplicated block id: 1996
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (313:318)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (366:371)

duplicated block id: 1997
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (135:140)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (558:563)

duplicated block id: 1998
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (283:288)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (299:304)

duplicated block id: 1999
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (117:122)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (167:172)

duplicated block id: 2000
size: 6 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (927:932)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (914:919)

duplicated block id: 2001
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (299:304)

duplicated block id: 2002
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (329:334)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (385:390)

duplicated block id: 2003
size: 6 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (897:902)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (943:948)

duplicated block id: 2004
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (94:103)
 - python/dataproc_templates/kafka/kafka_to_bq.py (77:86)

duplicated block id: 2005
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (135:140)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (500:505)

duplicated block id: 2006
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (315:320)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (500:505)

duplicated block id: 2007
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (117:122)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (135:140)

duplicated block id: 2008
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (283:288)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (586:591)

duplicated block id: 2009
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (404:409)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (450:455)

duplicated block id: 2010
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (374:379)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (713:718)

duplicated block id: 2011
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (117:122)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (66:71)

duplicated block id: 2012
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (772:777)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (884:889)

duplicated block id: 2013
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (404:409)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (416:421)

duplicated block id: 2014
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (262:267)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (315:320)

duplicated block id: 2015
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (519:524)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (884:889)

duplicated block id: 2016
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (906:911)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (914:919)

duplicated block id: 2017
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/kafka/kafka_to_bq.py (77:86)
 - python/dataproc_templates/mongo/mongo_to_bq.py (97:106)

duplicated block id: 2018
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (117:122)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (94:99)

duplicated block id: 2019
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (283:288)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (558:563)

duplicated block id: 2020
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (671:676)

duplicated block id: 2021
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (135:140)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (586:591)

duplicated block id: 2022
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (416:421)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (671:676)

duplicated block id: 2023
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (32:37)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (315:320)

duplicated block id: 2024
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (416:421)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (616:621)

duplicated block id: 2025
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (283:288)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (500:505)

duplicated block id: 2026
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (299:304)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (642:647)

duplicated block id: 2027
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (32:37)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (343:348)

duplicated block id: 2028
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (94:99)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (906:911)

duplicated block id: 2029
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (321:326)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (385:390)

duplicated block id: 2030
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (404:409)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (167:172)

duplicated block id: 2031
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (299:304)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (616:621)

duplicated block id: 2032
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (96:101)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (906:911)

duplicated block id: 2033
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (416:421)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (642:647)

duplicated block id: 2034
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (642:647)

duplicated block id: 2035
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (32:37)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (374:379)

duplicated block id: 2036
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (616:621)

duplicated block id: 2037
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/kafka/kafka_to_gcs.py (84:95)
 - python/dataproc_templates/s3/s3_to_bigquery.py (109:118)

duplicated block id: 2038
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (117:122)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (32:37)

duplicated block id: 2039
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (299:304)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (671:676)

duplicated block id: 2040
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (559:564)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (779:784)

duplicated block id: 2041
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (135:140)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (616:621)

duplicated block id: 2042
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (404:409)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (213:218)

duplicated block id: 2043
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (123:132)
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (107:115)

duplicated block id: 2044
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (642:647)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (906:911)

duplicated block id: 2045
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (426:431)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (452:457)

duplicated block id: 2046
size: 6 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (288:293)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (364:369)

duplicated block id: 2047
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (135:140)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (671:676)

duplicated block id: 2048
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_parameterize_script.py (140:148)
 - notebooks/postgresql2bq/PostgreSqlToBigQuery_parameterize_script.py (114:122)

duplicated block id: 2049
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (298:303)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (359:364)

duplicated block id: 2050
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (374:379)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (771:776)

duplicated block id: 2051
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/text_to_bigquery.py (104:113)
 - python/dataproc_templates/kafka/kafka_to_bq.py (77:86)

duplicated block id: 2052
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (135:140)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (642:647)

duplicated block id: 2053
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (671:676)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1014:1019)

duplicated block id: 2054
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (838:843)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1066:1071)

duplicated block id: 2055
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (906:911)

duplicated block id: 2056
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_mongo.py (100:109)
 - python/dataproc_templates/kafka/kafka_to_bq.py (77:86)

duplicated block id: 2057
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (586:591)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (713:718)

duplicated block id: 2058
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (32:37)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (404:409)

duplicated block id: 2059
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (32:37)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (416:421)

duplicated block id: 2060
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (416:421)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (771:776)

duplicated block id: 2061
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (713:718)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1014:1019)

duplicated block id: 2062
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (586:591)

duplicated block id: 2063
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (586:591)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (771:776)

duplicated block id: 2064
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (558:563)

duplicated block id: 2065
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (315:320)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (349:354)

duplicated block id: 2066
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_bq.py (165:175)
 - python/dataproc_templates/elasticsearch/elasticsearch_to_gcs.py (172:182)

duplicated block id: 2067
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (32:37)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (450:455)

duplicated block id: 2068
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (303:308)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (331:336)

duplicated block id: 2069
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (299:304)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (771:776)

duplicated block id: 2070
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (76:81)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (96:101)

duplicated block id: 2071
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (404:409)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (299:304)

duplicated block id: 2072
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (424:429)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (703:708)

duplicated block id: 2073
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (215:220)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (906:911)

duplicated block id: 2074
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (559:564)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (583:588)

duplicated block id: 2075
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (500:505)

duplicated block id: 2076
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (416:421)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (713:718)

duplicated block id: 2077
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (416:421)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1014:1019)

duplicated block id: 2078
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (385:390)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (328:333)

duplicated block id: 2079
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (404:409)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (349:354)

duplicated block id: 2080
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (107:115)
 - python/dataproc_templates/kafka/kafka_to_gcs.py (84:95)

duplicated block id: 2081
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (167:172)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1014:1019)

duplicated block id: 2082
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (135:140)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (713:718)

duplicated block id: 2083
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (423:428)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (453:458)

duplicated block id: 2084
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (123:132)
 - python/dataproc_templates/gcs/gcs_to_bigtable.py (92:101)

duplicated block id: 2085
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (299:304)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (713:718)

duplicated block id: 2086
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (450:455)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (66:71)

duplicated block id: 2087
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (495:500)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (141:146)

duplicated block id: 2088
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (146:151)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (906:911)

duplicated block id: 2089
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/mongo/mongo_to_bq.py (97:106)
 - python/dataproc_templates/pubsublite/pubsublite_to_gcs.py (94:103)

duplicated block id: 2090
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (283:288)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1014:1019)

duplicated block id: 2091
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (94:103)
 - python/dataproc_templates/pubsublite/pubsublite_to_gcs.py (94:103)

duplicated block id: 2092
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hive/util/hive_ddl_extractor.py (64:78)
 - python/dataproc_templates/mongo/mongo_to_bq.py (97:106)

duplicated block id: 2093
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (450:455)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (32:37)

duplicated block id: 2094
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (480:485)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (583:588)

duplicated block id: 2095
size: 6 cleaned lines of code
in 2 files:
 - notebooks/util/jdbc/engines/oracle_input_manager.py (85:90)
 - notebooks/util/jdbc/engines/oracle_input_manager.py (103:108)

duplicated block id: 2096
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (450:455)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (94:99)

duplicated block id: 2097
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (117:122)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (349:354)

duplicated block id: 2098
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (558:563)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1014:1019)

duplicated block id: 2099
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (107:115)
 - python/dataproc_templates/mongo/mongo_to_bq.py (97:106)

duplicated block id: 2100
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (135:140)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (771:776)

duplicated block id: 2101
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (317:322)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (292:297)

duplicated block id: 2102
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigtable.py (92:101)
 - python/dataproc_templates/s3/s3_to_bigquery.py (109:118)

duplicated block id: 2103
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (771:776)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (906:911)

duplicated block id: 2104
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (315:320)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (343:348)

duplicated block id: 2105
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (178:183)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (906:911)

duplicated block id: 2106
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hive/util/hive_ddl_extractor.py (64:78)
 - python/dataproc_templates/s3/s3_to_bigquery.py (109:118)

duplicated block id: 2107
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (499:504)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (489:494)

duplicated block id: 2108
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (374:379)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1014:1019)

duplicated block id: 2109
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (167:172)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (906:911)

duplicated block id: 2110
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (686:691)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (679:684)

duplicated block id: 2111
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (343:348)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (349:354)

duplicated block id: 2112
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (434:439)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (541:546)

duplicated block id: 2113
size: 6 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/gcs/GCSToJDBCConfig.java (100:109)
 - java/src/main/java/com/google/cloud/dataproc/templates/gcs/GCSToSpannerConfig.java (91:100)

duplicated block id: 2114
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (416:421)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (450:455)

duplicated block id: 2115
size: 6 cleaned lines of code
in 2 files:
 - notebooks/util/jdbc/engines/mysql_input_manager.py (167:172)
 - notebooks/util/jdbc/jdbc_input_manager_interface.py (205:210)

duplicated block id: 2116
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (66:71)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1014:1019)

duplicated block id: 2117
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (315:320)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (374:379)

duplicated block id: 2118
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (200:205)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (158:163)

duplicated block id: 2119
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (76:81)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (283:288)

duplicated block id: 2120
size: 6 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_parameterize_script.py (99:108)
 - notebooks/postgresql2bq/PostgreSqlToBigQuery_parameterize_script.py (114:122)

duplicated block id: 2121
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (349:354)

duplicated block id: 2122
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (213:218)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (500:505)

duplicated block id: 2123
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (178:183)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (404:409)

duplicated block id: 2124
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (178:183)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (416:421)

duplicated block id: 2125
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (263:268)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (352:357)

duplicated block id: 2126
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (76:81)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (215:220)

duplicated block id: 2127
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (214:219)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (196:201)

duplicated block id: 2128
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (178:183)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (450:455)

duplicated block id: 2129
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigtable.py (92:101)
 - python/dataproc_templates/kafka/kafka_to_gcs.py (84:95)

duplicated block id: 2130
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (374:379)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (586:591)

duplicated block id: 2131
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (515:520)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (558:563)

duplicated block id: 2132
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (263:268)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (364:369)

duplicated block id: 2133
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/pubsublite/pubsublite_to_gcs.py (94:103)
 - python/dataproc_templates/s3/s3_to_bigquery.py (109:118)

duplicated block id: 2134
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (94:99)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (713:718)

duplicated block id: 2135
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (442:447)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (541:546)

duplicated block id: 2136
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (458:463)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (551:556)

duplicated block id: 2137
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (500:505)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (616:621)

duplicated block id: 2138
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (374:379)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (558:563)

duplicated block id: 2139
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (110:119)
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (94:103)

duplicated block id: 2140
size: 6 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (927:932)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (889:894)

duplicated block id: 2141
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (107:115)
 - python/dataproc_templates/gcs/gcs_to_mongo.py (100:109)

duplicated block id: 2142
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (500:505)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (642:647)

duplicated block id: 2143
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (500:505)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (671:676)

duplicated block id: 2144
size: 6 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (288:293)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (352:357)

duplicated block id: 2145
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (374:379)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (500:505)

duplicated block id: 2146
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (94:99)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (771:776)

duplicated block id: 2147
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (107:115)
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (143:152)

duplicated block id: 2148
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (586:591)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1014:1019)

duplicated block id: 2149
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (315:320)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (450:455)

duplicated block id: 2150
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_mongo.py (100:109)
 - python/dataproc_templates/pubsublite/pubsublite_to_gcs.py (94:103)

duplicated block id: 2151
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (642:647)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1014:1019)

duplicated block id: 2152
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (107:115)
 - python/dataproc_templates/hive/util/hive_ddl_extractor.py (64:78)

duplicated block id: 2153
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (1:6)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1:6)

duplicated block id: 2154
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (793:798)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1008:1013)

duplicated block id: 2155
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (549:554)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1134:1139)

duplicated block id: 2156
size: 6 cleaned lines of code
in 2 files:
 - notebooks/util/jdbc/engines/mysql_input_manager.py (112:117)
 - notebooks/util/jdbc/jdbc_input_manager_interface.py (69:74)

duplicated block id: 2157
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (315:320)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (404:409)

duplicated block id: 2158
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (315:320)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (416:421)

duplicated block id: 2159
size: 6 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (927:932)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (876:881)

duplicated block id: 2160
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (771:776)

duplicated block id: 2161
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (515:520)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (535:540)

duplicated block id: 2162
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (586:591)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (906:911)

duplicated block id: 2163
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (299:304)

duplicated block id: 2164
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (76:81)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (178:183)

duplicated block id: 2165
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (549:554)
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (906:911)

duplicated block id: 2166
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (713:718)

duplicated block id: 2167
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (76:81)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (146:151)

duplicated block id: 2168
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (200:205)
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (153:158)

duplicated block id: 2169
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (76:81)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (117:122)

duplicated block id: 2170
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (343:348)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (500:505)

duplicated block id: 2171
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (416:421)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (906:911)

duplicated block id: 2172
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (213:218)

duplicated block id: 2173
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (299:304)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (906:911)

duplicated block id: 2174
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (906:911)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1014:1019)

duplicated block id: 2175
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (404:409)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (135:140)

duplicated block id: 2176
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hive/util/hive_ddl_extractor.py (64:78)
 - python/dataproc_templates/kafka/kafka_to_bq.py (77:86)

duplicated block id: 2177
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (213:218)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (349:354)

duplicated block id: 2178
size: 6 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (310:315)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (464:469)

duplicated block id: 2179
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (110:119)
 - python/dataproc_templates/kafka/kafka_to_bq.py (77:86)

duplicated block id: 2180
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (500:505)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (713:718)

duplicated block id: 2181
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (315:320)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (906:911)

duplicated block id: 2182
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (374:379)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (671:676)

duplicated block id: 2183
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (500:505)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (771:776)

duplicated block id: 2184
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (374:379)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (642:647)

duplicated block id: 2185
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (215:220)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (349:354)

duplicated block id: 2186
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (495:500)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (677:682)

duplicated block id: 2187
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (143:152)
 - python/dataproc_templates/kafka/kafka_to_gcs.py (84:95)

duplicated block id: 2188
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (76:81)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (906:911)

duplicated block id: 2189
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (450:455)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (906:911)

duplicated block id: 2190
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/elasticsearch/elasticsearch_to_bigtable.py (168:178)
 - python/dataproc_templates/elasticsearch/elasticsearch_to_bq.py (165:175)

duplicated block id: 2191
size: 6 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (730:735)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (639:644)

duplicated block id: 2192
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (143:152)
 - python/dataproc_templates/kafka/kafka_to_bq.py (77:86)

duplicated block id: 2193
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (374:379)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (616:621)

duplicated block id: 2194
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (178:183)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (66:71)

duplicated block id: 2195
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (215:220)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (642:647)

duplicated block id: 2196
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (349:354)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (671:676)

duplicated block id: 2197
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (167:172)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (713:718)

duplicated block id: 2198
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (343:348)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (167:172)

duplicated block id: 2199
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (110:119)
 - python/dataproc_templates/s3/s3_to_bigquery.py (109:118)

duplicated block id: 2200
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (583:588)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (779:784)

duplicated block id: 2201
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (135:140)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (167:172)

duplicated block id: 2202
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (349:354)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (616:621)

duplicated block id: 2203
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (178:183)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (94:99)

duplicated block id: 2204
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (215:220)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (671:676)

duplicated block id: 2205
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (349:354)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (642:647)

duplicated block id: 2206
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (117:122)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (215:220)

duplicated block id: 2207
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (616:621)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (771:776)

duplicated block id: 2208
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (107:115)
 - python/dataproc_templates/kafka/kafka_to_bq.py (77:86)

duplicated block id: 2209
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (215:220)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (616:621)

duplicated block id: 2210
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (315:320)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (258:263)

duplicated block id: 2211
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (178:183)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (32:37)

duplicated block id: 2212
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (343:348)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (135:140)

duplicated block id: 2213
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (117:122)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (283:288)

duplicated block id: 2214
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (442:447)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (462:467)

duplicated block id: 2215
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (586:591)

duplicated block id: 2216
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (616:621)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (713:718)

duplicated block id: 2217
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (374:379)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (299:304)

duplicated block id: 2218
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (110:119)
 - python/dataproc_templates/mongo/mongo_to_bq.py (97:106)

duplicated block id: 2219
size: 6 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (338:343)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (483:488)

duplicated block id: 2220
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (117:122)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (178:183)

duplicated block id: 2221
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigtable.py (92:101)
 - python/dataproc_templates/kafka/kafka_to_bq.py (77:86)

duplicated block id: 2222
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (94:99)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (500:505)

duplicated block id: 2223
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (123:132)
 - python/dataproc_templates/hive/util/hive_ddl_extractor.py (64:78)

duplicated block id: 2224
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (558:563)

duplicated block id: 2225
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (374:379)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (349:354)

duplicated block id: 2226
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (500:505)

duplicated block id: 2227
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (504:509)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (520:525)

duplicated block id: 2228
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (616:621)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (671:676)

duplicated block id: 2229
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (898:903)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1134:1139)

duplicated block id: 2230
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (135:140)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (213:218)

duplicated block id: 2231
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (178:183)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (771:776)

duplicated block id: 2232
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (167:172)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (771:776)

duplicated block id: 2233
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (94:99)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (586:591)

duplicated block id: 2234
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (343:348)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (94:99)

duplicated block id: 2235
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (283:288)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (167:172)

duplicated block id: 2236
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (343:348)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (66:71)

duplicated block id: 2237
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (213:218)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (299:304)

duplicated block id: 2238
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (94:99)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (558:563)

duplicated block id: 2239
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (343:348)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (32:37)

duplicated block id: 2240
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (283:288)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (135:140)

duplicated block id: 2241
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (178:183)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (713:718)

duplicated block id: 2242
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (135:140)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (299:304)

duplicated block id: 2243
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (374:379)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (32:37)

duplicated block id: 2244
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (787:792)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (848:853)

duplicated block id: 2245
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (343:348)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (299:304)

duplicated block id: 2246
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (315:320)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (771:776)

duplicated block id: 2247
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (450:455)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (713:718)

duplicated block id: 2248
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (349:354)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (558:563)

duplicated block id: 2249
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (215:220)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (500:505)

duplicated block id: 2250
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (450:455)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (771:776)

duplicated block id: 2251
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (76:81)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (771:776)

duplicated block id: 2252
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (94:99)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1014:1019)

duplicated block id: 2253
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (349:354)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (500:505)

duplicated block id: 2254
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (215:220)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (558:563)

duplicated block id: 2255
size: 6 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (927:932)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (973:978)

duplicated block id: 2256
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (343:348)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (213:218)

duplicated block id: 2257
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (616:621)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (642:647)

duplicated block id: 2258
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (374:379)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (94:99)

duplicated block id: 2259
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (153:158)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (214:219)

duplicated block id: 2260
size: 6 cleaned lines of code
in 2 files:
 - notebooks/util/jdbc/engines/oracle_input_manager.py (121:126)
 - notebooks/util/jdbc/jdbc_input_manager_interface.py (69:74)

duplicated block id: 2261
size: 6 cleaned lines of code
in 2 files:
 - notebooks/util/jdbc/engines/mysql_input_manager.py (78:83)
 - notebooks/util/jdbc/engines/oracle_input_manager.py (103:108)

duplicated block id: 2262
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (374:379)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (66:71)

duplicated block id: 2263
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hive/util/hive_ddl_extractor.py (64:78)
 - python/dataproc_templates/kafka/kafka_to_gcs.py (84:95)

duplicated block id: 2264
size: 6 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/kafka/KafkaToGCS.java (125:130)
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsublite/PubSubLiteToBigTable.java (158:163)

duplicated block id: 2265
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (117:122)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (146:151)

duplicated block id: 2266
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (500:505)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (906:911)

duplicated block id: 2267
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (94:99)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (616:621)

duplicated block id: 2268
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (616:621)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1014:1019)

duplicated block id: 2269
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (215:220)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (32:37)

duplicated block id: 2270
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (158:163)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (214:219)

duplicated block id: 2271
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (94:103)
 - python/dataproc_templates/mongo/mongo_to_bq.py (97:106)

duplicated block id: 2272
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (906:911)

duplicated block id: 2273
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (96:101)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1014:1019)

duplicated block id: 2274
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigtable.py (92:101)
 - python/dataproc_templates/pubsublite/pubsublite_to_gcs.py (94:103)

duplicated block id: 2275
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_mongo.py (100:109)
 - python/dataproc_templates/s3/s3_to_bigquery.py (109:118)

duplicated block id: 2276
size: 6 cleaned lines of code
in 2 files:
 - notebooks/util/jdbc/engines/mysql_input_manager.py (167:172)
 - notebooks/util/jdbc/jdbc_input_manager_interface.py (190:195)

duplicated block id: 2277
size: 6 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/bigquery/BigQueryToJDBC.java (67:76)
 - java/src/main/java/com/google/cloud/dataproc/templates/jdbc/JDBCToSpanner.java (67:76)

duplicated block id: 2278
size: 6 cleaned lines of code
in 2 files:
 - notebooks/util/jdbc/engines/mysql_input_manager.py (167:172)
 - notebooks/util/jdbc/jdbc_input_manager_interface.py (175:180)

duplicated block id: 2279
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (315:320)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (713:718)

duplicated block id: 2280
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (343:348)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (450:455)

duplicated block id: 2281
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (167:172)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (642:647)

duplicated block id: 2282
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (434:439)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (462:467)

duplicated block id: 2283
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigtable.py (92:101)
 - python/dataproc_templates/gcs/gcs_to_mongo.py (100:109)

duplicated block id: 2284
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (215:220)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (586:591)

duplicated block id: 2285
size: 6 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (897:902)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (884:889)

duplicated block id: 2286
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (76:81)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (713:718)

duplicated block id: 2287
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (215:220)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (94:99)

duplicated block id: 2288
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (167:172)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (671:676)

duplicated block id: 2289
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (167:172)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (616:621)

duplicated block id: 2290
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (94:99)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (642:647)

duplicated block id: 2291
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (215:220)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (66:71)

duplicated block id: 2292
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (349:354)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (586:591)

duplicated block id: 2293
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (343:348)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (404:409)

duplicated block id: 2294
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (480:485)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (141:146)

duplicated block id: 2295
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (714:719)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (913:918)

duplicated block id: 2296
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (343:348)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (416:421)

duplicated block id: 2297
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (750:755)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (836:841)

duplicated block id: 2298
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (94:99)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (671:676)

duplicated block id: 2299
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (143:152)
 - python/dataproc_templates/mongo/mongo_to_bq.py (97:106)

duplicated block id: 2300
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (450:455)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (616:621)

duplicated block id: 2301
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (96:101)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (404:409)

duplicated block id: 2302
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (146:151)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (404:409)

duplicated block id: 2303
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (94:99)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (299:304)

duplicated block id: 2304
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (679:684)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (697:702)

duplicated block id: 2305
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (96:101)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (416:421)

duplicated block id: 2306
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (76:81)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (671:676)

duplicated block id: 2307
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (343:348)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (451:456)

duplicated block id: 2308
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (616:621)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (906:911)

duplicated block id: 2309
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (117:122)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (416:421)

duplicated block id: 2310
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (146:151)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (349:354)

duplicated block id: 2311
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (315:320)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1014:1019)

duplicated block id: 2312
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (117:122)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (404:409)

duplicated block id: 2313
size: 6 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/databases/SpannerToGCSConfig.java (81:87)
 - java/src/main/java/com/google/cloud/dataproc/templates/gcs/GCSToSpannerConfig.java (83:89)

duplicated block id: 2314
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/text_to_bigquery.py (104:113)
 - python/dataproc_templates/s3/s3_to_bigquery.py (109:118)

duplicated block id: 2315
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (213:218)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (906:911)

duplicated block id: 2316
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (450:455)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (642:647)

duplicated block id: 2317
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (94:103)
 - python/dataproc_templates/gcs/gcs_to_bigtable.py (92:101)

duplicated block id: 2318
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (76:81)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (642:647)

duplicated block id: 2319
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (117:122)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (450:455)

duplicated block id: 2320
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (450:455)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (671:676)

duplicated block id: 2321
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (178:183)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (155:160)

duplicated block id: 2322
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1014:1019)

duplicated block id: 2323
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (94:103)
 - python/dataproc_templates/gcs/gcs_to_mongo.py (100:109)

duplicated block id: 2324
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (66:71)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (906:911)

duplicated block id: 2325
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (713:718)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (771:776)

duplicated block id: 2326
size: 6 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_parameterize_script.py (99:108)
 - notebooks/oracle2bq/OracleToBigQuery_parameterize_script.py (123:133)

duplicated block id: 2327
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (96:101)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (450:455)

duplicated block id: 2328
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (178:183)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (586:591)

duplicated block id: 2329
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (127:132)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (779:784)

duplicated block id: 2330
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigtable.py (92:101)
 - python/dataproc_templates/mongo/mongo_to_bq.py (97:106)

duplicated block id: 2331
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (374:379)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (135:140)

duplicated block id: 2332
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (558:563)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (586:591)

duplicated block id: 2333
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (110:119)
 - python/dataproc_templates/kafka/kafka_to_gcs.py (84:95)

duplicated block id: 2334
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_gcs.py (109:116)
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (148:155)

duplicated block id: 2335
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (107:115)
 - python/dataproc_templates/s3/s3_to_bigquery.py (109:118)

duplicated block id: 2336
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (167:172)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (586:591)

duplicated block id: 2337
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (178:183)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (558:563)

duplicated block id: 2338
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (76:81)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (616:621)

duplicated block id: 2339
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (167:172)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (558:563)

duplicated block id: 2340
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (94:99)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (349:354)

duplicated block id: 2341
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (178:183)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (500:505)

duplicated block id: 2342
size: 6 cleaned lines of code
in 2 files:
 - notebooks/util/jdbc/engines/mysql_input_manager.py (130:135)
 - notebooks/util/jdbc/jdbc_input_manager_interface.py (175:180)

duplicated block id: 2343
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/text_to_bigquery.py (104:113)
 - python/dataproc_templates/pubsublite/pubsublite_to_gcs.py (94:103)

duplicated block id: 2344
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (215:220)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (283:288)

duplicated block id: 2345
size: 6 cleaned lines of code
in 2 files:
 - notebooks/util/jdbc/engines/mysql_input_manager.py (130:135)
 - notebooks/util/jdbc/jdbc_input_manager_interface.py (190:195)

duplicated block id: 2346
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (107:115)
 - python/dataproc_templates/pubsublite/pubsublite_to_gcs.py (94:103)

duplicated block id: 2347
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (914:919)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1134:1139)

duplicated block id: 2348
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hive/hive_to_bigquery.py (98:104)
 - python/dataproc_templates/jdbc/jdbc_to_jdbc.py (179:185)

duplicated block id: 2349
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (146:151)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (450:455)

duplicated block id: 2350
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_parameterize_script.py (122:131)
 - notebooks/oracle2bq/OracleToBigQuery_parameterize_script.py (123:133)

duplicated block id: 2351
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (146:151)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (416:421)

duplicated block id: 2352
size: 6 cleaned lines of code
in 2 files:
 - notebooks/util/jdbc/engines/mysql_input_manager.py (130:135)
 - notebooks/util/jdbc/jdbc_input_manager_interface.py (205:210)

duplicated block id: 2353
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (167:172)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (500:505)

duplicated block id: 2354
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (349:354)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (771:776)

duplicated block id: 2355
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (442:447)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (523:528)

duplicated block id: 2356
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (670:675)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (884:889)

duplicated block id: 2357
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (141:146)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (779:784)

duplicated block id: 2358
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (450:455)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (500:505)

duplicated block id: 2359
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (76:81)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (586:591)

duplicated block id: 2360
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (76:81)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (558:563)

duplicated block id: 2361
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (515:520)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (504:509)

duplicated block id: 2362
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (519:524)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1104:1109)

duplicated block id: 2363
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (146:151)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (213:218)

duplicated block id: 2364
size: 6 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/kafka/KafkaToGCS.java (125:130)
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsub/PubSubToGCS.java (125:130)

duplicated block id: 2365
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigtable.py (92:101)
 - python/dataproc_templates/hive/util/hive_ddl_extractor.py (64:78)

duplicated block id: 2366
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (117:122)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (315:320)

duplicated block id: 2367
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (117:122)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (343:348)

duplicated block id: 2368
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (450:455)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (586:591)

duplicated block id: 2369
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (450:455)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (558:563)

duplicated block id: 2370
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (117:122)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (906:911)

duplicated block id: 2371
size: 6 cleaned lines of code
in 2 files:
 - notebooks/util/jdbc/jdbc_input_manager_interface.py (190:195)
 - notebooks/util/jdbc/jdbc_input_manager_interface.py (205:210)

duplicated block id: 2372
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (96:101)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (374:379)

duplicated block id: 2373
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (349:354)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (713:718)

duplicated block id: 2374
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (96:101)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (315:320)

duplicated block id: 2375
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (117:122)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (374:379)

duplicated block id: 2376
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (558:563)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (679:684)

duplicated block id: 2377
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/text_to_bigquery.py (104:113)
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (143:152)

duplicated block id: 2378
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (146:151)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (299:304)

duplicated block id: 2379
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (374:379)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (167:172)

duplicated block id: 2380
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (127:132)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (583:588)

duplicated block id: 2381
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/kafka/kafka_to_bq.py (107:113)
 - python/dataproc_templates/kafka/kafka_to_gcs.py (115:121)

duplicated block id: 2382
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (480:485)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (677:682)

duplicated block id: 2383
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (96:101)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (343:348)

duplicated block id: 2384
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (213:218)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (771:776)

duplicated block id: 2385
size: 6 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (897:902)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (859:864)

duplicated block id: 2386
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (153:158)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (200:205)

duplicated block id: 2387
size: 6 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/kafka/KafkaToBQDstream.java (190:195)
 - java/src/main/java/com/google/cloud/dataproc/templates/kafka/KafkaToGCS.java (136:141)

duplicated block id: 2388
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (200:205)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (214:219)

duplicated block id: 2389
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (352:357)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (385:390)

duplicated block id: 2390
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (178:183)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (671:676)

duplicated block id: 2391
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (374:379)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (213:218)

duplicated block id: 2392
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (178:183)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (642:647)

duplicated block id: 2393
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (343:348)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (906:911)

duplicated block id: 2394
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (76:81)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (500:505)

duplicated block id: 2395
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (146:151)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (374:379)

duplicated block id: 2396
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (146:151)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (343:348)

duplicated block id: 2397
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (146:151)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (315:320)

duplicated block id: 2398
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (495:500)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (779:784)

duplicated block id: 2399
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (178:183)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (616:621)

duplicated block id: 2400
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (260:265)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (331:336)

duplicated block id: 2401
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (200:205)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (196:201)

duplicated block id: 2402
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (146:151)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (135:140)

duplicated block id: 2403
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (215:220)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (213:218)

duplicated block id: 2404
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (66:71)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (771:776)

duplicated block id: 2405
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (450:455)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1014:1019)

duplicated block id: 2406
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (343:348)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (586:591)

duplicated block id: 2407
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (167:172)

duplicated block id: 2408
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (66:71)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (713:718)

duplicated block id: 2409
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (115:120)
 - python/dataproc_templates/jdbc/jdbc_to_jdbc.py (97:102)

duplicated block id: 2410
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (343:348)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (558:563)

duplicated block id: 2411
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (167:172)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (299:304)

duplicated block id: 2412
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/kafka/kafka_to_gcs.py (84:95)
 - python/dataproc_templates/mongo/mongo_to_bq.py (97:106)

duplicated block id: 2413
size: 6 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/kafka/KafkaToGCS.java (125:130)
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsub/PubSubToBQ.java (194:199)

duplicated block id: 2414
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (178:183)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (299:304)

duplicated block id: 2415
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (213:218)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (713:718)

duplicated block id: 2416
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (32:37)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (135:140)

duplicated block id: 2417
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (96:101)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (215:220)

duplicated block id: 2418
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (146:151)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (167:172)

duplicated block id: 2419
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (686:691)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (781:786)

duplicated block id: 2420
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (213:218)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (642:647)

duplicated block id: 2421
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/mongo/mongo_to_bq.py (97:106)
 - python/dataproc_templates/s3/s3_to_bigquery.py (109:118)

duplicated block id: 2422
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (299:304)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1014:1019)

duplicated block id: 2423
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (94:103)
 - python/dataproc_templates/gcs/text_to_bigquery.py (104:113)

duplicated block id: 2424
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_mongo.py (100:109)
 - python/dataproc_templates/hive/util/hive_ddl_extractor.py (64:78)

duplicated block id: 2425
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (343:348)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (616:621)

duplicated block id: 2426
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (76:81)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (450:455)

duplicated block id: 2427
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (213:218)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (671:676)

duplicated block id: 2428
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (178:183)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (349:354)

duplicated block id: 2429
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (66:71)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (94:99)

duplicated block id: 2430
size: 6 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/kafka/KafkaReader.java (54:59)
 - java/src/main/java/com/google/cloud/dataproc/templates/kafka/KafkaToPubSub.java (65:70)

duplicated block id: 2431
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (146:151)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (283:288)

duplicated block id: 2432
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (178:183)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (215:220)

duplicated block id: 2433
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (771:776)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1014:1019)

duplicated block id: 2434
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (404:409)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1014:1019)

duplicated block id: 2435
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/kafka/kafka_to_bq.py (77:86)
 - python/dataproc_templates/pubsublite/pubsublite_to_gcs.py (94:103)

duplicated block id: 2436
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (96:101)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (283:288)

duplicated block id: 2437
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (76:81)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (416:421)

duplicated block id: 2438
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (343:348)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (642:647)

duplicated block id: 2439
size: 6 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/util/Dataplex/DataplexEntityUtil.java (293:298)
 - java/src/main/java/com/google/cloud/dataproc/templates/util/Dataplex/DataplexEntityUtil.java (303:308)

duplicated block id: 2440
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (167:172)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (349:354)

duplicated block id: 2441
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/kafka/kafka_to_bq.py (77:86)
 - python/dataproc_templates/s3/s3_to_bigquery.py (109:118)

duplicated block id: 2442
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (110:119)
 - python/dataproc_templates/pubsublite/pubsublite_to_gcs.py (94:103)

duplicated block id: 2443
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (96:101)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (135:140)

duplicated block id: 2444
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (76:81)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (404:409)

duplicated block id: 2445
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (178:183)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (283:288)

duplicated block id: 2446
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (215:220)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (299:304)

duplicated block id: 2447
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (482:487)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (587:592)

duplicated block id: 2448
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (146:151)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (215:220)

duplicated block id: 2449
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (96:101)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (167:172)

duplicated block id: 2450
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (94:99)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (167:172)

duplicated block id: 2451
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (759:764)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (957:962)

duplicated block id: 2452
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (500:505)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (586:591)

duplicated block id: 2453
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (488:493)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (679:684)

duplicated block id: 2454
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (66:71)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (671:676)

duplicated block id: 2455
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (123:132)
 - python/dataproc_templates/kafka/kafka_to_bq.py (77:86)

duplicated block id: 2456
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/hive/util/hive_ddl_extractor.py (64:78)
 - python/dataproc_templates/jdbc/jdbc_to_bigquery.py (143:152)

duplicated block id: 2457
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (973:978)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1134:1139)

duplicated block id: 2458
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (141:146)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (583:588)

duplicated block id: 2459
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (94:99)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (135:140)

duplicated block id: 2460
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (96:101)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (213:218)

duplicated block id: 2461
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (677:682)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (141:146)

duplicated block id: 2462
size: 6 cleaned lines of code
in 2 files:
 - java/src/main/java/com/google/cloud/dataproc/templates/kafka/KafkaToGCS.java (125:130)
 - java/src/main/java/com/google/cloud/dataproc/templates/pubsub/PubSubToBigTable.java (176:181)

duplicated block id: 2463
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (66:71)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (642:647)

duplicated block id: 2464
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (141:146)
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (559:564)

duplicated block id: 2465
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (96:101)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (117:122)

duplicated block id: 2466
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (450:455)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (349:354)

duplicated block id: 2467
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (480:485)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (495:500)

duplicated block id: 2468
size: 6 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (298:303)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (434:439)

duplicated block id: 2469
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (96:101)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (146:151)

duplicated block id: 2470
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (404:409)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (66:71)

duplicated block id: 2471
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (110:119)
 - python/dataproc_templates/gcs/gcs_to_mongo.py (100:109)

duplicated block id: 2472
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (343:348)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (671:676)

duplicated block id: 2473
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (66:71)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (616:621)

duplicated block id: 2474
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (76:81)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (374:379)

duplicated block id: 2475
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (404:409)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (94:99)

duplicated block id: 2476
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (76:81)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (349:354)

duplicated block id: 2477
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (123:132)
 - python/dataproc_templates/pubsublite/pubsublite_to_gcs.py (94:103)

duplicated block id: 2478
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (349:354)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (906:911)

duplicated block id: 2479
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (783:788)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (994:999)

duplicated block id: 2480
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (213:218)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (616:621)

duplicated block id: 2481
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (450:455)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (299:304)

duplicated block id: 2482
size: 6 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (100:105)
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (427:432)

duplicated block id: 2483
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (906:911)
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (898:903)

duplicated block id: 2484
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2postgres/OracleToPostgres_notebook.ipynb (331:336)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (258:263)

duplicated block id: 2485
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (178:183)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (315:320)

duplicated block id: 2486
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (76:81)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1014:1019)

duplicated block id: 2487
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (343:348)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (713:718)

duplicated block id: 2488
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2bq/mssql-to-bigquery-notebook.ipynb (390:395)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (509:514)

duplicated block id: 2489
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (76:81)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (343:348)

duplicated block id: 2490
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (404:409)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (32:37)

duplicated block id: 2491
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (167:172)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (213:218)

duplicated block id: 2492
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (671:676)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (713:718)

duplicated block id: 2493
size: 6 cleaned lines of code
in 2 files:
 - notebooks/hive2bq/HiveToBigquery_notebook.ipynb (730:735)
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (573:578)

duplicated block id: 2494
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (76:81)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (315:320)

duplicated block id: 2495
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (213:218)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (558:563)

duplicated block id: 2496
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (343:348)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (771:776)

duplicated block id: 2497
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (178:183)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (343:348)

duplicated block id: 2498
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (146:151)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (178:183)

duplicated block id: 2499
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (96:101)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (178:183)

duplicated block id: 2500
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (213:218)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (586:591)

duplicated block id: 2501
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (504:509)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (679:684)

duplicated block id: 2502
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (215:220)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (135:140)

duplicated block id: 2503
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (178:183)
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (374:379)

duplicated block id: 2504
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (94:99)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (213:218)

duplicated block id: 2505
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (94:103)
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (107:115)

duplicated block id: 2506
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mssql2postgresql/mssql-to-postgres-notebook.ipynb (158:163)
 - notebooks/oracle2bq/OracleToBigQuery_notebook.ipynb (200:205)

duplicated block id: 2507
size: 6 cleaned lines of code
in 2 files:
 - notebooks/oracle2spanner/OracleToSpanner_notebook.ipynb (889:894)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (1134:1139)

duplicated block id: 2508
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/azure/azure_blob_storage_to_bigquery.py (110:119)
 - python/dataproc_templates/gcs/gcs_to_jdbc.py (107:115)

duplicated block id: 2509
size: 6 cleaned lines of code
in 2 files:
 - notebooks/mysql2spanner/MySqlToSpanner_notebook.ipynb (453:458)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (551:556)

duplicated block id: 2510
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (215:220)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (167:172)

duplicated block id: 2511
size: 6 cleaned lines of code
in 2 files:
 - notebooks/generic_notebook/vertex_pipeline_pyspark.ipynb (96:101)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (299:304)

duplicated block id: 2512
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (671:676)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (771:776)

duplicated block id: 2513
size: 6 cleaned lines of code
in 2 files:
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (500:505)
 - notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb (558:563)

duplicated block id: 2514
size: 6 cleaned lines of code
in 2 files:
 - python/dataproc_templates/bigquery/bigquery_to_memorystore.py (123:132)
 - python/dataproc_templates/gcs/gcs_to_bigquery.py (94:103)