An overview of contributor trends.
Committed in past 6 months (a rookie = the first commit in past year)
Past 30 days (7):
Past 31 to 90 days (3):
Past 91 to 180 days (6):
Last contributors more than 6 months ago
| Commits (3m) |
Commit Days |
-
|
8
|
8
|
8
|
3
|
2
|
7
|
8
|
11
|
4
|
1
|
-
|
1
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
|
| m1378.prz@gmail.com | 5 | 2 |
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| 42976936+mahyareb@users.noreply.github.com | 37 | 28 |
-
|
|
|
|
-
|
-
|
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| jahnaviii@google.com | 46 | 21 |
-
|
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| 90177675+jahnavi2k@users.noreply.github.com | 23 | 14 |
-
|
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| ismailmehdi@gmail.com | 1 | 16 |
-
|
|
-
|
-
|
-
|
-
|
|
|
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| dvnshgupta@google.com | 26 | 11 |
-
|
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| 76586767+dvnshgupta@users.noreply.github.com | 22 | 10 |
-
|
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| mebadi@google.com | 125 | 22 |
-
|
|
|
|
-
|
-
|
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| hardikgupta@google.com | 4 | 38 |
-
|
-
|
|
|
-
|
-
|
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| 75753836+hardikgu23@users.noreply.github.com | 4 | 28 |
-
|
-
|
|
|
-
|
-
|
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| 158031829+prernakakkar-google@users.noreply.github.com | - | 3 |
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| prernakakkar@google.com | - | 3 |
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| hailong.leon@gmail.com | - | 3 |
-
|
-
|
-
|
-
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| hailongli@google.com | - | 1 |
-
|
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| 51998522+viditchopra1500@users.noreply.github.com | - | 8 |
-
|
-
|
-
|
-
|
-
|
-
|
|
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| viditchopra@google.com | - | 10 |
-
|
-
|
-
|
-
|
-
|
-
|
|
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| yangtian@google.com | - | 3 |
-
|
-
|
-
|
-
|
-
|
-
|
-
|
|
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| mahyar@google.com | - | 1 |
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| ismailmehdi@google.com | - | 1 |
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
| Commits (3m) |
Commit Days |
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
-
|
7 contributors (44 commits):
| # | Contributor |
First Commit |
Latest Commit |
Commits Count |
File Updates (per extension) |
|---|---|---|---|---|---|
| 1. | 42976936+mahyareb@users.noreply.github.com | 2024-09-28 | 2025-04-29 | 3 (6%) | py (8), yaml (1), md (1) |
| 2. | jahnaviii@google.com | 2025-02-11 | 2025-04-28 | 16 (36%) | py (38), yaml (6), json (4), sql (4), csv (4) |
| 3. | dvnshgupta@google.com | 2025-02-13 | 2025-04-21 | 5 (11%) | ipynb (5) |
| 4. | 90177675+jahnavi2k@users.noreply.github.com | 2025-02-13 | 2025-04-28 | 12 (27%) | py (51), yaml (29), md (11), sql (5), json (3) |
| 5. | 76586767+dvnshgupta@users.noreply.github.com | 2025-02-14 | 2025-04-21 | 2 (4%) | yaml (9), py (3), md (3), ipynb (1), sh (1) |
| 6. | ismailmehdi@gmail.com | 2024-07-31 | 2025-04-22 | 1 (2%) | yaml (1) |
| 7. | m1378.prz@gmail.com | 2025-04-28 | 2025-04-29 | 5 (11%) | py (9), yaml (1), md (1) |
A contributor dependency is detected if two contributors have changed the same files in the past 30 days.
The number on lines shows the number of same files that both persons changed in past 30 days.
| Contributor 1 | Contributor 2 | # shared files | |
|---|---|---|---|
| 1. | 90177675+jahnavi2k@users.noreply.github.com | jahnaviii@google.com |
24 shared files
docs/configs/db-config.md datasets/bat/model_configs/gemini_2.5_pro_model.yaml datasets/model_configs/gemini_2.5_pro_model.yaml evalbench/databases/postgres.py evalbench/databases/__init__.py datasets/bat/setup/db_blog/bigquery/post_setup.sql evalbench/util/config.py evalbench/util/sanitizer.py datasets/bat/setup/db_blog/bigquery/pre_setup.sql evalbench/evalbench.py evalbench/work/sqlexecwork.py datasets/bat/example_run_config.yaml evalbench/databases/bigquery.py evalbench/databases/sqlite.py datasets/bat/prompts.json evalbench/reporting/bqstore.py evalbench/evaluator/db_manager.py datasets/bat/setup/db_blog/bigquery/setup.sql datasets/bat/db_configs/bigquery.yaml evalbench/generators/prompts/sqlgenbase.py evalbench/databases/mysql.py evalbench/generators/models/gemini.py evalbench/databases/sqlserver.py evalbench/databases/db.py |
| 2. | 90177675+jahnavi2k@users.noreply.github.com | 76586767+dvnshgupta@users.noreply.github.com |
17 shared files
docs/configs/db-config.md datasets/bird/README.md datasets/model_configs/gemini_2.0_flash_model.yaml datasets/bird/db_configs/sqlite.yaml datasets/model_configs/gemini_2.0_pro_model.yaml datasets/bird/download_dataset.sh datasets/model_configs/claude_3.5_model.yaml datasets/bird/example_run_config.yaml datasets/bat/example_run_config.yaml evalbench/dataset/dataset.py datasets/model_configs/gemini_1.5_flash_model.yaml evalbench/databases/sqlite.py docs/examples/GCP_CloudSQL_Example.ipynb docs/configs/run-config.md datasets/model_configs/gemini_1.5-pro-002_model.yaml datasets/model_configs/gemini_1.0_pro_model.yaml evalbench/databases/db.py |
| 3. | 42976936+mahyareb@users.noreply.github.com | m1378.prz@gmail.com |
8 shared files
docs/configs/db-config.md evalbench/evaluator/orchestrator.py datasets/bat/db_configs/alloydb.yaml evalbench/databases/alloydb.py evalbench/databases/__init__.py evalbench/generators/models/__init__.py evalbench/databases/bigquery.py evalbench/generators/models/alloydb_ai_nl.py |
| 4. | 42976936+mahyareb@users.noreply.github.com | 90177675+jahnavi2k@users.noreply.github.com |
6 shared files
docs/configs/db-config.md evalbench/evaluator/orchestrator.py evalbench/databases/__init__.py evalbench/evalbench.py evalbench/databases/bigquery.py evalbench/reporting/bqstore.py |
| 5. | 42976936+mahyareb@users.noreply.github.com | jahnaviii@google.com |
5 shared files
docs/configs/db-config.md evalbench/databases/__init__.py evalbench/evalbench.py evalbench/databases/bigquery.py evalbench/reporting/bqstore.py |
| 6. | m1378.prz@gmail.com | 90177675+jahnavi2k@users.noreply.github.com |
4 shared files
docs/configs/db-config.md evalbench/evaluator/orchestrator.py evalbench/databases/__init__.py evalbench/databases/bigquery.py |
| 7. | 76586767+dvnshgupta@users.noreply.github.com | jahnaviii@google.com |
4 shared files
docs/configs/db-config.md datasets/bat/example_run_config.yaml evalbench/databases/sqlite.py evalbench/databases/db.py |
| 8. | m1378.prz@gmail.com | jahnaviii@google.com |
3 shared files
docs/configs/db-config.md evalbench/databases/__init__.py evalbench/databases/bigquery.py |
| 9. | 42976936+mahyareb@users.noreply.github.com | 76586767+dvnshgupta@users.noreply.github.com |
1 shared file
docs/configs/db-config.md |
| 10. | m1378.prz@gmail.com | 76586767+dvnshgupta@users.noreply.github.com |
1 shared file
docs/configs/db-config.md |
| 11. | jahnaviii@google.com | ismailmehdi@gmail.com |
1 shared file
datasets/bat/example_run_config.yaml |
| 12. | 90177675+jahnavi2k@users.noreply.github.com | ismailmehdi@gmail.com |
1 shared file
datasets/bat/example_run_config.yaml |
| 13. | 76586767+dvnshgupta@users.noreply.github.com | ismailmehdi@gmail.com |
1 shared file
datasets/bat/example_run_config.yaml |
| 14. | 90177675+jahnavi2k@users.noreply.github.com | dvnshgupta@google.com |
1 shared file
docs/examples/GCP_CloudSQL_Example.ipynb |
| 15. | 76586767+dvnshgupta@users.noreply.github.com | dvnshgupta@google.com |
1 shared file
docs/examples/GCP_CloudSQL_Example.ipynb |
| Contributor | # connections | # commits | |
|---|---|---|---|
| 1. | 90177675+jahnavi2k@users.noreply.github.com | 6 | 12 |
| 2. | 76586767+dvnshgupta@users.noreply.github.com | 6 | 2 |
| 3. | jahnaviii@google.com | 5 | 16 |
| 4. | m1378.prz@gmail.com | 4 | 5 |
| 5. | 42976936+mahyareb@users.noreply.github.com | 4 | 3 |
| 6. | ismailmehdi@gmail.com | 3 | 1 |
| 7. | dvnshgupta@google.com | 2 | 5 |
C-median: 4.0
A half of the contributors has more than 4.0 connections, and a half has less than this number.
C-mean: 4.2
An average number of connections a contributor has with other contributors.
C-index: 4.0
There are 4.0 contributors with 4.0 or more connections.
10 contributors (293 commits):
| # | Contributor |
First Commit |
Latest Commit |
Commits Count |
File Updates (per extension) |
|---|---|---|---|---|---|
| 1. | mebadi@google.com | 2024-09-28 | 2025-04-03 | 125 (42%) | py (239), yaml (155), csv (38), md (31), sql (18) |
| 2. | hardikgupta@google.com | 2024-09-01 | 2025-03-21 | 4 (1%) | py (6) |
| 3. | 42976936+mahyareb@users.noreply.github.com | 2024-09-28 | 2025-04-29 | 37 (12%) | py (197), yaml (138), md (41), csv (19), sql (6) |
| 4. | jahnaviii@google.com | 2025-02-11 | 2025-04-28 | 46 (15%) | py (87), yaml (40), json (14), sql (13), md (7) |
| 5. | 75753836+hardikgu23@users.noreply.github.com | 2024-09-01 | 2025-03-21 | 4 (1%) | py (6) |
| 6. | dvnshgupta@google.com | 2025-02-13 | 2025-04-21 | 26 (8%) | py (24), ipynb (5) |
| 7. | 90177675+jahnavi2k@users.noreply.github.com | 2025-02-13 | 2025-04-28 | 23 (7%) | py (72), yaml (62), sql (23), csv (19), md (17) |
| 8. | 76586767+dvnshgupta@users.noreply.github.com | 2025-02-14 | 2025-04-21 | 22 (7%) | py (46), yaml (17), json (6), sql (6), md (3) |
| 9. | ismailmehdi@gmail.com | 2024-07-31 | 2025-04-22 | 1 (<1%) | yaml (1) |
| 10. | m1378.prz@gmail.com | 2025-04-28 | 2025-04-29 | 5 (1%) | py (9), yaml (1), md (1) |
A contributor dependency is detected if two contributors have changed the same files in the past 90 days.
The number on lines shows the number of same files that both persons changed in past 90 days.
| Contributor 1 | Contributor 2 | # shared files | |
|---|---|---|---|
| 1. | 42976936+mahyareb@users.noreply.github.com | mebadi@google.com |
132 shared files
docs/configs/db-config.md datasets/bat/db_blog/setup/mysql/setup.sql datasets/bat/db_blog/setup/data/tbl_status.csv datasets/bat/db_blog/setup/postgres/post_setup.sql evalbench/util/loghandler.py datasets/bat/db_blog/run_configs/sqlite/run_ddl.yaml datasets/bat/db_blog/run_configs/postgres/run_ddl.yaml datasets/bat/model_configs/gemini_2.0_flash_model.yaml evalbench/dataset/eval_format_verifier/eval_format_verifier.py evalbench/util/rate_limit.py evalbench/databases/postgres.py evalbench/databases/__init__.py evalbench/evalproto/eval_request.proto evalbench/databases/util.py datasets/bat/db_blog/setup/mysql/post_setup.sql evalbench/generators/prompts/mysql_dbschema.py datasets/bat/db_blog/prompts/dml.json evalbench/scorers/generatedqueryregexpmatcher.py docs/examples/sqlite_example.ipynb datasets/bat/db_blog/run_configs/sqlserver/run_ddl.yaml datasets/bat/db_blog/setup/mysql/pre_setup.sql evalbench/reporting/bqstore.py docs/configs/dataset-config.md datasets/bat/db_blog/setup/data/tbl_reports.csv datasets/bat/model_configs/gemini_1.5-pro-002_model.yaml requirements.txt evalbench/reporting/__init__.py evalbench/scorers/recallmatcher.py datasets/bat/db_blog/model_configs/base_gemini_model.yaml evalbench/generators/prompts/generator.py datasets/bat/db_blog/setup/data/tbl_user_roles.csv evalbench/work/work.py datasets/bat/db_blog/run_configs/mysql/run_dml.yaml datasets/bat/db_blog/setup/data/tbl_attachments.csv evalbench/scorers/executablesql.py datasets/bat/db_blog/db_configs/sqlserver_db_config.yaml evalbench/databases/db.py evalbench/generators/models/openai.py evalbench/evaluator/orchestrator.py datasets/bat/model_configs/gemini_2.0_pro_model.yaml docs/configs/model-config.md evalbench/scorers/util.py evalbench/dataset/util.py datasets/bat/db_blog/model_configs/gemini_1.5_flash_model.yaml datasets/bat/db_blog/run_configs/sqlserver/run_dql.yaml evalbench/util/sanitizer.py evalbench/evalbench.py datasets/bat/db_blog/run_configs/mysql/run_dql.yaml evalbench/work/sqlexecwork.py evalbench/scorers/comparator.py evalbench/repository/nldRepo.py evalbench/generators/prompts/__init__.py evalbench/test/sessionmgr_test.py evalbench/dataset/dataset.py evalbench/scorers/returnedsql.py .gitignore datasets/bat/db_blog/setup/data/tbl_posts.csv datasets/bat/db_blog/model_configs/gemini_1.5-pro-002_model.yaml datasets/bat/db_blog/setup/data/tbl_user_activity.csv evalbench/scorers/score.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/run.sh datasets/bat/db_blog/setup/data/tbl_followers.csv datasets/bat/db_blog/setup/data/tbl_labels.csv datasets/bat/db_blog/setup/data/tbl_tags_hierarchy.csv evalbench/generators/models/passthrough.py datasets/bat/db_blog/setup/data/tbl_private_messages.csv evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/dataset/eval_format_verifier/eval_format_verifier_test.py evalbench/generators/models/gemini.py evalbench/dataset/eval_format_verifier/eval_format_verifier_test_helper.py datasets/bat/db_blog/setup/data/tbl_posts_tags.csv evalbench/reporting/analyzer.py datasets/bat/db_blog/db_configs/pg_db_config.yaml datasets/bat/db_blog/run_configs/postgres/run_dml.yaml datasets/bat/db_blog/run_configs/mysql/run_ddl.yaml datasets/bat/db_blog/setup/data/tbl_country.csv evalbench/evaluator/evaluator.py datasets/bat/db_blog/run_configs/sqlserver/run_dml.yaml evalbench/util/sessionmgr.py evalbench/work/scorework.py evalbench/reporting/report.py datasets/bat/db_blog/model_configs/gemini_1.0_pro_model.yaml evalbench/eval_service.py evalbench/scorers/exactmatcher.py evalbench/databases/sqlite.py evalbench/util/gcp.py datasets/bat/db_blog/db_configs/mysql_db_config.yaml evalbench/evaluator/db_manager.py datasets/bat/db_blog/model_configs/gemini_2.0_pro_model.yaml docs/configs/run-config.md evalbench/util/service.py evalbench/reporting/csv.py datasets/bat/db_blog/run_configs/sqlite/run_dml.yaml evalbench/databases/sqlserver.py evalbench/evaluator/progress_reporter.py datasets/bat/db_blog/db_configs/sqlite_db_config.yaml evalbench/scorers/setmatcher.py datasets/bat/db_blog/setup/postgres/pre_setup.sql ... |
| 2. | 90177675+jahnavi2k@users.noreply.github.com | mebadi@google.com |
99 shared files
docs/configs/db-config.md evalbench/util/loghandler.py datasets/bat/db_blog/run_configs/sqlite/run_ddl.yaml datasets/bat/db_blog/run_configs/postgres/run_ddl.yaml datasets/bat/setup/db_blog/postgres/setup.sql datasets/bat/model_configs/gemini_2.0_flash_model.yaml evalbench/databases/postgres.py evalbench/databases/__init__.py datasets/bat/db_configs/postgres.yaml datasets/bat/setup/db_blog/sqlserver/post_setup.sql datasets/bat/setup/db_blog/data/tbl_posts.csv datasets/bat/db_blog/prompts/dml.json docs/examples/sqlite_example.ipynb datasets/bat/db_blog/run_configs/sqlserver/run_ddl.yaml evalbench/reporting/bqstore.py docs/configs/dataset-config.md datasets/bat/model_configs/gemini_1.5-pro-002_model.yaml requirements.txt datasets/bat/model_configs/claude_3.5_model.yaml datasets/bat/setup/db_blog/data/tbl_user_activity.csv datasets/bat/db_configs/sqlite.yaml datasets/bat/setup/db_blog/sqlite/setup.sql datasets/bat/db_blog/run_configs/mysql/run_dml.yaml evalbench/scorers/executablesql.py datasets/bat/db_blog/db_configs/sqlserver_db_config.yaml evalbench/databases/db.py evalbench/evaluator/orchestrator.py datasets/bat/model_configs/gemini_2.0_pro_model.yaml docs/configs/model-config.md datasets/bat/setup/db_blog/sqlserver/setup.sql datasets/bat/setup/db_blog/data/tbl_tags.csv datasets/bat/db_blog/model_configs/gemini_1.5_flash_model.yaml datasets/bat/db_blog/run_configs/sqlserver/run_dql.yaml evalbench/util/sanitizer.py evalbench/evalbench.py datasets/bat/db_blog/run_configs/mysql/run_dql.yaml evalbench/work/sqlexecwork.py evalbench/generators/prompts/__init__.py datasets/bat/setup/db_blog/postgres/pre_setup.sql evalbench/dataset/dataset.py datasets/bat/prompts.json datasets/bat/db_configs/mysql.yaml datasets/bat/setup/db_blog/data/tbl_reactions.csv evalbench/scorers/score.py evalbench/generators/prompts/sqlserver_dbschema.py datasets/bat/setup/db_blog/data/tbl_categories.csv evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/generators/models/gemini.py datasets/bat/db_configs/sqlserver.yaml datasets/bat/setup/db_blog/sqlite/pre_setup.sql datasets/bat/db_blog/run_configs/postgres/run_dml.yaml datasets/bat/db_blog/run_configs/mysql/run_ddl.yaml datasets/bat/model_configs/gemini_1.5_flash_model.yaml datasets/bat/setup/db_blog/data/tbl_users.csv datasets/bat/setup/db_blog/data/tbl_user_roles.csv datasets/bat/setup/db_blog/data/tbl_posts_tags.csv evalbench/evaluator/evaluator.py datasets/bat/db_blog/run_configs/sqlserver/run_dml.yaml evalbench/reporting/report.py datasets/bat/setup/db_blog/data/tbl_labels.csv datasets/bat/db_blog/model_configs/gemini_1.0_pro_model.yaml datasets/bat/setup/db_blog/mysql/pre_setup.sql datasets/bat/setup/db_blog/sqlserver/pre_setup.sql evalbench/databases/sqlite.py datasets/bat/setup/db_blog/mysql/setup.sql evalbench/evaluator/db_manager.py datasets/bat/db_blog/model_configs/gemini_2.0_pro_model.yaml docs/configs/run-config.md datasets/bat/setup/db_blog/data/tbl_media.csv datasets/bat/db_blog/run_configs/sqlite/run_dml.yaml datasets/bat/model_configs/gemini_1.0_pro_model.yaml evalbench/databases/sqlserver.py datasets/bat/setup/db_blog/postgres/post_setup.sql datasets/bat/db_blog/db_configs/sqlite_db_config.yaml datasets/bat/setup/db_blog/data/tbl_attachments.csv datasets/bat/setup/db_blog/mysql/post_setup.sql evalbench/generators/prompts/sqlite_dbschema.py datasets/bat/setup/db_blog/sqlite/post_setup.sql datasets/bat/setup/db_blog/data/tbl_private_messages.csv datasets/bat/db_blog/run_configs/postgres/run_dql.yaml datasets/bat/setup/db_blog/data/tbl_status.csv datasets/bat/setup/db_blog/data/tbl_comments.csv evalbench/util/config.py datasets/bat/db_blog/run_configs/sqlite/run_dql.yaml datasets/bat/db_blog/model_configs/gemini_2.0_flash_model.yaml README.md evalbench/generators/models/__init__.py datasets/bat/example_run_config.yaml datasets/bat/setup/db_blog/data/tbl_followers.csv datasets/bat/db_blog/prompts/ddl.json datasets/bat/db_blog/prompts/dql.json evalbench/generators/models/claude.py datasets/bat/setup/db_blog/data/tbl_tags_hierarchy.csv evalbench/generators/prompts/sqlgenbase.py datasets/bat/setup/db_blog/data/tbl_notifications.csv datasets/bat/db_blog/model_configs/claude_3.5_model.yaml datasets/bat/setup/db_blog/data/tbl_reports.csv datasets/bat/setup/db_blog/data/tbl_country.csv |
| 3. | 90177675+jahnavi2k@users.noreply.github.com | jahnaviii@google.com |
73 shared files
docs/configs/db-config.md datasets/bat/model_configs/gemini_2.5_pro_model.yaml datasets/bat/db_blog/run_configs/sqlite/run_ddl.yaml datasets/bat/db_blog/run_configs/postgres/run_ddl.yaml datasets/model_configs/gemini_2.5_pro_model.yaml evalbench/databases/postgres.py evalbench/databases/__init__.py datasets/bat/setup/db_blog/bigquery/pre_setup.sql datasets/bird/example_run_config.yaml run_client.sh datasets/bat/db_blog/prompts/dml.json datasets/bat/db_blog/setup/sqlserver/setup.sql datasets/model_configs/gemini_1.5_flash_model.yaml datasets/bat/db_blog/run_configs/sqlserver/run_ddl.yaml evalbench/reporting/bqstore.py requirements.txt datasets/bat/db_blog/setup/sqlite/setup.sql datasets/bat/db_blog/run_configs/mysql/run_dml.yaml datasets/bat/db_blog/db_configs/sqlserver_db_config.yaml evalbench/databases/db.py datasets/model_configs/gemini_2.0_pro_model.yaml datasets/bat/setup/db_blog/sqlserver/setup.sql datasets/bat/db_blog/model_configs/gemini_1.5_flash_model.yaml datasets/bat/db_blog/run_configs/sqlserver/run_dql.yaml evalbench/util/sanitizer.py evalbench/evalbench.py datasets/bat/db_blog/run_configs/mysql/run_dql.yaml evalbench/work/sqlexecwork.py evalbench/generators/prompts/__init__.py evalbench/dataset/dataset.py datasets/bat/prompts.json evalbench/generators/prompts/sqlserver_dbschema.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/generators/models/gemini.py datasets/bat/db_blog/run_configs/postgres/run_dml.yaml datasets/bat/db_blog/run_configs/mysql/run_ddl.yaml datasets/bird/README.md datasets/model_configs/gemini_2.0_flash_model.yaml datasets/bat/db_blog/run_configs/sqlserver/run_dml.yaml datasets/bat/db_blog/setup/sqlserver/post_setup.sql datasets/bird/download_dataset.sh datasets/bat/setup/db_blog/bigquery/post_setup.sql datasets/bat/db_blog/model_configs/gemini_1.0_pro_model.yaml evalbench/databases/bigquery.py evalbench/databases/sqlite.py evalbench/evaluator/db_manager.py datasets/bat/db_blog/model_configs/gemini_2.0_pro_model.yaml docs/configs/run-config.md datasets/bat/setup/db_blog/bigquery/setup.sql datasets/model_configs/gemini_1.5-pro-002_model.yaml datasets/model_configs/gemini_1.0_pro_model.yaml datasets/bat/db_configs/bigquery.yaml datasets/bat/db_blog/run_configs/sqlite/run_dml.yaml evalbench/databases/sqlserver.py datasets/bat/db_blog/db_configs/sqlite_db_config.yaml evalbench/generators/prompts/sqlite_dbschema.py datasets/bird/db_configs/sqlite.yaml datasets/bat/db_blog/setup/sqlite/pre_setup.sql datasets/bat/db_blog/run_configs/postgres/run_dql.yaml datasets/model_configs/claude_3.5_model.yaml evalbench/util/config.py datasets/bat/db_blog/run_configs/sqlite/run_dql.yaml datasets/bat/db_blog/model_configs/gemini_2.0_flash_model.yaml evalbench/generators/models/__init__.py datasets/bat/example_run_config.yaml datasets/bat/db_blog/setup/sqlite/post_setup.sql datasets/bat/db_blog/prompts/ddl.json datasets/bat/db_blog/prompts/dql.json evalbench/generators/models/claude.py datasets/bat/db_blog/setup/sqlserver/pre_setup.sql evalbench/generators/prompts/sqlgenbase.py datasets/bat/db_blog/model_configs/claude_3.5_model.yaml |
| 4. | 42976936+mahyareb@users.noreply.github.com | 90177675+jahnavi2k@users.noreply.github.com |
61 shared files
docs/configs/db-config.md evalbench/util/loghandler.py datasets/bat/db_blog/run_configs/sqlite/run_ddl.yaml datasets/bat/db_blog/run_configs/postgres/run_ddl.yaml datasets/bat/model_configs/gemini_2.0_flash_model.yaml evalbench/databases/postgres.py evalbench/databases/__init__.py datasets/bat/db_blog/prompts/dml.json docs/examples/sqlite_example.ipynb datasets/bat/db_blog/run_configs/sqlserver/run_ddl.yaml evalbench/reporting/bqstore.py docs/configs/dataset-config.md datasets/bat/model_configs/gemini_1.5-pro-002_model.yaml requirements.txt datasets/bat/db_blog/run_configs/mysql/run_dml.yaml evalbench/scorers/executablesql.py datasets/bat/db_blog/db_configs/sqlserver_db_config.yaml evalbench/databases/db.py evalbench/evaluator/orchestrator.py datasets/bat/model_configs/gemini_2.0_pro_model.yaml docs/configs/model-config.md datasets/bat/db_blog/model_configs/gemini_1.5_flash_model.yaml datasets/bat/db_blog/run_configs/sqlserver/run_dql.yaml evalbench/util/sanitizer.py evalbench/evalbench.py datasets/bat/db_blog/run_configs/mysql/run_dql.yaml evalbench/work/sqlexecwork.py evalbench/generators/prompts/__init__.py evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/generators/models/gemini.py datasets/bat/db_blog/run_configs/postgres/run_dml.yaml datasets/bat/db_blog/run_configs/mysql/run_ddl.yaml evalbench/evaluator/evaluator.py datasets/bat/db_blog/run_configs/sqlserver/run_dml.yaml evalbench/reporting/report.py datasets/bat/db_blog/model_configs/gemini_1.0_pro_model.yaml evalbench/databases/bigquery.py evalbench/databases/sqlite.py evalbench/evaluator/db_manager.py datasets/bat/db_blog/model_configs/gemini_2.0_pro_model.yaml docs/configs/run-config.md datasets/bat/db_blog/run_configs/sqlite/run_dml.yaml evalbench/databases/sqlserver.py datasets/bat/db_blog/db_configs/sqlite_db_config.yaml evalbench/generators/prompts/sqlite_dbschema.py datasets/bat/db_blog/run_configs/postgres/run_dql.yaml evalbench/util/config.py datasets/bat/db_blog/run_configs/sqlite/run_dql.yaml datasets/bat/db_blog/model_configs/gemini_2.0_flash_model.yaml README.md evalbench/generators/models/__init__.py datasets/bat/example_run_config.yaml datasets/bat/db_blog/prompts/ddl.json datasets/bat/db_blog/prompts/dql.json evalbench/generators/models/claude.py evalbench/generators/prompts/sqlgenbase.py datasets/bat/db_blog/model_configs/claude_3.5_model.yaml |
| 5. | jahnaviii@google.com | mebadi@google.com |
49 shared files
docs/configs/db-config.md datasets/bat/db_blog/run_configs/sqlite/run_ddl.yaml datasets/bat/db_blog/run_configs/postgres/run_ddl.yaml evalbench/databases/postgres.py evalbench/databases/__init__.py datasets/bat/db_blog/prompts/dml.json datasets/bat/db_blog/run_configs/sqlserver/run_ddl.yaml evalbench/reporting/bqstore.py requirements.txt datasets/bat/db_blog/run_configs/mysql/run_dml.yaml datasets/bat/db_blog/db_configs/sqlserver_db_config.yaml evalbench/databases/db.py datasets/bat/setup/db_blog/sqlserver/setup.sql datasets/bat/db_blog/model_configs/gemini_1.5_flash_model.yaml datasets/bat/db_blog/run_configs/sqlserver/run_dql.yaml evalbench/util/sanitizer.py evalbench/evalbench.py datasets/bat/db_blog/run_configs/mysql/run_dql.yaml evalbench/work/sqlexecwork.py evalbench/generators/prompts/__init__.py evalbench/dataset/dataset.py datasets/bat/prompts.json evalbench/generators/prompts/sqlserver_dbschema.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/generators/models/gemini.py datasets/bat/db_blog/run_configs/postgres/run_dml.yaml datasets/bat/db_blog/run_configs/mysql/run_ddl.yaml datasets/bat/db_blog/run_configs/sqlserver/run_dml.yaml datasets/bat/db_blog/model_configs/gemini_1.0_pro_model.yaml evalbench/databases/sqlite.py evalbench/evaluator/db_manager.py datasets/bat/db_blog/model_configs/gemini_2.0_pro_model.yaml docs/configs/run-config.md datasets/bat/db_blog/run_configs/sqlite/run_dml.yaml evalbench/databases/sqlserver.py datasets/bat/db_blog/db_configs/sqlite_db_config.yaml evalbench/generators/prompts/sqlite_dbschema.py datasets/bat/db_blog/run_configs/postgres/run_dql.yaml evalbench/util/config.py datasets/bat/db_blog/run_configs/sqlite/run_dql.yaml datasets/bat/db_blog/model_configs/gemini_2.0_flash_model.yaml evalbench/generators/models/__init__.py datasets/bat/example_run_config.yaml datasets/bat/db_blog/prompts/ddl.json datasets/bat/db_blog/prompts/dql.json evalbench/generators/models/claude.py evalbench/generators/prompts/sqlgenbase.py datasets/bat/db_blog/model_configs/claude_3.5_model.yaml |
| 6. | 42976936+mahyareb@users.noreply.github.com | jahnaviii@google.com |
48 shared files
docs/configs/db-config.md datasets/bat/db_blog/run_configs/sqlite/run_ddl.yaml datasets/bat/db_blog/run_configs/postgres/run_ddl.yaml evalbench/databases/postgres.py evalbench/databases/__init__.py datasets/bat/db_blog/prompts/dml.json datasets/bat/db_blog/run_configs/sqlserver/run_ddl.yaml evalbench/reporting/bqstore.py requirements.txt datasets/bat/db_blog/run_configs/mysql/run_dml.yaml datasets/bat/db_blog/db_configs/sqlserver_db_config.yaml evalbench/databases/db.py datasets/bat/db_blog/model_configs/gemini_1.5_flash_model.yaml datasets/bat/db_blog/run_configs/sqlserver/run_dql.yaml evalbench/util/sanitizer.py evalbench/evalbench.py datasets/bat/db_blog/run_configs/mysql/run_dql.yaml evalbench/work/sqlexecwork.py evalbench/generators/prompts/__init__.py evalbench/dataset/dataset.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/generators/models/gemini.py datasets/bat/db_blog/run_configs/postgres/run_dml.yaml datasets/bat/db_blog/run_configs/mysql/run_ddl.yaml datasets/bat/db_blog/run_configs/sqlserver/run_dml.yaml datasets/bat/db_blog/model_configs/gemini_1.0_pro_model.yaml evalbench/databases/bigquery.py evalbench/databases/sqlite.py evalbench/evaluator/db_manager.py datasets/bat/db_blog/model_configs/gemini_2.0_pro_model.yaml docs/configs/run-config.md datasets/bat/db_blog/run_configs/sqlite/run_dml.yaml evalbench/databases/sqlserver.py datasets/bat/db_blog/db_configs/sqlite_db_config.yaml evalbench/generators/prompts/sqlite_dbschema.py datasets/bat/db_blog/run_configs/postgres/run_dql.yaml evalbench/util/config.py datasets/bat/db_blog/run_configs/sqlite/run_dql.yaml datasets/bat/db_blog/model_configs/gemini_2.0_flash_model.yaml evalbench/generators/models/__init__.py datasets/bat/example_run_config.yaml datasets/bat/db_blog/prompts/ddl.json datasets/bat/db_blog/prompts/dql.json evalbench/generators/models/claude.py evalbench/generators/prompts/sqlgenbase.py datasets/bat/db_blog/model_configs/claude_3.5_model.yaml |
| 7. | 90177675+jahnavi2k@users.noreply.github.com | 76586767+dvnshgupta@users.noreply.github.com |
37 shared files
docs/configs/db-config.md datasets/bat/db_blog/run_configs/sqlite/run_ddl.yaml evalbench/databases/__init__.py datasets/bird/example_run_config.yaml datasets/bat/db_blog/prompts/dml.json datasets/model_configs/gemini_1.5_flash_model.yaml datasets/bat/db_blog/setup/sqlite/setup.sql evalbench/databases/db.py datasets/model_configs/gemini_2.0_pro_model.yaml evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/generators/prompts/__init__.py evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py datasets/bird/README.md datasets/model_configs/gemini_2.0_flash_model.yaml evalbench/evaluator/evaluator.py datasets/bird/download_dataset.sh evalbench/databases/sqlite.py docs/examples/GCP_CloudSQL_Example.ipynb docs/configs/run-config.md datasets/model_configs/gemini_1.5-pro-002_model.yaml datasets/model_configs/gemini_1.0_pro_model.yaml datasets/bat/db_blog/run_configs/sqlite/run_dml.yaml datasets/bat/db_blog/db_configs/sqlite_db_config.yaml evalbench/generators/prompts/sqlite_dbschema.py datasets/bird/db_configs/sqlite.yaml datasets/bat/db_blog/setup/sqlite/pre_setup.sql datasets/model_configs/claude_3.5_model.yaml datasets/bat/db_blog/run_configs/sqlite/run_dql.yaml datasets/bat/example_run_config.yaml datasets/bat/db_blog/setup/sqlite/post_setup.sql datasets/bat/db_blog/prompts/ddl.json datasets/bat/db_blog/prompts/dql.json |
| 8. | 76586767+dvnshgupta@users.noreply.github.com | jahnaviii@google.com |
34 shared files
docs/configs/db-config.md datasets/bat/db_blog/run_configs/sqlite/run_ddl.yaml evalbench/databases/__init__.py datasets/bird/example_run_config.yaml datasets/bat/db_blog/prompts/dml.json datasets/model_configs/gemini_1.5_flash_model.yaml datasets/bat/db_blog/setup/sqlite/setup.sql evalbench/databases/db.py datasets/model_configs/gemini_2.0_pro_model.yaml evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/generators/prompts/__init__.py evalbench/dataset/dataset.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py datasets/bird/README.md datasets/model_configs/gemini_2.0_flash_model.yaml datasets/bird/download_dataset.sh evalbench/databases/sqlite.py docs/configs/run-config.md datasets/model_configs/gemini_1.5-pro-002_model.yaml datasets/model_configs/gemini_1.0_pro_model.yaml datasets/bat/db_blog/run_configs/sqlite/run_dml.yaml datasets/bat/db_blog/db_configs/sqlite_db_config.yaml evalbench/generators/prompts/sqlite_dbschema.py datasets/bird/db_configs/sqlite.yaml datasets/bat/db_blog/setup/sqlite/pre_setup.sql datasets/model_configs/claude_3.5_model.yaml datasets/bat/db_blog/run_configs/sqlite/run_dql.yaml datasets/bat/example_run_config.yaml datasets/bat/db_blog/setup/sqlite/post_setup.sql datasets/bat/db_blog/prompts/ddl.json datasets/bat/db_blog/prompts/dql.json |
| 9. | 42976936+mahyareb@users.noreply.github.com | 76586767+dvnshgupta@users.noreply.github.com |
33 shared files
docs/configs/db-config.md datasets/bat/db_blog/run_configs/sqlite/run_ddl.yaml evalbench/databases/__init__.py evalbench/generators/prompts/mysql_dbschema.py datasets/bat/db_blog/prompts/dml.json evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/recallmatcher.py evalbench/databases/db.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/scorers/comparator.py evalbench/generators/prompts/__init__.py evalbench/dataset/dataset.py evalbench/scorers/returnedsql.py evalbench/scorers/score.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/reporting/analyzer.py evalbench/evaluator/evaluator.py evalbench/scorers/exactmatcher.py evalbench/databases/sqlite.py docs/configs/run-config.md datasets/bat/db_blog/run_configs/sqlite/run_dml.yaml datasets/bat/db_blog/db_configs/sqlite_db_config.yaml evalbench/scorers/setmatcher.py evalbench/generators/prompts/sqlite_dbschema.py evalbench/generators/prompts/pg_dbschema.py evalbench/dataset/evalinput.py datasets/bat/db_blog/run_configs/sqlite/run_dql.yaml datasets/bat/example_run_config.yaml datasets/bat/db_blog/prompts/ddl.json datasets/bat/db_blog/prompts/dql.json |
| 10. | 76586767+dvnshgupta@users.noreply.github.com | mebadi@google.com |
33 shared files
docs/configs/db-config.md datasets/bat/db_blog/run_configs/sqlite/run_ddl.yaml evalbench/databases/__init__.py evalbench/generators/prompts/mysql_dbschema.py datasets/bat/db_blog/prompts/dml.json evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/recallmatcher.py evalbench/databases/db.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/scorers/comparator.py evalbench/generators/prompts/__init__.py evalbench/dataset/dataset.py evalbench/scorers/returnedsql.py evalbench/scorers/score.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/reporting/analyzer.py evalbench/evaluator/evaluator.py evalbench/scorers/exactmatcher.py evalbench/databases/sqlite.py docs/configs/run-config.md datasets/bat/db_blog/run_configs/sqlite/run_dml.yaml datasets/bat/db_blog/db_configs/sqlite_db_config.yaml evalbench/scorers/setmatcher.py evalbench/generators/prompts/sqlite_dbschema.py evalbench/generators/prompts/pg_dbschema.py evalbench/dataset/evalinput.py datasets/bat/db_blog/run_configs/sqlite/run_dql.yaml datasets/bat/example_run_config.yaml datasets/bat/db_blog/prompts/ddl.json datasets/bat/db_blog/prompts/dql.json |
| 11. | 76586767+dvnshgupta@users.noreply.github.com | dvnshgupta@google.com |
13 shared files
evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/recallmatcher.py evalbench/scorers/comparator.py evalbench/scorers/returnedsql.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/reporting/analyzer.py evalbench/evaluator/evaluator.py evalbench/scorers/vertextmatcher.py evalbench/scorers/exactmatcher.py docs/examples/GCP_CloudSQL_Example.ipynb evalbench/scorers/setmatcher.py evalbench/dataset/evalinput.py |
| 12. | mebadi@google.com | dvnshgupta@google.com |
11 shared files
evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/recallmatcher.py evalbench/scorers/comparator.py evalbench/scorers/returnedsql.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/reporting/analyzer.py evalbench/evaluator/evaluator.py evalbench/scorers/exactmatcher.py evalbench/scorers/setmatcher.py evalbench/dataset/evalinput.py |
| 13. | dvnshgupta@google.com | 42976936+mahyareb@users.noreply.github.com |
11 shared files
evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/recallmatcher.py evalbench/scorers/comparator.py evalbench/scorers/returnedsql.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/reporting/analyzer.py evalbench/evaluator/evaluator.py evalbench/scorers/exactmatcher.py evalbench/scorers/setmatcher.py evalbench/dataset/evalinput.py |
| 14. | 42976936+mahyareb@users.noreply.github.com | m1378.prz@gmail.com |
8 shared files
docs/configs/db-config.md evalbench/databases/__init__.py evalbench/generators/models/alloydb_ai_nl.py evalbench/evaluator/orchestrator.py datasets/bat/db_configs/alloydb.yaml evalbench/databases/bigquery.py evalbench/databases/alloydb.py evalbench/generators/models/__init__.py |
| 15. | 76586767+dvnshgupta@users.noreply.github.com | 75753836+hardikgu23@users.noreply.github.com |
6 shared files
evalbench/scorers/recallmatcher.py evalbench/evalbench.py evalbench/scorers/comparator.py evalbench/scorers/score.py evalbench/databases/mysql.py evalbench/reporting/analyzer.py |
| 16. | 75753836+hardikgu23@users.noreply.github.com | 42976936+mahyareb@users.noreply.github.com |
6 shared files
evalbench/scorers/recallmatcher.py evalbench/evalbench.py evalbench/scorers/comparator.py evalbench/scorers/score.py evalbench/databases/mysql.py evalbench/reporting/analyzer.py |
| 17. | 75753836+hardikgu23@users.noreply.github.com | mebadi@google.com |
6 shared files
evalbench/scorers/recallmatcher.py evalbench/evalbench.py evalbench/scorers/comparator.py evalbench/scorers/score.py evalbench/databases/mysql.py evalbench/reporting/analyzer.py |
| 18. | m1378.prz@gmail.com | 90177675+jahnavi2k@users.noreply.github.com |
5 shared files
docs/configs/db-config.md evalbench/databases/__init__.py evalbench/evaluator/orchestrator.py evalbench/databases/bigquery.py evalbench/generators/models/__init__.py |
| 19. | m1378.prz@gmail.com | mebadi@google.com |
5 shared files
docs/configs/db-config.md evalbench/databases/__init__.py evalbench/evaluator/orchestrator.py evalbench/databases/alloydb.py evalbench/generators/models/__init__.py |
| 20. | 42976936+mahyareb@users.noreply.github.com | hardikgupta@google.com |
5 shared files
evalbench/generators/prompts/mysql_dbschema.py evalbench/evalbench.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/databases/mysql.py evalbench/generators/prompts/pg_dbschema.py |
| 21. | mebadi@google.com | hardikgupta@google.com |
5 shared files
evalbench/generators/prompts/mysql_dbschema.py evalbench/evalbench.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/databases/mysql.py evalbench/generators/prompts/pg_dbschema.py |
| 22. | 76586767+dvnshgupta@users.noreply.github.com | hardikgupta@google.com |
5 shared files
evalbench/generators/prompts/mysql_dbschema.py evalbench/evalbench.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/databases/mysql.py evalbench/generators/prompts/pg_dbschema.py |
| 23. | m1378.prz@gmail.com | jahnaviii@google.com |
4 shared files
docs/configs/db-config.md evalbench/databases/__init__.py evalbench/databases/bigquery.py evalbench/generators/models/__init__.py |
| 24. | dvnshgupta@google.com | 75753836+hardikgu23@users.noreply.github.com |
4 shared files
evalbench/scorers/recallmatcher.py evalbench/scorers/comparator.py evalbench/scorers/score.py evalbench/reporting/analyzer.py |
| 25. | dvnshgupta@google.com | 90177675+jahnavi2k@users.noreply.github.com |
4 shared files
evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/evaluator/evaluator.py docs/examples/GCP_CloudSQL_Example.ipynb |
| 26. | 75753836+hardikgu23@users.noreply.github.com | 90177675+jahnavi2k@users.noreply.github.com |
3 shared files
evalbench/evalbench.py evalbench/scorers/score.py evalbench/databases/mysql.py |
| 27. | hardikgupta@google.com | jahnaviii@google.com |
3 shared files
evalbench/evalbench.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/databases/mysql.py |
| 28. | hardikgupta@google.com | 90177675+jahnavi2k@users.noreply.github.com |
3 shared files
evalbench/evalbench.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/databases/mysql.py |
| 29. | m1378.prz@gmail.com | 76586767+dvnshgupta@users.noreply.github.com |
2 shared files
docs/configs/db-config.md evalbench/databases/__init__.py |
| 30. | 75753836+hardikgu23@users.noreply.github.com | hardikgupta@google.com |
2 shared files
evalbench/evalbench.py evalbench/databases/mysql.py |
| 31. | 75753836+hardikgu23@users.noreply.github.com | jahnaviii@google.com |
2 shared files
evalbench/evalbench.py evalbench/databases/mysql.py |
| 32. | dvnshgupta@google.com | jahnaviii@google.com |
1 shared file
evalbench/scorers/llmrater.py |
| 33. | mebadi@google.com | ismailmehdi@gmail.com |
1 shared file
datasets/bat/example_run_config.yaml |
| 34. | jahnaviii@google.com | ismailmehdi@gmail.com |
1 shared file
datasets/bat/example_run_config.yaml |
| 35. | 90177675+jahnavi2k@users.noreply.github.com | ismailmehdi@gmail.com |
1 shared file
datasets/bat/example_run_config.yaml |
| 36. | 42976936+mahyareb@users.noreply.github.com | ismailmehdi@gmail.com |
1 shared file
datasets/bat/example_run_config.yaml |
| 37. | 76586767+dvnshgupta@users.noreply.github.com | ismailmehdi@gmail.com |
1 shared file
datasets/bat/example_run_config.yaml |
| Contributor | # connections | # commits | |
|---|---|---|---|
| 1. | mebadi@google.com | 9 | 125 |
| 2. | jahnaviii@google.com | 9 | 46 |
| 3. | 42976936+mahyareb@users.noreply.github.com | 9 | 37 |
| 4. | 90177675+jahnavi2k@users.noreply.github.com | 9 | 23 |
| 5. | 76586767+dvnshgupta@users.noreply.github.com | 9 | 22 |
| 6. | 75753836+hardikgu23@users.noreply.github.com | 7 | 4 |
| 7. | dvnshgupta@google.com | 6 | 26 |
| 8. | hardikgupta@google.com | 6 | 4 |
| 9. | m1378.prz@gmail.com | 5 | 5 |
| 10. | ismailmehdi@gmail.com | 5 | 1 |
C-median: 8.0
A half of the contributors has more than 8.0 connections, and a half has less than this number.
C-mean: 7.4
An average number of connections a contributor has with other contributors.
C-index: 6.0
There are 6.0 contributors with 6.0 or more connections.
16 contributors (359 commits):
| # | Contributor |
First Commit |
Latest Commit |
Commits Count |
|---|---|---|---|---|
| 1. | mebadi@google.com | 2024-09-28 | 2025-04-03 | 135 (37%) |
| 2. | hardikgupta@google.com | 2024-09-01 | 2025-03-21 | 18 (5%) |
| 3. | 42976936+mahyareb@users.noreply.github.com | 2024-09-28 | 2025-04-29 | 57 (15%) |
| 4. | jahnaviii@google.com | 2025-02-11 | 2025-04-28 | 46 (12%) |
| 5. | 75753836+hardikgu23@users.noreply.github.com | 2024-09-01 | 2025-03-21 | 9 (2%) |
| 6. | dvnshgupta@google.com | 2025-02-13 | 2025-04-21 | 26 (7%) |
| 7. | 90177675+jahnavi2k@users.noreply.github.com | 2025-02-13 | 2025-04-28 | 23 (6%) |
| 8. | 76586767+dvnshgupta@users.noreply.github.com | 2025-02-14 | 2025-04-21 | 22 (6%) |
| 9. | ismailmehdi@gmail.com | 2024-07-31 | 2025-04-22 | 2 (<1%) |
| 10. | viditchopra@google.com | 2024-08-22 | 2024-11-15 | 2 (<1%) |
| 11. | 51998522+viditchopra1500@users.noreply.github.com | 2024-08-30 | 2024-11-18 | 2 (<1%) |
| 12. | prernakakkar@google.com | 2024-09-09 | 2025-01-24 | 5 (1%) |
| 13. | m1378.prz@gmail.com | 2025-04-28 | 2025-04-29 | 5 (1%) |
| 14. | 158031829+prernakakkar-google@users.noreply.github.com | 2024-09-10 | 2025-01-27 | 3 (<1%) |
| 15. | hailong.leon@gmail.com | 2024-12-07 | 2025-01-16 | 3 (<1%) |
| 16. | hailongli@google.com | 2024-12-07 | 2024-12-07 | 1 (<1%) |
A contributor dependency is detected if two contributors have changed the same files in the past 180 days.
The number on lines shows the number of same files that both persons changed in past 180 days.
| Contributor 1 | Contributor 2 | # shared files | |
|---|---|---|---|
| 1. | 42976936+mahyareb@users.noreply.github.com | mebadi@google.com |
137 shared files
docs/configs/db-config.md datasets/bat/db_blog/setup/mysql/setup.sql datasets/bat/db_blog/setup/data/tbl_status.csv datasets/bat/db_blog/setup/postgres/post_setup.sql evalbench/util/loghandler.py datasets/bat/db_blog/run_configs/sqlite/run_ddl.yaml datasets/bat/db_blog/run_configs/postgres/run_ddl.yaml datasets/bat/model_configs/gemini_2.0_flash_model.yaml evalbench/dataset/eval_format_verifier/eval_format_verifier.py evalbench/util/rate_limit.py evalbench/databases/postgres.py evalbench/databases/__init__.py evalbench/evalproto/eval_request.proto evalbench/databases/util.py datasets/bat/db_blog/setup/mysql/post_setup.sql evalbench/generators/prompts/mysql_dbschema.py datasets/bat/db_blog/prompts/dml.json evalbench/scorers/generatedqueryregexpmatcher.py docs/examples/sqlite_example.ipynb datasets/bat/db_blog/run_configs/sqlserver/run_ddl.yaml datasets/bat/db_blog/setup/mysql/pre_setup.sql evalbench/reporting/bqstore.py docs/configs/dataset-config.md datasets/bat/db_blog/setup/data/tbl_reports.csv datasets/bat/model_configs/gemini_1.5-pro-002_model.yaml requirements.txt evalbench/reporting/__init__.py evalbench/scorers/recallmatcher.py datasets/bat/db_blog/model_configs/base_gemini_model.yaml evalbench/generators/prompts/generator.py datasets/bat/db_blog/setup/data/tbl_user_roles.csv evalbench/work/work.py datasets/bat/db_blog/run_configs/mysql/run_dml.yaml datasets/bat/db_blog/setup/data/tbl_attachments.csv evalbench/scorers/executablesql.py datasets/bat/db_blog/db_configs/sqlserver_db_config.yaml evalbench/databases/db.py evalbench/generators/models/openai.py evalbench/evaluator/orchestrator.py datasets/bat/model_configs/gemini_2.0_pro_model.yaml docs/configs/model-config.md evalbench/scorers/util.py evalbench/dataset/util.py evalbench_service/Dockerfile datasets/bat/db_blog/model_configs/gemini_1.5_flash_model.yaml datasets/bat/db_blog/run_configs/sqlserver/run_dql.yaml evalbench/util/sanitizer.py evalbench/evalbench.py datasets/bat/db_blog/run_configs/mysql/run_dql.yaml evalbench/work/sqlexecwork.py evalbench/scorers/comparator.py evalbench/repository/nldRepo.py evalbench/generators/prompts/__init__.py evalbench/test/sessionmgr_test.py evalbench/dataset/dataset.py evalbench/scorers/returnedsql.py .gitignore datasets/bat/db_blog/setup/data/tbl_posts.csv Makefile datasets/bat/db_blog/model_configs/gemini_1.5-pro-002_model.yaml datasets/bat/db_blog/setup/data/tbl_user_activity.csv evalbench/scorers/score.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/run.sh datasets/bat/db_blog/setup/data/tbl_followers.csv datasets/bat/db_blog/setup/data/tbl_labels.csv datasets/bat/db_blog/setup/data/tbl_tags_hierarchy.csv evalbench/generators/models/passthrough.py datasets/bat/db_blog/setup/data/tbl_private_messages.csv evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/dataset/eval_format_verifier/eval_format_verifier_test.py evalbench/generators/models/gemini.py evalbench/dataset/eval_format_verifier/eval_format_verifier_test_helper.py datasets/bat/db_blog/setup/data/tbl_posts_tags.csv evalbench/reporting/analyzer.py datasets/bat/db_blog/db_configs/pg_db_config.yaml datasets/bat/db_blog/run_configs/postgres/run_dml.yaml datasets/bat/db_blog/run_configs/mysql/run_ddl.yaml datasets/bat/db_blog/setup/data/tbl_country.csv evalbench/evaluator/evaluator.py datasets/bat/db_blog/run_configs/sqlserver/run_dml.yaml evalbench/util/sessionmgr.py evalbench/work/scorework.py evalbench/reporting/report.py datasets/bat/db_blog/model_configs/gemini_1.0_pro_model.yaml evalbench/eval_service.py evalbench/scorers/exactmatcher.py evalbench/databases/sqlite.py evalbench/util/gcp.py datasets/bat/db_blog/db_configs/mysql_db_config.yaml evalbench/evaluator/db_manager.py datasets/bat/db_blog/model_configs/gemini_2.0_pro_model.yaml docs/configs/run-config.md evalbench/util/service.py evalbench/reporting/csv.py evalbench/util/__init__.py datasets/bat/db_blog/run_configs/sqlite/run_dml.yaml evalbench/databases/sqlserver.py evalbench/evaluator/progress_reporter.py ... |
| 2. | 90177675+jahnavi2k@users.noreply.github.com | mebadi@google.com |
99 shared files
docs/configs/db-config.md evalbench/util/loghandler.py datasets/bat/db_blog/run_configs/sqlite/run_ddl.yaml datasets/bat/db_blog/run_configs/postgres/run_ddl.yaml datasets/bat/setup/db_blog/postgres/setup.sql datasets/bat/model_configs/gemini_2.0_flash_model.yaml evalbench/databases/postgres.py evalbench/databases/__init__.py datasets/bat/db_configs/postgres.yaml datasets/bat/setup/db_blog/sqlserver/post_setup.sql datasets/bat/setup/db_blog/data/tbl_posts.csv datasets/bat/db_blog/prompts/dml.json docs/examples/sqlite_example.ipynb datasets/bat/db_blog/run_configs/sqlserver/run_ddl.yaml evalbench/reporting/bqstore.py docs/configs/dataset-config.md datasets/bat/model_configs/gemini_1.5-pro-002_model.yaml requirements.txt datasets/bat/model_configs/claude_3.5_model.yaml datasets/bat/setup/db_blog/data/tbl_user_activity.csv datasets/bat/db_configs/sqlite.yaml datasets/bat/setup/db_blog/sqlite/setup.sql datasets/bat/db_blog/run_configs/mysql/run_dml.yaml evalbench/scorers/executablesql.py datasets/bat/db_blog/db_configs/sqlserver_db_config.yaml evalbench/databases/db.py evalbench/evaluator/orchestrator.py datasets/bat/model_configs/gemini_2.0_pro_model.yaml docs/configs/model-config.md datasets/bat/setup/db_blog/sqlserver/setup.sql datasets/bat/setup/db_blog/data/tbl_tags.csv datasets/bat/db_blog/model_configs/gemini_1.5_flash_model.yaml datasets/bat/db_blog/run_configs/sqlserver/run_dql.yaml evalbench/util/sanitizer.py evalbench/evalbench.py datasets/bat/db_blog/run_configs/mysql/run_dql.yaml evalbench/work/sqlexecwork.py evalbench/generators/prompts/__init__.py datasets/bat/setup/db_blog/postgres/pre_setup.sql evalbench/dataset/dataset.py datasets/bat/prompts.json datasets/bat/db_configs/mysql.yaml datasets/bat/setup/db_blog/data/tbl_reactions.csv evalbench/scorers/score.py evalbench/generators/prompts/sqlserver_dbschema.py datasets/bat/setup/db_blog/data/tbl_categories.csv evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/generators/models/gemini.py datasets/bat/db_configs/sqlserver.yaml datasets/bat/setup/db_blog/sqlite/pre_setup.sql datasets/bat/db_blog/run_configs/postgres/run_dml.yaml datasets/bat/db_blog/run_configs/mysql/run_ddl.yaml datasets/bat/model_configs/gemini_1.5_flash_model.yaml datasets/bat/setup/db_blog/data/tbl_users.csv datasets/bat/setup/db_blog/data/tbl_user_roles.csv datasets/bat/setup/db_blog/data/tbl_posts_tags.csv evalbench/evaluator/evaluator.py datasets/bat/db_blog/run_configs/sqlserver/run_dml.yaml evalbench/reporting/report.py datasets/bat/setup/db_blog/data/tbl_labels.csv datasets/bat/db_blog/model_configs/gemini_1.0_pro_model.yaml datasets/bat/setup/db_blog/mysql/pre_setup.sql datasets/bat/setup/db_blog/sqlserver/pre_setup.sql evalbench/databases/sqlite.py datasets/bat/setup/db_blog/mysql/setup.sql evalbench/evaluator/db_manager.py datasets/bat/db_blog/model_configs/gemini_2.0_pro_model.yaml docs/configs/run-config.md datasets/bat/setup/db_blog/data/tbl_media.csv datasets/bat/db_blog/run_configs/sqlite/run_dml.yaml datasets/bat/model_configs/gemini_1.0_pro_model.yaml evalbench/databases/sqlserver.py datasets/bat/setup/db_blog/postgres/post_setup.sql datasets/bat/db_blog/db_configs/sqlite_db_config.yaml datasets/bat/setup/db_blog/data/tbl_attachments.csv datasets/bat/setup/db_blog/mysql/post_setup.sql evalbench/generators/prompts/sqlite_dbschema.py datasets/bat/setup/db_blog/sqlite/post_setup.sql datasets/bat/setup/db_blog/data/tbl_private_messages.csv datasets/bat/db_blog/run_configs/postgres/run_dql.yaml datasets/bat/setup/db_blog/data/tbl_status.csv datasets/bat/setup/db_blog/data/tbl_comments.csv evalbench/util/config.py datasets/bat/db_blog/run_configs/sqlite/run_dql.yaml datasets/bat/db_blog/model_configs/gemini_2.0_flash_model.yaml README.md evalbench/generators/models/__init__.py datasets/bat/example_run_config.yaml datasets/bat/setup/db_blog/data/tbl_followers.csv datasets/bat/db_blog/prompts/ddl.json datasets/bat/db_blog/prompts/dql.json evalbench/generators/models/claude.py datasets/bat/setup/db_blog/data/tbl_tags_hierarchy.csv evalbench/generators/prompts/sqlgenbase.py datasets/bat/setup/db_blog/data/tbl_notifications.csv datasets/bat/db_blog/model_configs/claude_3.5_model.yaml datasets/bat/setup/db_blog/data/tbl_reports.csv datasets/bat/setup/db_blog/data/tbl_country.csv |
| 3. | 90177675+jahnavi2k@users.noreply.github.com | jahnaviii@google.com |
73 shared files
docs/configs/db-config.md datasets/bat/model_configs/gemini_2.5_pro_model.yaml datasets/bat/db_blog/run_configs/sqlite/run_ddl.yaml datasets/bat/db_blog/run_configs/postgres/run_ddl.yaml datasets/model_configs/gemini_2.5_pro_model.yaml evalbench/databases/postgres.py evalbench/databases/__init__.py datasets/bat/setup/db_blog/bigquery/pre_setup.sql datasets/bird/example_run_config.yaml run_client.sh datasets/bat/db_blog/prompts/dml.json datasets/bat/db_blog/setup/sqlserver/setup.sql datasets/model_configs/gemini_1.5_flash_model.yaml datasets/bat/db_blog/run_configs/sqlserver/run_ddl.yaml evalbench/reporting/bqstore.py requirements.txt datasets/bat/db_blog/setup/sqlite/setup.sql datasets/bat/db_blog/run_configs/mysql/run_dml.yaml datasets/bat/db_blog/db_configs/sqlserver_db_config.yaml evalbench/databases/db.py datasets/model_configs/gemini_2.0_pro_model.yaml datasets/bat/setup/db_blog/sqlserver/setup.sql datasets/bat/db_blog/model_configs/gemini_1.5_flash_model.yaml datasets/bat/db_blog/run_configs/sqlserver/run_dql.yaml evalbench/util/sanitizer.py evalbench/evalbench.py datasets/bat/db_blog/run_configs/mysql/run_dql.yaml evalbench/work/sqlexecwork.py evalbench/generators/prompts/__init__.py evalbench/dataset/dataset.py datasets/bat/prompts.json evalbench/generators/prompts/sqlserver_dbschema.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/generators/models/gemini.py datasets/bat/db_blog/run_configs/postgres/run_dml.yaml datasets/bat/db_blog/run_configs/mysql/run_ddl.yaml datasets/bird/README.md datasets/model_configs/gemini_2.0_flash_model.yaml datasets/bat/db_blog/run_configs/sqlserver/run_dml.yaml datasets/bat/db_blog/setup/sqlserver/post_setup.sql datasets/bird/download_dataset.sh datasets/bat/setup/db_blog/bigquery/post_setup.sql datasets/bat/db_blog/model_configs/gemini_1.0_pro_model.yaml evalbench/databases/bigquery.py evalbench/databases/sqlite.py evalbench/evaluator/db_manager.py datasets/bat/db_blog/model_configs/gemini_2.0_pro_model.yaml docs/configs/run-config.md datasets/bat/setup/db_blog/bigquery/setup.sql datasets/model_configs/gemini_1.5-pro-002_model.yaml datasets/model_configs/gemini_1.0_pro_model.yaml datasets/bat/db_configs/bigquery.yaml datasets/bat/db_blog/run_configs/sqlite/run_dml.yaml evalbench/databases/sqlserver.py datasets/bat/db_blog/db_configs/sqlite_db_config.yaml evalbench/generators/prompts/sqlite_dbschema.py datasets/bird/db_configs/sqlite.yaml datasets/bat/db_blog/setup/sqlite/pre_setup.sql datasets/bat/db_blog/run_configs/postgres/run_dql.yaml datasets/model_configs/claude_3.5_model.yaml evalbench/util/config.py datasets/bat/db_blog/run_configs/sqlite/run_dql.yaml datasets/bat/db_blog/model_configs/gemini_2.0_flash_model.yaml evalbench/generators/models/__init__.py datasets/bat/example_run_config.yaml datasets/bat/db_blog/setup/sqlite/post_setup.sql datasets/bat/db_blog/prompts/ddl.json datasets/bat/db_blog/prompts/dql.json evalbench/generators/models/claude.py datasets/bat/db_blog/setup/sqlserver/pre_setup.sql evalbench/generators/prompts/sqlgenbase.py datasets/bat/db_blog/model_configs/claude_3.5_model.yaml |
| 4. | 42976936+mahyareb@users.noreply.github.com | 90177675+jahnavi2k@users.noreply.github.com |
61 shared files
docs/configs/db-config.md evalbench/util/loghandler.py datasets/bat/db_blog/run_configs/sqlite/run_ddl.yaml datasets/bat/db_blog/run_configs/postgres/run_ddl.yaml datasets/bat/model_configs/gemini_2.0_flash_model.yaml evalbench/databases/postgres.py evalbench/databases/__init__.py datasets/bat/db_blog/prompts/dml.json docs/examples/sqlite_example.ipynb datasets/bat/db_blog/run_configs/sqlserver/run_ddl.yaml evalbench/reporting/bqstore.py docs/configs/dataset-config.md datasets/bat/model_configs/gemini_1.5-pro-002_model.yaml requirements.txt datasets/bat/db_blog/run_configs/mysql/run_dml.yaml evalbench/scorers/executablesql.py datasets/bat/db_blog/db_configs/sqlserver_db_config.yaml evalbench/databases/db.py evalbench/evaluator/orchestrator.py datasets/bat/model_configs/gemini_2.0_pro_model.yaml docs/configs/model-config.md datasets/bat/db_blog/model_configs/gemini_1.5_flash_model.yaml datasets/bat/db_blog/run_configs/sqlserver/run_dql.yaml evalbench/util/sanitizer.py evalbench/evalbench.py datasets/bat/db_blog/run_configs/mysql/run_dql.yaml evalbench/work/sqlexecwork.py evalbench/generators/prompts/__init__.py evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/generators/models/gemini.py datasets/bat/db_blog/run_configs/postgres/run_dml.yaml datasets/bat/db_blog/run_configs/mysql/run_ddl.yaml evalbench/evaluator/evaluator.py datasets/bat/db_blog/run_configs/sqlserver/run_dml.yaml evalbench/reporting/report.py datasets/bat/db_blog/model_configs/gemini_1.0_pro_model.yaml evalbench/databases/bigquery.py evalbench/databases/sqlite.py evalbench/evaluator/db_manager.py datasets/bat/db_blog/model_configs/gemini_2.0_pro_model.yaml docs/configs/run-config.md datasets/bat/db_blog/run_configs/sqlite/run_dml.yaml evalbench/databases/sqlserver.py datasets/bat/db_blog/db_configs/sqlite_db_config.yaml evalbench/generators/prompts/sqlite_dbschema.py datasets/bat/db_blog/run_configs/postgres/run_dql.yaml evalbench/util/config.py datasets/bat/db_blog/run_configs/sqlite/run_dql.yaml datasets/bat/db_blog/model_configs/gemini_2.0_flash_model.yaml README.md evalbench/generators/models/__init__.py datasets/bat/example_run_config.yaml datasets/bat/db_blog/prompts/ddl.json datasets/bat/db_blog/prompts/dql.json evalbench/generators/models/claude.py evalbench/generators/prompts/sqlgenbase.py datasets/bat/db_blog/model_configs/claude_3.5_model.yaml |
| 5. | jahnaviii@google.com | mebadi@google.com |
49 shared files
docs/configs/db-config.md datasets/bat/db_blog/run_configs/sqlite/run_ddl.yaml datasets/bat/db_blog/run_configs/postgres/run_ddl.yaml evalbench/databases/postgres.py evalbench/databases/__init__.py datasets/bat/db_blog/prompts/dml.json datasets/bat/db_blog/run_configs/sqlserver/run_ddl.yaml evalbench/reporting/bqstore.py requirements.txt datasets/bat/db_blog/run_configs/mysql/run_dml.yaml datasets/bat/db_blog/db_configs/sqlserver_db_config.yaml evalbench/databases/db.py datasets/bat/setup/db_blog/sqlserver/setup.sql datasets/bat/db_blog/model_configs/gemini_1.5_flash_model.yaml datasets/bat/db_blog/run_configs/sqlserver/run_dql.yaml evalbench/util/sanitizer.py evalbench/evalbench.py datasets/bat/db_blog/run_configs/mysql/run_dql.yaml evalbench/work/sqlexecwork.py evalbench/generators/prompts/__init__.py evalbench/dataset/dataset.py datasets/bat/prompts.json evalbench/generators/prompts/sqlserver_dbschema.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/generators/models/gemini.py datasets/bat/db_blog/run_configs/postgres/run_dml.yaml datasets/bat/db_blog/run_configs/mysql/run_ddl.yaml datasets/bat/db_blog/run_configs/sqlserver/run_dml.yaml datasets/bat/db_blog/model_configs/gemini_1.0_pro_model.yaml evalbench/databases/sqlite.py evalbench/evaluator/db_manager.py datasets/bat/db_blog/model_configs/gemini_2.0_pro_model.yaml docs/configs/run-config.md datasets/bat/db_blog/run_configs/sqlite/run_dml.yaml evalbench/databases/sqlserver.py datasets/bat/db_blog/db_configs/sqlite_db_config.yaml evalbench/generators/prompts/sqlite_dbschema.py datasets/bat/db_blog/run_configs/postgres/run_dql.yaml evalbench/util/config.py datasets/bat/db_blog/run_configs/sqlite/run_dql.yaml datasets/bat/db_blog/model_configs/gemini_2.0_flash_model.yaml evalbench/generators/models/__init__.py datasets/bat/example_run_config.yaml datasets/bat/db_blog/prompts/ddl.json datasets/bat/db_blog/prompts/dql.json evalbench/generators/models/claude.py evalbench/generators/prompts/sqlgenbase.py datasets/bat/db_blog/model_configs/claude_3.5_model.yaml |
| 6. | 42976936+mahyareb@users.noreply.github.com | jahnaviii@google.com |
48 shared files
docs/configs/db-config.md datasets/bat/db_blog/run_configs/sqlite/run_ddl.yaml datasets/bat/db_blog/run_configs/postgres/run_ddl.yaml evalbench/databases/postgres.py evalbench/databases/__init__.py datasets/bat/db_blog/prompts/dml.json datasets/bat/db_blog/run_configs/sqlserver/run_ddl.yaml evalbench/reporting/bqstore.py requirements.txt datasets/bat/db_blog/run_configs/mysql/run_dml.yaml datasets/bat/db_blog/db_configs/sqlserver_db_config.yaml evalbench/databases/db.py datasets/bat/db_blog/model_configs/gemini_1.5_flash_model.yaml datasets/bat/db_blog/run_configs/sqlserver/run_dql.yaml evalbench/util/sanitizer.py evalbench/evalbench.py datasets/bat/db_blog/run_configs/mysql/run_dql.yaml evalbench/work/sqlexecwork.py evalbench/generators/prompts/__init__.py evalbench/dataset/dataset.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/generators/models/gemini.py datasets/bat/db_blog/run_configs/postgres/run_dml.yaml datasets/bat/db_blog/run_configs/mysql/run_ddl.yaml datasets/bat/db_blog/run_configs/sqlserver/run_dml.yaml datasets/bat/db_blog/model_configs/gemini_1.0_pro_model.yaml evalbench/databases/bigquery.py evalbench/databases/sqlite.py evalbench/evaluator/db_manager.py datasets/bat/db_blog/model_configs/gemini_2.0_pro_model.yaml docs/configs/run-config.md datasets/bat/db_blog/run_configs/sqlite/run_dml.yaml evalbench/databases/sqlserver.py datasets/bat/db_blog/db_configs/sqlite_db_config.yaml evalbench/generators/prompts/sqlite_dbschema.py datasets/bat/db_blog/run_configs/postgres/run_dql.yaml evalbench/util/config.py datasets/bat/db_blog/run_configs/sqlite/run_dql.yaml datasets/bat/db_blog/model_configs/gemini_2.0_flash_model.yaml evalbench/generators/models/__init__.py datasets/bat/example_run_config.yaml datasets/bat/db_blog/prompts/ddl.json datasets/bat/db_blog/prompts/dql.json evalbench/generators/models/claude.py evalbench/generators/prompts/sqlgenbase.py datasets/bat/db_blog/model_configs/claude_3.5_model.yaml |
| 7. | 90177675+jahnavi2k@users.noreply.github.com | 76586767+dvnshgupta@users.noreply.github.com |
37 shared files
docs/configs/db-config.md datasets/bat/db_blog/run_configs/sqlite/run_ddl.yaml evalbench/databases/__init__.py datasets/bird/example_run_config.yaml datasets/bat/db_blog/prompts/dml.json datasets/model_configs/gemini_1.5_flash_model.yaml datasets/bat/db_blog/setup/sqlite/setup.sql evalbench/databases/db.py datasets/model_configs/gemini_2.0_pro_model.yaml evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/generators/prompts/__init__.py evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py datasets/bird/README.md datasets/model_configs/gemini_2.0_flash_model.yaml evalbench/evaluator/evaluator.py datasets/bird/download_dataset.sh evalbench/databases/sqlite.py docs/examples/GCP_CloudSQL_Example.ipynb docs/configs/run-config.md datasets/model_configs/gemini_1.5-pro-002_model.yaml datasets/model_configs/gemini_1.0_pro_model.yaml datasets/bat/db_blog/run_configs/sqlite/run_dml.yaml datasets/bat/db_blog/db_configs/sqlite_db_config.yaml evalbench/generators/prompts/sqlite_dbschema.py datasets/bird/db_configs/sqlite.yaml datasets/bat/db_blog/setup/sqlite/pre_setup.sql datasets/model_configs/claude_3.5_model.yaml datasets/bat/db_blog/run_configs/sqlite/run_dql.yaml datasets/bat/example_run_config.yaml datasets/bat/db_blog/setup/sqlite/post_setup.sql datasets/bat/db_blog/prompts/ddl.json datasets/bat/db_blog/prompts/dql.json |
| 8. | 76586767+dvnshgupta@users.noreply.github.com | jahnaviii@google.com |
34 shared files
docs/configs/db-config.md datasets/bat/db_blog/run_configs/sqlite/run_ddl.yaml evalbench/databases/__init__.py datasets/bird/example_run_config.yaml datasets/bat/db_blog/prompts/dml.json datasets/model_configs/gemini_1.5_flash_model.yaml datasets/bat/db_blog/setup/sqlite/setup.sql evalbench/databases/db.py datasets/model_configs/gemini_2.0_pro_model.yaml evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/generators/prompts/__init__.py evalbench/dataset/dataset.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py datasets/bird/README.md datasets/model_configs/gemini_2.0_flash_model.yaml datasets/bird/download_dataset.sh evalbench/databases/sqlite.py docs/configs/run-config.md datasets/model_configs/gemini_1.5-pro-002_model.yaml datasets/model_configs/gemini_1.0_pro_model.yaml datasets/bat/db_blog/run_configs/sqlite/run_dml.yaml datasets/bat/db_blog/db_configs/sqlite_db_config.yaml evalbench/generators/prompts/sqlite_dbschema.py datasets/bird/db_configs/sqlite.yaml datasets/bat/db_blog/setup/sqlite/pre_setup.sql datasets/model_configs/claude_3.5_model.yaml datasets/bat/db_blog/run_configs/sqlite/run_dql.yaml datasets/bat/example_run_config.yaml datasets/bat/db_blog/setup/sqlite/post_setup.sql datasets/bat/db_blog/prompts/ddl.json datasets/bat/db_blog/prompts/dql.json |
| 9. | 42976936+mahyareb@users.noreply.github.com | 76586767+dvnshgupta@users.noreply.github.com |
33 shared files
docs/configs/db-config.md datasets/bat/db_blog/run_configs/sqlite/run_ddl.yaml evalbench/databases/__init__.py evalbench/generators/prompts/mysql_dbschema.py datasets/bat/db_blog/prompts/dml.json evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/recallmatcher.py evalbench/databases/db.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/scorers/comparator.py evalbench/generators/prompts/__init__.py evalbench/dataset/dataset.py evalbench/scorers/returnedsql.py evalbench/scorers/score.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/reporting/analyzer.py evalbench/evaluator/evaluator.py evalbench/scorers/exactmatcher.py evalbench/databases/sqlite.py docs/configs/run-config.md datasets/bat/db_blog/run_configs/sqlite/run_dml.yaml datasets/bat/db_blog/db_configs/sqlite_db_config.yaml evalbench/scorers/setmatcher.py evalbench/generators/prompts/sqlite_dbschema.py evalbench/generators/prompts/pg_dbschema.py evalbench/dataset/evalinput.py datasets/bat/db_blog/run_configs/sqlite/run_dql.yaml datasets/bat/example_run_config.yaml datasets/bat/db_blog/prompts/ddl.json datasets/bat/db_blog/prompts/dql.json |
| 10. | 76586767+dvnshgupta@users.noreply.github.com | mebadi@google.com |
33 shared files
docs/configs/db-config.md datasets/bat/db_blog/run_configs/sqlite/run_ddl.yaml evalbench/databases/__init__.py evalbench/generators/prompts/mysql_dbschema.py datasets/bat/db_blog/prompts/dml.json evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/recallmatcher.py evalbench/databases/db.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/scorers/comparator.py evalbench/generators/prompts/__init__.py evalbench/dataset/dataset.py evalbench/scorers/returnedsql.py evalbench/scorers/score.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/reporting/analyzer.py evalbench/evaluator/evaluator.py evalbench/scorers/exactmatcher.py evalbench/databases/sqlite.py docs/configs/run-config.md datasets/bat/db_blog/run_configs/sqlite/run_dml.yaml datasets/bat/db_blog/db_configs/sqlite_db_config.yaml evalbench/scorers/setmatcher.py evalbench/generators/prompts/sqlite_dbschema.py evalbench/generators/prompts/pg_dbschema.py evalbench/dataset/evalinput.py datasets/bat/db_blog/run_configs/sqlite/run_dql.yaml datasets/bat/example_run_config.yaml datasets/bat/db_blog/prompts/ddl.json datasets/bat/db_blog/prompts/dql.json |
| 11. | hardikgupta@google.com | 42976936+mahyareb@users.noreply.github.com |
20 shared files
evalbench/databases/postgres.py evalbench/evalproto/eval_request.proto evalbench/databases/util.py evalbench/generators/prompts/mysql_dbschema.py evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/recallmatcher.py evalbench/scorers/util.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/scorers/comparator.py evalbench/scorers/returnedsql.py evalbench/scorers/score.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/scorers/exactmatcher.py evalbench/databases/sqlserver.py evalbench/generators/prompts/pg_dbschema.py evalbench/dataset/evalinput.py evalbench/databases/alloydb.py |
| 12. | hardikgupta@google.com | mebadi@google.com |
20 shared files
evalbench/databases/postgres.py evalbench/evalproto/eval_request.proto evalbench/databases/util.py evalbench/generators/prompts/mysql_dbschema.py evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/recallmatcher.py evalbench/scorers/util.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/scorers/comparator.py evalbench/scorers/returnedsql.py evalbench/scorers/score.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/scorers/exactmatcher.py evalbench/databases/sqlserver.py evalbench/generators/prompts/pg_dbschema.py evalbench/dataset/evalinput.py evalbench/databases/alloydb.py |
| 13. | 75753836+hardikgu23@users.noreply.github.com | hardikgupta@google.com |
18 shared files
evalbench/databases/postgres.py evalbench/databases/util.py evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/recallmatcher.py evalbench/scorers/util.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/scorers/comparator.py evalbench/scorers/returnedsql.py evalbench/scorers/score.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/scorers/vertextmatcher.py evalbench/scorers/exactmatcher.py evalbench/databases/sqlserver.py evalbench/databases/alloydb.py evalbench/setup_teardown/databaseHandler/mysql_handler.py evalbench/setup_teardown/databaseHandler/postgres_handler.py |
| 14. | 75753836+hardikgu23@users.noreply.github.com | 42976936+mahyareb@users.noreply.github.com |
16 shared files
evalbench/databases/postgres.py evalbench/databases/util.py evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/recallmatcher.py evalbench/scorers/util.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/scorers/comparator.py evalbench/scorers/returnedsql.py evalbench/scorers/score.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/reporting/analyzer.py evalbench/scorers/exactmatcher.py evalbench/databases/sqlserver.py evalbench/databases/alloydb.py |
| 15. | 75753836+hardikgu23@users.noreply.github.com | mebadi@google.com |
16 shared files
evalbench/databases/postgres.py evalbench/databases/util.py evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/recallmatcher.py evalbench/scorers/util.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/scorers/comparator.py evalbench/scorers/returnedsql.py evalbench/scorers/score.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/reporting/analyzer.py evalbench/scorers/exactmatcher.py evalbench/databases/sqlserver.py evalbench/databases/alloydb.py |
| 16. | 76586767+dvnshgupta@users.noreply.github.com | hardikgupta@google.com |
15 shared files
evalbench/generators/prompts/mysql_dbschema.py evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/recallmatcher.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/scorers/comparator.py evalbench/scorers/returnedsql.py evalbench/scorers/score.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/scorers/vertextmatcher.py evalbench/scorers/exactmatcher.py evalbench/generators/prompts/pg_dbschema.py evalbench/dataset/evalinput.py |
| 17. | hailong.leon@gmail.com | 42976936+mahyareb@users.noreply.github.com |
13 shared files
evalbench/databases/postgres.py evalbench/databases/util.py requirements.txt evalbench/databases/db.py evalbench/scorers/util.py evalbench/work/sqlexecwork.py evalbench/scorers/score.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/reporting/analyzer.py evalbench/databases/sqlserver.py evalbench/scorers/setmatcher.py evalbench/databases/alloydb.py |
| 18. | hailong.leon@gmail.com | mebadi@google.com |
13 shared files
evalbench/databases/postgres.py evalbench/databases/util.py requirements.txt evalbench/databases/db.py evalbench/scorers/util.py evalbench/work/sqlexecwork.py evalbench/scorers/score.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/reporting/analyzer.py evalbench/databases/sqlserver.py evalbench/scorers/setmatcher.py evalbench/databases/alloydb.py |
| 19. | 76586767+dvnshgupta@users.noreply.github.com | dvnshgupta@google.com |
13 shared files
evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/recallmatcher.py evalbench/scorers/comparator.py evalbench/scorers/returnedsql.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/reporting/analyzer.py evalbench/evaluator/evaluator.py evalbench/scorers/vertextmatcher.py evalbench/scorers/exactmatcher.py docs/examples/GCP_CloudSQL_Example.ipynb evalbench/scorers/setmatcher.py evalbench/dataset/evalinput.py |
| 20. | 75753836+hardikgu23@users.noreply.github.com | 76586767+dvnshgupta@users.noreply.github.com |
12 shared files
evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/recallmatcher.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/scorers/comparator.py evalbench/scorers/returnedsql.py evalbench/scorers/score.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/reporting/analyzer.py evalbench/scorers/vertextmatcher.py evalbench/scorers/exactmatcher.py |
| 21. | mebadi@google.com | dvnshgupta@google.com |
11 shared files
evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/recallmatcher.py evalbench/scorers/comparator.py evalbench/scorers/returnedsql.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/reporting/analyzer.py evalbench/evaluator/evaluator.py evalbench/scorers/exactmatcher.py evalbench/scorers/setmatcher.py evalbench/dataset/evalinput.py |
| 22. | dvnshgupta@google.com | 42976936+mahyareb@users.noreply.github.com |
11 shared files
evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/recallmatcher.py evalbench/scorers/comparator.py evalbench/scorers/returnedsql.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/reporting/analyzer.py evalbench/evaluator/evaluator.py evalbench/scorers/exactmatcher.py evalbench/scorers/setmatcher.py evalbench/dataset/evalinput.py |
| 23. | 75753836+hardikgu23@users.noreply.github.com | hailong.leon@gmail.com |
10 shared files
evalbench/databases/postgres.py evalbench/databases/util.py evalbench/scorers/util.py evalbench/work/sqlexecwork.py evalbench/scorers/score.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/reporting/analyzer.py evalbench/databases/sqlserver.py evalbench/databases/alloydb.py |
| 24. | 42976936+mahyareb@users.noreply.github.com | prernakakkar@google.com |
10 shared files
evalbench/evalproto/eval_request.proto evalbench/repository/nldRepo.py evalbench/configs/base_experiment_nl2code_hibernate.yaml evalbench/evalproto/eval_response.proto evalbench/evalproto/eval_config.proto evalbench/configs/base_experiment_nl2code_jdbc.yaml evalbench/configs/db/nl2code_postgres.yaml evalbench/repository/__init__.py evalbench/evalproto/eval_connect.proto evalbench/evalproto/eval_service.proto |
| 25. | 42976936+mahyareb@users.noreply.github.com | 158031829+prernakakkar-google@users.noreply.github.com |
10 shared files
evalbench/evalproto/eval_request.proto evalbench/repository/nldRepo.py evalbench/configs/base_experiment_nl2code_hibernate.yaml evalbench/evalproto/eval_response.proto evalbench/evalproto/eval_config.proto evalbench/configs/base_experiment_nl2code_jdbc.yaml evalbench/configs/db/nl2code_postgres.yaml evalbench/repository/__init__.py evalbench/evalproto/eval_connect.proto evalbench/evalproto/eval_service.proto |
| 26. | prernakakkar@google.com | 158031829+prernakakkar-google@users.noreply.github.com |
10 shared files
evalbench/evalproto/eval_request.proto evalbench/repository/nldRepo.py evalbench/configs/base_experiment_nl2code_hibernate.yaml evalbench/evalproto/eval_response.proto evalbench/evalproto/eval_config.proto evalbench/configs/base_experiment_nl2code_jdbc.yaml evalbench/configs/db/nl2code_postgres.yaml evalbench/repository/__init__.py evalbench/evalproto/eval_connect.proto evalbench/evalproto/eval_service.proto |
| 27. | hardikgupta@google.com | hailong.leon@gmail.com |
9 shared files
evalbench/databases/postgres.py evalbench/databases/util.py evalbench/scorers/util.py evalbench/work/sqlexecwork.py evalbench/scorers/score.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/databases/sqlserver.py evalbench/databases/alloydb.py |
| 28. | hardikgupta@google.com | dvnshgupta@google.com |
9 shared files
evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/recallmatcher.py evalbench/scorers/comparator.py evalbench/scorers/returnedsql.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/scorers/vertextmatcher.py evalbench/scorers/exactmatcher.py evalbench/dataset/evalinput.py |
| 29. | 75753836+hardikgu23@users.noreply.github.com | dvnshgupta@google.com |
9 shared files
evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/recallmatcher.py evalbench/scorers/comparator.py evalbench/scorers/returnedsql.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/reporting/analyzer.py evalbench/scorers/vertextmatcher.py evalbench/scorers/exactmatcher.py |
| 30. | 42976936+mahyareb@users.noreply.github.com | m1378.prz@gmail.com |
8 shared files
docs/configs/db-config.md evalbench/databases/__init__.py evalbench/generators/models/alloydb_ai_nl.py evalbench/evaluator/orchestrator.py datasets/bat/db_configs/alloydb.yaml evalbench/databases/bigquery.py evalbench/databases/alloydb.py evalbench/generators/models/__init__.py |
| 31. | hardikgupta@google.com | 90177675+jahnavi2k@users.noreply.github.com |
8 shared files
evalbench/databases/postgres.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/scorers/score.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/databases/sqlserver.py |
| 32. | hailong.leon@gmail.com | 90177675+jahnavi2k@users.noreply.github.com |
8 shared files
evalbench/databases/postgres.py requirements.txt evalbench/databases/db.py evalbench/work/sqlexecwork.py evalbench/scorers/score.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/databases/sqlserver.py |
| 33. | 75753836+hardikgu23@users.noreply.github.com | 90177675+jahnavi2k@users.noreply.github.com |
7 shared files
evalbench/databases/postgres.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/scorers/score.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/databases/sqlserver.py |
| 34. | hardikgupta@google.com | jahnaviii@google.com |
7 shared files
evalbench/databases/postgres.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/databases/sqlserver.py |
| 35. | hailong.leon@gmail.com | jahnaviii@google.com |
7 shared files
evalbench/databases/postgres.py requirements.txt evalbench/databases/db.py evalbench/work/sqlexecwork.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/databases/sqlserver.py |
| 36. | hailong.leon@gmail.com | 76586767+dvnshgupta@users.noreply.github.com |
7 shared files
evalbench/databases/db.py evalbench/work/sqlexecwork.py evalbench/scorers/score.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/reporting/analyzer.py evalbench/scorers/setmatcher.py |
| 37. | 75753836+hardikgu23@users.noreply.github.com | jahnaviii@google.com |
6 shared files
evalbench/databases/postgres.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/databases/mysql.py evalbench/scorers/llmrater.py evalbench/databases/sqlserver.py |
| 38. | 51998522+viditchopra1500@users.noreply.github.com | viditchopra@google.com |
6 shared files
evalbench/configs/newDatasetFormat.yaml evalbench/scorers/util.py evalbench/scorers/llmrater.py evalbench/configs/base_experiment_gemini.yaml evalbench/configs/base_experiment_service.yaml evalbench/configs/base_experiment_magick.yaml |
| 39. | m1378.prz@gmail.com | 90177675+jahnavi2k@users.noreply.github.com |
5 shared files
docs/configs/db-config.md evalbench/databases/__init__.py evalbench/evaluator/orchestrator.py evalbench/databases/bigquery.py evalbench/generators/models/__init__.py |
| 40. | m1378.prz@gmail.com | mebadi@google.com |
5 shared files
docs/configs/db-config.md evalbench/databases/__init__.py evalbench/evaluator/orchestrator.py evalbench/databases/alloydb.py evalbench/generators/models/__init__.py |
| 41. | m1378.prz@gmail.com | jahnaviii@google.com |
4 shared files
docs/configs/db-config.md evalbench/databases/__init__.py evalbench/databases/bigquery.py evalbench/generators/models/__init__.py |
| 42. | hailong.leon@gmail.com | dvnshgupta@google.com |
4 shared files
evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/reporting/analyzer.py evalbench/scorers/setmatcher.py |
| 43. | dvnshgupta@google.com | 90177675+jahnavi2k@users.noreply.github.com |
4 shared files
evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/evaluator/evaluator.py docs/examples/GCP_CloudSQL_Example.ipynb |
| 44. | mebadi@google.com | prernakakkar@google.com |
3 shared files
evalbench/evalproto/eval_request.proto evalbench/repository/nldRepo.py evalbench/evalproto/eval_service.proto |
| 45. | mebadi@google.com | 158031829+prernakakkar-google@users.noreply.github.com |
3 shared files
evalbench/evalproto/eval_request.proto evalbench/repository/nldRepo.py evalbench/evalproto/eval_service.proto |
| 46. | m1378.prz@gmail.com | 76586767+dvnshgupta@users.noreply.github.com |
2 shared files
docs/configs/db-config.md evalbench/databases/__init__.py |
| 47. | 51998522+viditchopra1500@users.noreply.github.com | hardikgupta@google.com |
2 shared files
evalbench/scorers/util.py evalbench/scorers/llmrater.py |
| 48. | 51998522+viditchopra1500@users.noreply.github.com | 75753836+hardikgu23@users.noreply.github.com |
2 shared files
evalbench/scorers/util.py evalbench/scorers/llmrater.py |
| 49. | 51998522+viditchopra1500@users.noreply.github.com | hailong.leon@gmail.com |
2 shared files
evalbench/scorers/util.py evalbench/scorers/llmrater.py |
| 50. | 51998522+viditchopra1500@users.noreply.github.com | mebadi@google.com |
2 shared files
evalbench/scorers/util.py evalbench/scorers/llmrater.py |
| 51. | 51998522+viditchopra1500@users.noreply.github.com | 42976936+mahyareb@users.noreply.github.com |
2 shared files
evalbench/scorers/util.py evalbench/scorers/llmrater.py |
| 52. | viditchopra@google.com | hardikgupta@google.com |
2 shared files
evalbench/scorers/util.py evalbench/scorers/llmrater.py |
| 53. | viditchopra@google.com | 75753836+hardikgu23@users.noreply.github.com |
2 shared files
evalbench/scorers/util.py evalbench/scorers/llmrater.py |
| 54. | viditchopra@google.com | hailong.leon@gmail.com |
2 shared files
evalbench/scorers/util.py evalbench/scorers/llmrater.py |
| 55. | viditchopra@google.com | mebadi@google.com |
2 shared files
evalbench/scorers/util.py evalbench/scorers/llmrater.py |
| 56. | viditchopra@google.com | 42976936+mahyareb@users.noreply.github.com |
2 shared files
evalbench/scorers/util.py evalbench/scorers/llmrater.py |
| 57. | 42976936+mahyareb@users.noreply.github.com | hailongli@google.com |
2 shared files
evalbench/scorers/score.py evalbench/scorers/setmatcher.py |
| 58. | hailong.leon@gmail.com | hailongli@google.com |
2 shared files
evalbench/scorers/score.py evalbench/scorers/setmatcher.py |
| 59. | hailongli@google.com | mebadi@google.com |
2 shared files
evalbench/scorers/score.py evalbench/scorers/setmatcher.py |
| 60. | hailongli@google.com | dvnshgupta@google.com |
2 shared files
evalbench/scorers/score.py evalbench/scorers/setmatcher.py |
| 61. | hailongli@google.com | 76586767+dvnshgupta@users.noreply.github.com |
2 shared files
evalbench/scorers/score.py evalbench/scorers/setmatcher.py |
| 62. | hardikgupta@google.com | prernakakkar@google.com |
1 shared file
evalbench/evalproto/eval_request.proto |
| 63. | hardikgupta@google.com | 158031829+prernakakkar-google@users.noreply.github.com |
1 shared file
evalbench/evalproto/eval_request.proto |
| 64. | hardikgupta@google.com | hailongli@google.com |
1 shared file
evalbench/scorers/score.py |
| 65. | 75753836+hardikgu23@users.noreply.github.com | hailongli@google.com |
1 shared file
evalbench/scorers/score.py |
| 66. | hailongli@google.com | 90177675+jahnavi2k@users.noreply.github.com |
1 shared file
evalbench/scorers/score.py |
| 67. | viditchopra@google.com | 76586767+dvnshgupta@users.noreply.github.com |
1 shared file
evalbench/scorers/llmrater.py |
| 68. | viditchopra@google.com | dvnshgupta@google.com |
1 shared file
evalbench/scorers/llmrater.py |
| 69. | viditchopra@google.com | 90177675+jahnavi2k@users.noreply.github.com |
1 shared file
evalbench/scorers/llmrater.py |
| 70. | viditchopra@google.com | jahnaviii@google.com |
1 shared file
evalbench/scorers/llmrater.py |
| 71. | 51998522+viditchopra1500@users.noreply.github.com | 76586767+dvnshgupta@users.noreply.github.com |
1 shared file
evalbench/scorers/llmrater.py |
| 72. | 51998522+viditchopra1500@users.noreply.github.com | dvnshgupta@google.com |
1 shared file
evalbench/scorers/llmrater.py |
| 73. | 51998522+viditchopra1500@users.noreply.github.com | 90177675+jahnavi2k@users.noreply.github.com |
1 shared file
evalbench/scorers/llmrater.py |
| 74. | 51998522+viditchopra1500@users.noreply.github.com | jahnaviii@google.com |
1 shared file
evalbench/scorers/llmrater.py |
| 75. | dvnshgupta@google.com | jahnaviii@google.com |
1 shared file
evalbench/scorers/llmrater.py |
| 76. | 75753836+hardikgu23@users.noreply.github.com | m1378.prz@gmail.com |
1 shared file
evalbench/databases/alloydb.py |
| 77. | hardikgupta@google.com | m1378.prz@gmail.com |
1 shared file
evalbench/databases/alloydb.py |
| 78. | hailong.leon@gmail.com | m1378.prz@gmail.com |
1 shared file
evalbench/databases/alloydb.py |
| 79. | mebadi@google.com | ismailmehdi@gmail.com |
1 shared file
datasets/bat/example_run_config.yaml |
| 80. | jahnaviii@google.com | ismailmehdi@gmail.com |
1 shared file
datasets/bat/example_run_config.yaml |
| 81. | 90177675+jahnavi2k@users.noreply.github.com | ismailmehdi@gmail.com |
1 shared file
datasets/bat/example_run_config.yaml |
| 82. | 42976936+mahyareb@users.noreply.github.com | ismailmehdi@gmail.com |
1 shared file
datasets/bat/example_run_config.yaml |
| 83. | 76586767+dvnshgupta@users.noreply.github.com | ismailmehdi@gmail.com |
1 shared file
datasets/bat/example_run_config.yaml |
| Contributor | # connections | # commits | |
|---|---|---|---|
| 1. | mebadi@google.com | 15 | 135 |
| 2. | 42976936+mahyareb@users.noreply.github.com | 15 | 57 |
| 3. | hardikgupta@google.com | 14 | 18 |
| 4. | 90177675+jahnavi2k@users.noreply.github.com | 13 | 23 |
| 5. | 76586767+dvnshgupta@users.noreply.github.com | 13 | 22 |
| 6. | jahnaviii@google.com | 12 | 46 |
| 7. | 75753836+hardikgu23@users.noreply.github.com | 12 | 9 |
| 8. | hailong.leon@gmail.com | 12 | 3 |
| 9. | dvnshgupta@google.com | 11 | 26 |
| 10. | viditchopra@google.com | 10 | 2 |
| 11. | 51998522+viditchopra1500@users.noreply.github.com | 10 | 2 |
| 12. | m1378.prz@gmail.com | 8 | 5 |
| 13. | hailongli@google.com | 8 | 1 |
| 14. | ismailmehdi@gmail.com | 5 | 2 |
| 15. | prernakakkar@google.com | 4 | 5 |
| 16. | 158031829+prernakakkar-google@users.noreply.github.com | 4 | 3 |
C-median: 11.5
A half of the contributors has more than 11.5 connections, and a half has less than this number.
C-mean: 10.3
An average number of connections a contributor has with other contributors.
C-index: 10.0
There are 10.0 contributors with 10.0 or more connections.
19 contributors (524 commits):
| # | Contributor |
First Commit |
Latest Commit |
Commits Count |
|---|---|---|---|---|
| 1. | mebadi@google.com | 2024-09-28 | 2025-04-03 | 142 (27%) |
| 2. | hardikgupta@google.com | 2024-09-01 | 2025-03-21 | 100 (19%) |
| 3. | 42976936+mahyareb@users.noreply.github.com | 2024-09-28 | 2025-04-29 | 67 (12%) |
| 4. | jahnaviii@google.com | 2025-02-11 | 2025-04-28 | 46 (8%) |
| 5. | 75753836+hardikgu23@users.noreply.github.com | 2024-09-01 | 2025-03-21 | 36 (6%) |
| 6. | dvnshgupta@google.com | 2025-02-13 | 2025-04-21 | 26 (4%) |
| 7. | 90177675+jahnavi2k@users.noreply.github.com | 2025-02-13 | 2025-04-28 | 23 (4%) |
| 8. | 76586767+dvnshgupta@users.noreply.github.com | 2025-02-14 | 2025-04-21 | 22 (4%) |
| 9. | ismailmehdi@gmail.com | 2024-07-31 | 2025-04-22 | 18 (3%) |
| 10. | viditchopra@google.com | 2024-08-22 | 2024-11-15 | 11 (2%) |
| 11. | 51998522+viditchopra1500@users.noreply.github.com | 2024-08-30 | 2024-11-18 | 8 (1%) |
| 12. | prernakakkar@google.com | 2024-09-09 | 2025-01-24 | 6 (1%) |
| 13. | m1378.prz@gmail.com | 2025-04-28 | 2025-04-29 | 5 (<1%) |
| 14. | 158031829+prernakakkar-google@users.noreply.github.com | 2024-09-10 | 2025-01-27 | 4 (<1%) |
| 15. | yangtian@google.com | 2024-08-20 | 2024-10-01 | 4 (<1%) |
| 16. | hailong.leon@gmail.com | 2024-12-07 | 2025-01-16 | 3 (<1%) |
| 17. | hailongli@google.com | 2024-12-07 | 2024-12-07 | 1 (<1%) |
| 18. | mahyar@google.com | 2024-09-28 | 2024-09-28 | 1 (<1%) |
| 19. | ismailmehdi@google.com | 2024-05-23 | 2024-05-23 | 1 (<1%) |
A contributor dependency is detected if two contributors have changed the same files in the past 365 days.
The number on lines shows the number of same files that both persons changed in past 365 days.
| Contributor 1 | Contributor 2 | # shared files | |
|---|---|---|---|
| 1. | 75753836+hardikgu23@users.noreply.github.com | hardikgupta@google.com |
342 shared files
evalbench/setup_teardown/datasets/bat/db_finance/tbl_liabilities.csv evalbench/setup-teardown/datasets/bat/db_finance/tbl_expenses.csv evalbench/setup-teardown/datasets/bat/db_hr/holiday.csv evalbench/setup-teardown/run.sh evalbench/setup-teardown/datasets/bat/db_hr/job.csv evalbench/setup_teardown/datasets/bat/db_blog/tbl_private_messages.csv evalbench/setup_teardown/datasets/bat/db_chat/tbl_sessions.csv evalbench/dataset/eval_format_verifier/eval_format_verifier.py evalbench/databases/postgres.py evalbench/setup-teardown/datasets/bat/db_blog/tbl_notifications.csv evalbench/databases/__init__.py evalbench/configs/newDatasetFormat.yaml evalbench/setup-teardown/datasets/bat/db_hr/employee_training.csv evalbench/setup-teardown/datasets/bat/db_chat/tbl_users.csv evalbench/evalproto/eval_request.proto evalbench/setup_teardown/datasets/bat/db_chat/tbl_user_roles.csv evalbench/setup_teardown/datasets/bat/db_finance/tbl_currency_exchange_x_user.csv evalbench/setup_teardown/checksum/db_ecommerce_mysql.csv evalbench/scorers/generatedqueryregexpmatcher.py evalbench/setup_teardown/datasets/bat/db_finance/tbl_currency_exchange.csv evalbench/setup_teardown/datasets/bat/db_chat/tbl_notifications.csv evalbench/setup_teardown/datasets/bat/db_blog/tbl_followers.csv evalbench/setup_teardown/datasets/bat/db_ecommerce/tbl_categories.csv evalbench/setup_teardown/datasets/bat/db_ecommerce/tbl_products.csv evalbench/setup_teardown/datasets/bat/db_finance/tbl_bank.csv evalbench/setup_teardown/datasets/bat/db_chat/tbl_permissions.csv evalbench/setup_teardown/datasets/bat/db_chat/tbl_user_blocks.csv evalbench/setup_teardown/datasets/bat/db_ecommerce/tbl_shipping.csv evalbench/setup_teardown/datasets/bat/db_ecommerce/tbl_orders.csv evalbench/setup_teardown/schema_details/schema_detail.proto evalbench/setup_teardown/datasets/bat/db_hr/holiday.csv evalbench/setup_teardown/datasets/bat/db_hr/employee_termination.csv evalbench/setup_teardown/datasets/bat/db_finance/tbl_login.csv evalbench/setup-teardown/datasets/bat/db_hr/timesheet_employee.csv evalbench/setup-teardown/datasets/bat/db_hr/employee_allowances.csv evalbench/setup-teardown/datasets/bat/db_ecommerce/tbl_seller.csv evalbench/setup-teardown/datasets/bat/db_ecommerce/tbl_brands.csv evalbench/setup_teardown/datasets/bat/db_blog/tbl_reports.csv evalbench/setup_teardown/checksum/db_blog_mysql.csv evalbench/setup_teardown/datasets/bat/db_chat/tbl_status.csv evalbench/setup_teardown/datasets/bat/db_chat/tbl_conversations.csv evalbench/setup-teardown/datasets/bat/db_blog/tbl_posts.csv evalbench/setup_teardown/datasets/bat/db_hr/benefit.csv evalbench/configs/model/base_nl2code_model.yaml evalbench/setup_teardown/datasets/bat/db_chat/tbl_conversations_history.csv evalbench/setup-teardown/datasets/bat/db_hr/employee_computer.csv evalbench/scorers/util.py evalbench/dataset/util.py evalbench/setup-teardown/datasets/bat/db_hr/department.csv evalbench/setup_teardown/datasets/bat/db_hr/job_history.csv evalbench/setup-teardown/schema_details/bat/db_blog/setup.yaml evalbench/setup-teardown/datasets/bat/db_blog/tbl_labels.csv evalbench/setup-teardown/datasets/bat/db_chat/tbl_user_statistics.csv evalbench/scorers/comparator.py evalbench/setup_teardown/datasets/bat/db_finance/tbl_user.csv evalbench/configs/base_experiment_nl2code_hibernate.yaml evalbench/setup_teardown/datasets/bat/db_ecommerce/tbl_roles.csv evalbench/dataset/dataset.py evalbench/repository/base.py evalbench/setup-teardown/datasets/bat/db_blog/tbl_private_messages.csv evalbench/setup-teardown/schema_detail_pb2.py evalbench/setup_teardown/datasets/bat/db_blog/tbl_posts_tags.csv evalbench/setup-teardown/schema_details/bat/db_chat/setup.yaml evalbench/setup_teardown/checksum/db_hr_mysql.csv evalbench/setup_teardown/datasets/bat/db_ecommerce/tbl_addresses.csv evalbench/setup_teardown/datasets/bat/db_finance/tbl_payment_method.csv evalbench/setup-teardown/datasets/bat/db_ecommerce/tbl_product_images.csv evalbench/setup_teardown/schema_details/bat/db_finance/mysql.textproto evalbench/setup-teardown/datasets/bat/db_finance/tbl_user.csv evalbench/setup-teardown/datasets/bat/db_hr/employee_x_benefit.csv evalbench/setup-teardown/datasets/bat/db_blog/tbl_followers.csv evalbench/setup-teardown/datasets/bat/db_chat/tbl_blocked_keywords.csv evalbench/scorers/score.py evalbench/setup_teardown/datasets/bat/db_ecommerce/tbl_messages.csv evalbench/setup_teardown/datasets/bat/db_blog/tbl_attachments.csv evalbench/setup-teardown/schema_details/bat/db_chat/postgres.textproto evalbench/run.sh evalbench/setup_teardown/datasets/bat/db_hr/attendance.csv evalbench/setup-teardown/datasets/bat/db_blog/tbl_categories.csv evalbench/scorers/llmrater.py evalbench/dataset/eval_format_verifier/eval_format_verifier_test.py evalbench/setup-teardown/schema_details/bat/db_hr/setup.yaml evalbench/setup-teardown/schema_details/bat/db_hr/mysql.textproto evalbench/setup-teardown/schema_details/bat/db_ecommerce/mysql.textproto evalbench/setup-teardown/datasets/bat/db_finance/tbl_currency_exchange_x_user.csv evalbench/setup-teardown/datasets/bat/db_hr/leave_request.csv evalbench/setup_teardown/schema_details/bat/db_ecommerce/setup.yaml evalbench/setup-teardown/databaseHandler/__init__.py evalbench/setup-teardown/datasets/bat/db_chat/tbl_friend_requests.csv evalbench/setup-teardown/datasets/bat/db_blog/tbl_status.csv evalbench/setup_teardown/databaseHandler/__init__.py evalbench/setup_teardown/checksum/db_ecommerce_postgres.csv evalbench/setup-teardown/datasets/bat/db_hr/invoice.csv evalbench/setup_teardown/datasets/bat/db_ecommerce/tbl_notifications.csv evalbench/setup-teardown/datasets/bat/db_hr/timesheet.csv evalbench/setup_teardown/datasets/bat/db_blog/tbl_tags_hierarchy.csv evalbench/setup_teardown/datasets/bat/db_chat/tbl_message_reports.csv evalbench/setup-teardown/datasets/bat/db_finance/tbl_reports.csv evalbench/setup-teardown/datasets/bat/db_ecommerce/tbl_reviews.csv evalbench/setup-teardown/datasets/bat/db_finance/tbl_comm_funds_x_user.csv ... |
| 2. | 42976936+mahyareb@users.noreply.github.com | mebadi@google.com |
139 shared files
docs/configs/db-config.md datasets/bat/db_blog/setup/mysql/setup.sql datasets/bat/db_blog/setup/data/tbl_status.csv datasets/bat/db_blog/setup/postgres/post_setup.sql evalbench/util/loghandler.py datasets/bat/db_blog/run_configs/sqlite/run_ddl.yaml datasets/bat/db_blog/run_configs/postgres/run_ddl.yaml evalbench/dataset/eval_format_verifier/eval_format_verifier.py evalbench/util/rate_limit.py evalbench/databases/postgres.py evalbench/databases/__init__.py evalbench/evalproto/eval_request.proto evalbench/generators/prompts/mysql_dbschema.py evalbench/scorers/generatedqueryregexpmatcher.py datasets/bat/db_blog/run_configs/sqlserver/run_ddl.yaml evalbench/reporting/bqstore.py datasets/bat/db_blog/setup/data/tbl_reports.csv datasets/bat/db_blog/model_configs/base_gemini_model.yaml datasets/bat/db_blog/setup/data/tbl_attachments.csv evalbench/scorers/executablesql.py datasets/bat/db_blog/db_configs/sqlserver_db_config.yaml datasets/bat/model_configs/gemini_2.0_pro_model.yaml docs/configs/model-config.md evalbench/scorers/util.py evalbench/dataset/util.py evalbench_service/Dockerfile datasets/bat/db_blog/run_configs/mysql/run_dql.yaml evalbench/scorers/comparator.py evalbench/repository/nldRepo.py evalbench/dataset/dataset.py datasets/bat/db_blog/setup/data/tbl_user_activity.csv evalbench/scorers/score.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/run.sh datasets/bat/db_blog/setup/data/tbl_followers.csv evalbench/generators/models/passthrough.py datasets/bat/db_blog/setup/data/tbl_private_messages.csv evalbench/scorers/llmrater.py evalbench/dataset/eval_format_verifier/eval_format_verifier_test.py datasets/bat/db_blog/setup/data/tbl_posts_tags.csv datasets/bat/db_blog/setup/data/tbl_country.csv datasets/bat/db_blog/run_configs/sqlserver/run_dml.yaml evalbench/work/scorework.py datasets/bat/db_blog/model_configs/gemini_1.0_pro_model.yaml evalbench/scorers/exactmatcher.py evalbench_service/k8s/evalbench.yaml datasets/bat/db_blog/db_configs/mysql_db_config.yaml docs/configs/run-config.md datasets/bat/db_blog/run_configs/sqlite/run_dml.yaml evalbench/databases/sqlserver.py evalbench/evaluator/progress_reporter.py datasets/bat/db_blog/db_configs/sqlite_db_config.yaml evalbench/scorers/setmatcher.py evalbench/generators/prompts/sqlite_dbschema.py evalbench/generators/prompts/pg_dbschema.py datasets/bat/db_blog/setup/data/tbl_notifications.csv evalbench/dataset/evalinput.py evalbench/databases/alloydb.py evalbench/util/config.py datasets/bat/db_blog/run_configs/sqlite/run_dql.yaml datasets/bat/db_blog/model_configs/gemini_2.0_flash_model.yaml README.md datasets/bat/db_blog/setup/data/tbl_categories.csv evalbench/generators/models/__init__.py evalbench_service/k8s/vertical-autoscale-test.yaml datasets/bat/db_blog/db_configs/postgres_db_config.yaml datasets/bat/db_blog/prompts/ddl.json pyproject.toml datasets/bat/db_blog/setup/data/tbl_media.csv evalbench/generators/prompts/sqlgenbase.py datasets/bat/db_blog/model_configs/claude_3.5_model.yaml evalbench/evalproto/eval_service.proto datasets/bat/model_configs/gemini_2.0_flash_model.yaml evalbench/databases/util.py datasets/bat/db_blog/setup/mysql/post_setup.sql datasets/bat/db_blog/prompts/dml.json docs/examples/sqlite_example.ipynb datasets/bat/db_blog/setup/mysql/pre_setup.sql docs/configs/dataset-config.md datasets/bat/model_configs/gemini_1.5-pro-002_model.yaml requirements.txt evalbench/reporting/__init__.py evalbench/scorers/recallmatcher.py evalbench/generators/prompts/generator.py datasets/bat/db_blog/setup/data/tbl_user_roles.csv evalbench/work/work.py datasets/bat/db_blog/run_configs/mysql/run_dml.yaml evalbench/databases/db.py evalbench/generators/models/openai.py evalbench/evaluator/orchestrator.py datasets/bat/db_blog/model_configs/gemini_1.5_flash_model.yaml datasets/bat/db_blog/run_configs/sqlserver/run_dql.yaml evalbench/util/sanitizer.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/generators/prompts/__init__.py evalbench/test/sessionmgr_test.py evalbench/scorers/returnedsql.py .gitignore datasets/bat/db_blog/setup/data/tbl_posts.csv ... |
| 3. | 90177675+jahnavi2k@users.noreply.github.com | mebadi@google.com |
99 shared files
docs/configs/db-config.md evalbench/util/loghandler.py datasets/bat/db_blog/run_configs/sqlite/run_ddl.yaml datasets/bat/db_blog/run_configs/postgres/run_ddl.yaml evalbench/databases/postgres.py evalbench/databases/__init__.py datasets/bat/db_configs/postgres.yaml datasets/bat/setup/db_blog/data/tbl_posts.csv datasets/bat/db_blog/run_configs/sqlserver/run_ddl.yaml evalbench/reporting/bqstore.py datasets/bat/setup/db_blog/sqlite/setup.sql evalbench/scorers/executablesql.py datasets/bat/db_blog/db_configs/sqlserver_db_config.yaml datasets/bat/model_configs/gemini_2.0_pro_model.yaml docs/configs/model-config.md datasets/bat/setup/db_blog/sqlserver/setup.sql datasets/bat/db_blog/run_configs/mysql/run_dql.yaml evalbench/dataset/dataset.py datasets/bat/setup/db_blog/data/tbl_reactions.csv evalbench/scorers/score.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/scorers/llmrater.py datasets/bat/db_configs/sqlserver.yaml datasets/bat/setup/db_blog/sqlite/pre_setup.sql datasets/bat/model_configs/gemini_1.5_flash_model.yaml datasets/bat/setup/db_blog/data/tbl_posts_tags.csv datasets/bat/db_blog/run_configs/sqlserver/run_dml.yaml datasets/bat/db_blog/model_configs/gemini_1.0_pro_model.yaml datasets/bat/setup/db_blog/sqlserver/pre_setup.sql datasets/bat/setup/db_blog/mysql/setup.sql docs/configs/run-config.md datasets/bat/setup/db_blog/data/tbl_media.csv datasets/bat/db_blog/run_configs/sqlite/run_dml.yaml evalbench/databases/sqlserver.py datasets/bat/setup/db_blog/postgres/post_setup.sql datasets/bat/db_blog/db_configs/sqlite_db_config.yaml datasets/bat/setup/db_blog/mysql/post_setup.sql evalbench/generators/prompts/sqlite_dbschema.py datasets/bat/setup/db_blog/data/tbl_status.csv datasets/bat/setup/db_blog/data/tbl_comments.csv evalbench/util/config.py datasets/bat/db_blog/run_configs/sqlite/run_dql.yaml datasets/bat/db_blog/model_configs/gemini_2.0_flash_model.yaml README.md evalbench/generators/models/__init__.py datasets/bat/setup/db_blog/data/tbl_followers.csv datasets/bat/db_blog/prompts/ddl.json evalbench/generators/prompts/sqlgenbase.py datasets/bat/setup/db_blog/data/tbl_notifications.csv datasets/bat/db_blog/model_configs/claude_3.5_model.yaml datasets/bat/setup/db_blog/data/tbl_reports.csv datasets/bat/setup/db_blog/data/tbl_country.csv datasets/bat/setup/db_blog/postgres/setup.sql datasets/bat/model_configs/gemini_2.0_flash_model.yaml datasets/bat/setup/db_blog/sqlserver/post_setup.sql datasets/bat/db_blog/prompts/dml.json docs/examples/sqlite_example.ipynb docs/configs/dataset-config.md datasets/bat/model_configs/gemini_1.5-pro-002_model.yaml requirements.txt datasets/bat/model_configs/claude_3.5_model.yaml datasets/bat/setup/db_blog/data/tbl_user_activity.csv datasets/bat/db_configs/sqlite.yaml datasets/bat/db_blog/run_configs/mysql/run_dml.yaml evalbench/databases/db.py evalbench/evaluator/orchestrator.py datasets/bat/setup/db_blog/data/tbl_tags.csv datasets/bat/db_blog/model_configs/gemini_1.5_flash_model.yaml datasets/bat/db_blog/run_configs/sqlserver/run_dql.yaml evalbench/util/sanitizer.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/generators/prompts/__init__.py datasets/bat/setup/db_blog/postgres/pre_setup.sql datasets/bat/prompts.json datasets/bat/db_configs/mysql.yaml datasets/bat/setup/db_blog/data/tbl_categories.csv evalbench/databases/mysql.py evalbench/generators/models/gemini.py datasets/bat/db_blog/run_configs/postgres/run_dml.yaml datasets/bat/db_blog/run_configs/mysql/run_ddl.yaml datasets/bat/setup/db_blog/data/tbl_users.csv datasets/bat/setup/db_blog/data/tbl_user_roles.csv evalbench/evaluator/evaluator.py evalbench/reporting/report.py datasets/bat/setup/db_blog/data/tbl_labels.csv datasets/bat/setup/db_blog/mysql/pre_setup.sql evalbench/databases/sqlite.py evalbench/evaluator/db_manager.py datasets/bat/db_blog/model_configs/gemini_2.0_pro_model.yaml datasets/bat/model_configs/gemini_1.0_pro_model.yaml datasets/bat/setup/db_blog/data/tbl_attachments.csv datasets/bat/setup/db_blog/sqlite/post_setup.sql datasets/bat/setup/db_blog/data/tbl_private_messages.csv datasets/bat/db_blog/run_configs/postgres/run_dql.yaml datasets/bat/example_run_config.yaml datasets/bat/db_blog/prompts/dql.json evalbench/generators/models/claude.py datasets/bat/setup/db_blog/data/tbl_tags_hierarchy.csv |
| 4. | 90177675+jahnavi2k@users.noreply.github.com | jahnaviii@google.com |
73 shared files
docs/configs/db-config.md datasets/bat/db_blog/run_configs/sqlite/run_ddl.yaml datasets/bat/db_blog/run_configs/postgres/run_ddl.yaml evalbench/databases/postgres.py evalbench/databases/__init__.py datasets/bat/setup/db_blog/bigquery/pre_setup.sql run_client.sh datasets/bat/db_blog/setup/sqlserver/setup.sql datasets/bat/db_blog/run_configs/sqlserver/run_ddl.yaml evalbench/reporting/bqstore.py datasets/bat/db_blog/setup/sqlite/setup.sql datasets/bat/db_blog/db_configs/sqlserver_db_config.yaml datasets/model_configs/gemini_2.0_pro_model.yaml datasets/bat/setup/db_blog/sqlserver/setup.sql datasets/bat/db_blog/run_configs/mysql/run_dql.yaml evalbench/dataset/dataset.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/scorers/llmrater.py datasets/model_configs/gemini_2.0_flash_model.yaml datasets/bat/db_blog/run_configs/sqlserver/run_dml.yaml datasets/bat/db_blog/model_configs/gemini_1.0_pro_model.yaml docs/configs/run-config.md datasets/bat/db_blog/run_configs/sqlite/run_dml.yaml evalbench/databases/sqlserver.py datasets/bat/db_blog/db_configs/sqlite_db_config.yaml evalbench/generators/prompts/sqlite_dbschema.py datasets/bat/db_blog/setup/sqlite/pre_setup.sql datasets/model_configs/claude_3.5_model.yaml evalbench/util/config.py datasets/bat/db_blog/run_configs/sqlite/run_dql.yaml datasets/bat/db_blog/model_configs/gemini_2.0_flash_model.yaml evalbench/generators/models/__init__.py datasets/bat/db_blog/setup/sqlite/post_setup.sql datasets/bat/db_blog/prompts/ddl.json datasets/bat/db_blog/setup/sqlserver/pre_setup.sql evalbench/generators/prompts/sqlgenbase.py datasets/bat/db_blog/model_configs/claude_3.5_model.yaml datasets/bat/model_configs/gemini_2.5_pro_model.yaml datasets/model_configs/gemini_2.5_pro_model.yaml datasets/bird/example_run_config.yaml datasets/bat/db_blog/prompts/dml.json datasets/model_configs/gemini_1.5_flash_model.yaml requirements.txt datasets/bat/db_blog/run_configs/mysql/run_dml.yaml evalbench/databases/db.py datasets/bat/db_blog/model_configs/gemini_1.5_flash_model.yaml datasets/bat/db_blog/run_configs/sqlserver/run_dql.yaml evalbench/util/sanitizer.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/generators/prompts/__init__.py datasets/bat/prompts.json evalbench/databases/mysql.py evalbench/generators/models/gemini.py datasets/bat/db_blog/run_configs/postgres/run_dml.yaml datasets/bat/db_blog/run_configs/mysql/run_ddl.yaml datasets/bird/README.md datasets/bat/db_blog/setup/sqlserver/post_setup.sql datasets/bird/download_dataset.sh datasets/bat/setup/db_blog/bigquery/post_setup.sql evalbench/databases/bigquery.py evalbench/databases/sqlite.py evalbench/evaluator/db_manager.py datasets/bat/db_blog/model_configs/gemini_2.0_pro_model.yaml datasets/bat/setup/db_blog/bigquery/setup.sql datasets/model_configs/gemini_1.5-pro-002_model.yaml datasets/model_configs/gemini_1.0_pro_model.yaml datasets/bat/db_configs/bigquery.yaml datasets/bird/db_configs/sqlite.yaml datasets/bat/db_blog/run_configs/postgres/run_dql.yaml datasets/bat/example_run_config.yaml datasets/bat/db_blog/prompts/dql.json evalbench/generators/models/claude.py |
| 5. | 42976936+mahyareb@users.noreply.github.com | 90177675+jahnavi2k@users.noreply.github.com |
61 shared files
docs/configs/db-config.md evalbench/util/loghandler.py datasets/bat/db_blog/run_configs/sqlite/run_ddl.yaml datasets/bat/db_blog/run_configs/postgres/run_ddl.yaml evalbench/databases/postgres.py evalbench/databases/__init__.py datasets/bat/db_blog/run_configs/sqlserver/run_ddl.yaml evalbench/reporting/bqstore.py evalbench/scorers/executablesql.py datasets/bat/db_blog/db_configs/sqlserver_db_config.yaml datasets/bat/model_configs/gemini_2.0_pro_model.yaml docs/configs/model-config.md datasets/bat/db_blog/run_configs/mysql/run_dql.yaml evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/scorers/llmrater.py datasets/bat/db_blog/run_configs/sqlserver/run_dml.yaml datasets/bat/db_blog/model_configs/gemini_1.0_pro_model.yaml docs/configs/run-config.md datasets/bat/db_blog/run_configs/sqlite/run_dml.yaml evalbench/databases/sqlserver.py datasets/bat/db_blog/db_configs/sqlite_db_config.yaml evalbench/generators/prompts/sqlite_dbschema.py evalbench/util/config.py datasets/bat/db_blog/run_configs/sqlite/run_dql.yaml datasets/bat/db_blog/model_configs/gemini_2.0_flash_model.yaml README.md evalbench/generators/models/__init__.py datasets/bat/db_blog/prompts/ddl.json evalbench/generators/prompts/sqlgenbase.py datasets/bat/db_blog/model_configs/claude_3.5_model.yaml datasets/bat/model_configs/gemini_2.0_flash_model.yaml datasets/bat/db_blog/prompts/dml.json docs/examples/sqlite_example.ipynb docs/configs/dataset-config.md datasets/bat/model_configs/gemini_1.5-pro-002_model.yaml requirements.txt datasets/bat/db_blog/run_configs/mysql/run_dml.yaml evalbench/databases/db.py evalbench/evaluator/orchestrator.py datasets/bat/db_blog/model_configs/gemini_1.5_flash_model.yaml datasets/bat/db_blog/run_configs/sqlserver/run_dql.yaml evalbench/util/sanitizer.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/generators/prompts/__init__.py evalbench/databases/mysql.py evalbench/generators/models/gemini.py datasets/bat/db_blog/run_configs/postgres/run_dml.yaml datasets/bat/db_blog/run_configs/mysql/run_ddl.yaml evalbench/evaluator/evaluator.py evalbench/reporting/report.py evalbench/databases/bigquery.py evalbench/databases/sqlite.py evalbench/evaluator/db_manager.py datasets/bat/db_blog/model_configs/gemini_2.0_pro_model.yaml datasets/bat/db_blog/run_configs/postgres/run_dql.yaml datasets/bat/example_run_config.yaml datasets/bat/db_blog/prompts/dql.json evalbench/generators/models/claude.py |
| 6. | ismailmehdi@gmail.com | 42976936+mahyareb@users.noreply.github.com |
52 shared files
evalbench/databases/postgres.py evalbench/databases/__init__.py evalbench/evalproto/eval_request.proto evalbench/scorers/generatedqueryregexpmatcher.py evalbench/reporting/bqstore.py evalbench_service/Dockerfile evalbench/scorers/comparator.py evalbench/dataset/dataset.py evalbench/evalproto/eval_response.proto evalbench/scorers/score.py evalbench/run.sh evalbench/generators/models/passthrough.py evalbench/work/scorework.py evalbench/scorers/exactmatcher.py evalbench_service/k8s/evalbench.yaml evalbench/dataset/evalinput.py evalbench/databases/alloydb.py evalbench/util/config.py README.md evalbench/generators/models/__init__.py evalbench/evalproto/eval_service.proto evalbench/databases/util.py requirements.txt evalbench/reporting/__init__.py evalbench/scorers/recallmatcher.py evalbench/generators/prompts/generator.py evalbench/work/work.py evalbench/databases/db.py evalbench/generators/models/openai.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/generators/prompts/__init__.py evalbench/test/sessionmgr_test.py .gitignore Makefile evalbench/configs/db/postgres.yaml evalbench/databases/mysql.py evalbench/generators/models/gemini.py evalbench/evalproto/eval_config.proto evalbench/reporting/analyzer.py evalbench/evaluator/evaluator.py evalbench/util/sessionmgr.py evalbench/reporting/report.py evalbench/eval_service.py evalbench/util/__init__.py evalbench/configs/db/alloydb.yaml evalbench/evalproto/eval_connect.proto datasets/bat/example_run_config.yaml evalbench/generators/models/magick.py evalbench/generators/prompts/passthrough.py evalbench/generators/models/generator.py evalbench/eval_server.py |
| 7. | jahnaviii@google.com | mebadi@google.com |
49 shared files
docs/configs/db-config.md datasets/bat/db_blog/run_configs/sqlite/run_ddl.yaml datasets/bat/db_blog/run_configs/postgres/run_ddl.yaml evalbench/databases/postgres.py evalbench/databases/__init__.py datasets/bat/db_blog/run_configs/sqlserver/run_ddl.yaml evalbench/reporting/bqstore.py datasets/bat/db_blog/db_configs/sqlserver_db_config.yaml datasets/bat/setup/db_blog/sqlserver/setup.sql datasets/bat/db_blog/run_configs/mysql/run_dql.yaml evalbench/dataset/dataset.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/scorers/llmrater.py datasets/bat/db_blog/run_configs/sqlserver/run_dml.yaml datasets/bat/db_blog/model_configs/gemini_1.0_pro_model.yaml docs/configs/run-config.md datasets/bat/db_blog/run_configs/sqlite/run_dml.yaml evalbench/databases/sqlserver.py datasets/bat/db_blog/db_configs/sqlite_db_config.yaml evalbench/generators/prompts/sqlite_dbschema.py evalbench/util/config.py datasets/bat/db_blog/run_configs/sqlite/run_dql.yaml datasets/bat/db_blog/model_configs/gemini_2.0_flash_model.yaml evalbench/generators/models/__init__.py datasets/bat/db_blog/prompts/ddl.json evalbench/generators/prompts/sqlgenbase.py datasets/bat/db_blog/model_configs/claude_3.5_model.yaml datasets/bat/db_blog/prompts/dml.json requirements.txt datasets/bat/db_blog/run_configs/mysql/run_dml.yaml evalbench/databases/db.py datasets/bat/db_blog/model_configs/gemini_1.5_flash_model.yaml datasets/bat/db_blog/run_configs/sqlserver/run_dql.yaml evalbench/util/sanitizer.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/generators/prompts/__init__.py datasets/bat/prompts.json evalbench/databases/mysql.py evalbench/generators/models/gemini.py datasets/bat/db_blog/run_configs/postgres/run_dml.yaml datasets/bat/db_blog/run_configs/mysql/run_ddl.yaml evalbench/databases/sqlite.py evalbench/evaluator/db_manager.py datasets/bat/db_blog/model_configs/gemini_2.0_pro_model.yaml datasets/bat/db_blog/run_configs/postgres/run_dql.yaml datasets/bat/example_run_config.yaml datasets/bat/db_blog/prompts/dql.json evalbench/generators/models/claude.py |
| 8. | 42976936+mahyareb@users.noreply.github.com | hardikgupta@google.com |
49 shared files
evalbench/dataset/eval_format_verifier/eval_format_verifier.py evalbench/databases/postgres.py evalbench/databases/__init__.py evalbench/evalproto/eval_request.proto evalbench/generators/prompts/mysql_dbschema.py evalbench/scorers/generatedqueryregexpmatcher.py evalbench/reporting/bqstore.py evalbench/scorers/util.py evalbench/dataset/util.py evalbench_service/Dockerfile evalbench/scorers/comparator.py evalbench/configs/base_experiment_nl2code_hibernate.yaml evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/run.sh evalbench/generators/models/passthrough.py evalbench/scorers/llmrater.py evalbench/dataset/eval_format_verifier/eval_format_verifier_test.py evalbench/scorers/exactmatcher.py evalbench_service/k8s/evalbench.yaml evalbench/configs/base_experiment_nl2code_jdbc.yaml evalbench/databases/sqlserver.py evalbench/generators/prompts/pg_dbschema.py evalbench/dataset/evalinput.py evalbench/databases/alloydb.py evalbench/util/config.py evalbench/configs/db/nl2code_postgres.yaml README.md evalbench/databases/util.py requirements.txt evalbench/scorers/recallmatcher.py evalbench/generators/models/openai.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/scorers/returnedsql.py Makefile evalbench/configs/db/postgres.yaml evalbench/databases/mysql.py evalbench/generators/models/gemini.py evalbench/evalproto/eval_config.proto evalbench/dataset/eval_format_verifier/eval_format_verifier_test_helper.py evalbench/reporting/analyzer.py evalbench/evaluator/evaluator.py evalbench/util/sessionmgr.py evalbench/eval_service.py evalbench/configs/db/alloydb.yaml evalbench/dataset/eval_format_verifier/eval_format.py evalbench/repository/__init__.py |
| 9. | 42976936+mahyareb@users.noreply.github.com | jahnaviii@google.com |
48 shared files
docs/configs/db-config.md datasets/bat/db_blog/run_configs/sqlite/run_ddl.yaml datasets/bat/db_blog/run_configs/postgres/run_ddl.yaml evalbench/databases/postgres.py evalbench/databases/__init__.py datasets/bat/db_blog/run_configs/sqlserver/run_ddl.yaml evalbench/reporting/bqstore.py datasets/bat/db_blog/db_configs/sqlserver_db_config.yaml datasets/bat/db_blog/run_configs/mysql/run_dql.yaml evalbench/dataset/dataset.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/scorers/llmrater.py datasets/bat/db_blog/run_configs/sqlserver/run_dml.yaml datasets/bat/db_blog/model_configs/gemini_1.0_pro_model.yaml docs/configs/run-config.md datasets/bat/db_blog/run_configs/sqlite/run_dml.yaml evalbench/databases/sqlserver.py datasets/bat/db_blog/db_configs/sqlite_db_config.yaml evalbench/generators/prompts/sqlite_dbschema.py evalbench/util/config.py datasets/bat/db_blog/run_configs/sqlite/run_dql.yaml datasets/bat/db_blog/model_configs/gemini_2.0_flash_model.yaml evalbench/generators/models/__init__.py datasets/bat/db_blog/prompts/ddl.json evalbench/generators/prompts/sqlgenbase.py datasets/bat/db_blog/model_configs/claude_3.5_model.yaml datasets/bat/db_blog/prompts/dml.json requirements.txt datasets/bat/db_blog/run_configs/mysql/run_dml.yaml evalbench/databases/db.py datasets/bat/db_blog/model_configs/gemini_1.5_flash_model.yaml datasets/bat/db_blog/run_configs/sqlserver/run_dql.yaml evalbench/util/sanitizer.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/generators/prompts/__init__.py evalbench/databases/mysql.py evalbench/generators/models/gemini.py datasets/bat/db_blog/run_configs/postgres/run_dml.yaml datasets/bat/db_blog/run_configs/mysql/run_ddl.yaml evalbench/databases/bigquery.py evalbench/databases/sqlite.py evalbench/evaluator/db_manager.py datasets/bat/db_blog/model_configs/gemini_2.0_pro_model.yaml datasets/bat/db_blog/run_configs/postgres/run_dql.yaml datasets/bat/example_run_config.yaml datasets/bat/db_blog/prompts/dql.json evalbench/generators/models/claude.py |
| 10. | ismailmehdi@gmail.com | mebadi@google.com |
48 shared files
evalbench/databases/postgres.py evalbench/databases/__init__.py evalbench/evalproto/eval_request.proto evalbench/scorers/generatedqueryregexpmatcher.py evalbench/reporting/bqstore.py evalbench_service/Dockerfile evalbench/scorers/comparator.py evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/run.sh evalbench/generators/models/passthrough.py evalbench/work/scorework.py evalbench/scorers/exactmatcher.py evalbench_service/k8s/evalbench.yaml evalbench/dataset/evalinput.py evalbench/databases/alloydb.py evalbench/util/config.py README.md evalbench/generators/models/__init__.py evalbench/evalproto/eval_service.proto evalbench/databases/util.py requirements.txt evalbench/reporting/__init__.py evalbench/scorers/recallmatcher.py evalbench/generators/prompts/generator.py evalbench/work/work.py evalbench/databases/db.py evalbench/generators/models/openai.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/generators/prompts/__init__.py evalbench/test/sessionmgr_test.py .gitignore Makefile evalbench/databases/mysql.py evalbench/generators/models/gemini.py evalbench/evalproto/eval_config.proto evalbench/reporting/analyzer.py evalbench/evaluator/evaluator.py evalbench/util/sessionmgr.py evalbench/reporting/report.py evalbench/eval_service.py evalbench/util/__init__.py datasets/bat/example_run_config.yaml evalbench/generators/models/magick.py evalbench/generators/prompts/passthrough.py evalbench/generators/models/generator.py evalbench/eval_server.py |
| 11. | mebadi@google.com | hardikgupta@google.com |
43 shared files
evalbench/dataset/eval_format_verifier/eval_format_verifier.py evalbench/databases/postgres.py evalbench/databases/__init__.py evalbench/evalproto/eval_request.proto evalbench/generators/prompts/mysql_dbschema.py evalbench/scorers/generatedqueryregexpmatcher.py evalbench/reporting/bqstore.py evalbench/scorers/util.py evalbench/dataset/util.py evalbench_service/Dockerfile evalbench/scorers/comparator.py evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/run.sh evalbench/generators/models/passthrough.py evalbench/scorers/llmrater.py evalbench/dataset/eval_format_verifier/eval_format_verifier_test.py evalbench/scorers/exactmatcher.py evalbench_service/k8s/evalbench.yaml evalbench/databases/sqlserver.py evalbench/generators/prompts/pg_dbschema.py evalbench/dataset/evalinput.py evalbench/databases/alloydb.py evalbench/util/config.py README.md evalbench/databases/util.py requirements.txt evalbench/scorers/recallmatcher.py evalbench/generators/models/openai.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/scorers/returnedsql.py Makefile evalbench/databases/mysql.py evalbench/generators/models/gemini.py evalbench/evalproto/eval_config.proto evalbench/dataset/eval_format_verifier/eval_format_verifier_test_helper.py evalbench/reporting/analyzer.py evalbench/evaluator/evaluator.py evalbench/util/sessionmgr.py evalbench/eval_service.py evalbench/dataset/eval_format_verifier/eval_format.py |
| 12. | ismailmehdi@gmail.com | hardikgupta@google.com |
42 shared files
evalbench/databases/postgres.py evalbench/databases/__init__.py evalbench/evalproto/eval_request.proto evalbench/scorers/generatedqueryregexpmatcher.py evalbench/reporting/bqstore.py evalbench_service/k8s/evalbench-test.yaml evalbench_service/Dockerfile evalbench/scorers/comparator.py evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/run.sh evalbench/generators/models/passthrough.py evalbench_service/k8s/namespace-test.yaml evalbench/scorers/vertextmatcher.py evalbench/scorers/exactmatcher.py evalbench_service/k8s/evalbench.yaml evalbench/work/sqlgenwork.py run_service.sh .pycodestyle evalbench/dataset/evalinput.py evalbench/databases/alloydb.py evalbench/util/config.py README.md evalbench_service/k8s/service-test.yaml evalbench/databases/util.py requirements.txt .github/workflows/main.yml evalbench/scorers/recallmatcher.py evalbench/generators/models/openai.py evalbench/evalbench.py evalbench/work/sqlexecwork.py Makefile evalbench/configs/db/postgres.yaml evalbench/databases/mysql.py evalbench/generators/models/gemini.py evalbench/evalproto/eval_config.proto evalbench/reporting/analyzer.py evalbench/evaluator/evaluator.py evalbench/util/sessionmgr.py evalbench/eval_service.py evalbench/configs/db/alloydb.yaml evalbench_service/k8s/ksa-test.yaml |
| 13. | 42976936+mahyareb@users.noreply.github.com | 75753836+hardikgu23@users.noreply.github.com |
41 shared files
evalbench/dataset/eval_format_verifier/eval_format_verifier.py evalbench/databases/postgres.py evalbench/databases/__init__.py evalbench/evalproto/eval_request.proto evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/util.py evalbench/dataset/util.py evalbench/scorers/comparator.py evalbench/configs/base_experiment_nl2code_hibernate.yaml evalbench/dataset/dataset.py evalbench/evalproto/eval_response.proto evalbench/scorers/score.py evalbench/run.sh evalbench/scorers/llmrater.py evalbench/dataset/eval_format_verifier/eval_format_verifier_test.py evalbench/scorers/exactmatcher.py evalbench/configs/base_experiment_nl2code_jdbc.yaml evalbench/databases/sqlserver.py evalbench/dataset/evalinput.py evalbench/databases/alloydb.py evalbench/configs/db/nl2code_postgres.yaml README.md evalbench/evalproto/eval_service.proto evalbench/databases/util.py requirements.txt evalbench/scorers/recallmatcher.py evalbench/generators/models/openai.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/scorers/returnedsql.py Makefile evalbench/configs/db/postgres.yaml evalbench/databases/mysql.py evalbench/generators/models/gemini.py evalbench/dataset/eval_format_verifier/eval_format_verifier_test_helper.py evalbench/reporting/analyzer.py evalbench/evaluator/evaluator.py evalbench/eval_service.py evalbench/configs/db/alloydb.yaml evalbench/dataset/eval_format_verifier/eval_format.py evalbench/repository/__init__.py |
| 14. | 90177675+jahnavi2k@users.noreply.github.com | 76586767+dvnshgupta@users.noreply.github.com |
37 shared files
docs/configs/db-config.md datasets/bat/db_blog/run_configs/sqlite/run_ddl.yaml evalbench/databases/__init__.py datasets/bat/db_blog/setup/sqlite/setup.sql datasets/model_configs/gemini_2.0_pro_model.yaml evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/scorers/llmrater.py datasets/model_configs/gemini_2.0_flash_model.yaml docs/examples/GCP_CloudSQL_Example.ipynb docs/configs/run-config.md datasets/bat/db_blog/run_configs/sqlite/run_dml.yaml datasets/bat/db_blog/db_configs/sqlite_db_config.yaml evalbench/generators/prompts/sqlite_dbschema.py datasets/bat/db_blog/setup/sqlite/pre_setup.sql datasets/model_configs/claude_3.5_model.yaml datasets/bat/db_blog/run_configs/sqlite/run_dql.yaml datasets/bat/db_blog/setup/sqlite/post_setup.sql datasets/bat/db_blog/prompts/ddl.json datasets/bird/example_run_config.yaml datasets/bat/db_blog/prompts/dml.json datasets/model_configs/gemini_1.5_flash_model.yaml evalbench/databases/db.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/generators/prompts/__init__.py evalbench/databases/mysql.py datasets/bird/README.md evalbench/evaluator/evaluator.py datasets/bird/download_dataset.sh evalbench/databases/sqlite.py datasets/model_configs/gemini_1.5-pro-002_model.yaml datasets/model_configs/gemini_1.0_pro_model.yaml datasets/bird/db_configs/sqlite.yaml datasets/bat/example_run_config.yaml datasets/bat/db_blog/prompts/dql.json |
| 15. | 76586767+dvnshgupta@users.noreply.github.com | jahnaviii@google.com |
34 shared files
docs/configs/db-config.md datasets/bat/db_blog/run_configs/sqlite/run_ddl.yaml evalbench/databases/__init__.py datasets/bat/db_blog/setup/sqlite/setup.sql datasets/model_configs/gemini_2.0_pro_model.yaml evalbench/dataset/dataset.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/scorers/llmrater.py datasets/model_configs/gemini_2.0_flash_model.yaml docs/configs/run-config.md datasets/bat/db_blog/run_configs/sqlite/run_dml.yaml datasets/bat/db_blog/db_configs/sqlite_db_config.yaml evalbench/generators/prompts/sqlite_dbschema.py datasets/bat/db_blog/setup/sqlite/pre_setup.sql datasets/model_configs/claude_3.5_model.yaml datasets/bat/db_blog/run_configs/sqlite/run_dql.yaml datasets/bat/db_blog/setup/sqlite/post_setup.sql datasets/bat/db_blog/prompts/ddl.json datasets/bird/example_run_config.yaml datasets/bat/db_blog/prompts/dml.json datasets/model_configs/gemini_1.5_flash_model.yaml evalbench/databases/db.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/generators/prompts/__init__.py evalbench/databases/mysql.py datasets/bird/README.md datasets/bird/download_dataset.sh evalbench/databases/sqlite.py datasets/model_configs/gemini_1.5-pro-002_model.yaml datasets/model_configs/gemini_1.0_pro_model.yaml datasets/bird/db_configs/sqlite.yaml datasets/bat/example_run_config.yaml datasets/bat/db_blog/prompts/dql.json |
| 16. | mebadi@google.com | 75753836+hardikgu23@users.noreply.github.com |
34 shared files
evalbench/dataset/eval_format_verifier/eval_format_verifier.py evalbench/databases/postgres.py evalbench/databases/__init__.py evalbench/evalproto/eval_request.proto evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/util.py evalbench/dataset/util.py evalbench/scorers/comparator.py evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/run.sh evalbench/scorers/llmrater.py evalbench/dataset/eval_format_verifier/eval_format_verifier_test.py evalbench/scorers/exactmatcher.py evalbench/databases/sqlserver.py evalbench/dataset/evalinput.py evalbench/databases/alloydb.py README.md evalbench/evalproto/eval_service.proto evalbench/databases/util.py requirements.txt evalbench/scorers/recallmatcher.py evalbench/generators/models/openai.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/scorers/returnedsql.py Makefile evalbench/databases/mysql.py evalbench/generators/models/gemini.py evalbench/dataset/eval_format_verifier/eval_format_verifier_test_helper.py evalbench/reporting/analyzer.py evalbench/evaluator/evaluator.py evalbench/eval_service.py evalbench/dataset/eval_format_verifier/eval_format.py |
| 17. | 42976936+mahyareb@users.noreply.github.com | 76586767+dvnshgupta@users.noreply.github.com |
33 shared files
docs/configs/db-config.md datasets/bat/db_blog/run_configs/sqlite/run_ddl.yaml evalbench/databases/__init__.py evalbench/generators/prompts/mysql_dbschema.py evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/comparator.py evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/scorers/llmrater.py evalbench/scorers/exactmatcher.py docs/configs/run-config.md datasets/bat/db_blog/run_configs/sqlite/run_dml.yaml datasets/bat/db_blog/db_configs/sqlite_db_config.yaml evalbench/scorers/setmatcher.py evalbench/generators/prompts/sqlite_dbschema.py evalbench/generators/prompts/pg_dbschema.py evalbench/dataset/evalinput.py datasets/bat/db_blog/run_configs/sqlite/run_dql.yaml datasets/bat/db_blog/prompts/ddl.json datasets/bat/db_blog/prompts/dml.json evalbench/scorers/recallmatcher.py evalbench/databases/db.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/generators/prompts/__init__.py evalbench/scorers/returnedsql.py evalbench/databases/mysql.py evalbench/reporting/analyzer.py evalbench/evaluator/evaluator.py evalbench/databases/sqlite.py datasets/bat/example_run_config.yaml datasets/bat/db_blog/prompts/dql.json |
| 18. | 76586767+dvnshgupta@users.noreply.github.com | mebadi@google.com |
33 shared files
docs/configs/db-config.md datasets/bat/db_blog/run_configs/sqlite/run_ddl.yaml evalbench/databases/__init__.py evalbench/generators/prompts/mysql_dbschema.py evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/comparator.py evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/scorers/llmrater.py evalbench/scorers/exactmatcher.py docs/configs/run-config.md datasets/bat/db_blog/run_configs/sqlite/run_dml.yaml datasets/bat/db_blog/db_configs/sqlite_db_config.yaml evalbench/scorers/setmatcher.py evalbench/generators/prompts/sqlite_dbschema.py evalbench/generators/prompts/pg_dbschema.py evalbench/dataset/evalinput.py datasets/bat/db_blog/run_configs/sqlite/run_dql.yaml datasets/bat/db_blog/prompts/ddl.json datasets/bat/db_blog/prompts/dml.json evalbench/scorers/recallmatcher.py evalbench/databases/db.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/generators/prompts/__init__.py evalbench/scorers/returnedsql.py evalbench/databases/mysql.py evalbench/reporting/analyzer.py evalbench/evaluator/evaluator.py evalbench/databases/sqlite.py datasets/bat/example_run_config.yaml datasets/bat/db_blog/prompts/dql.json |
| 19. | ismailmehdi@gmail.com | 75753836+hardikgu23@users.noreply.github.com |
33 shared files
evalbench/databases/postgres.py evalbench/databases/__init__.py evalbench/evalproto/eval_request.proto evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/comparator.py evalbench/dataset/dataset.py evalbench/dataset/evaloutput.py evalbench/evalproto/eval_response.proto tunnel.sh evalbench/scorers/score.py evalbench/run.sh evalbench/scorers/vertextmatcher.py evalbench/scorers/exactmatcher.py evalbench/dataset/evalinput.py evalbench/databases/alloydb.py README.md evalbench/evalproto/eval_service.proto evalbench/databases/util.py requirements.txt evalbench/scorers/recallmatcher.py evalbench_service/run_service.sh evalbench/generators/models/openai.py evalbench/evalbench.py evalbench/work/sqlexecwork.py Makefile evalbench/configs/db/postgres.yaml evalbench/databases/mysql.py evalbench/generators/models/gemini.py evalbench/reporting/analyzer.py evalbench/evaluator/evaluator.py evalbench/eval_service.py evalbench/client/eval_client.py evalbench/configs/db/alloydb.yaml |
| 20. | ismailmehdi@gmail.com | 90177675+jahnavi2k@users.noreply.github.com |
19 shared files
evalbench/databases/postgres.py evalbench/databases/__init__.py run_client.sh evalbench/reporting/bqstore.py evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/util/config.py README.md evalbench/generators/models/__init__.py requirements.txt evalbench/databases/db.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/generators/prompts/__init__.py evalbench/databases/mysql.py evalbench/generators/models/gemini.py evalbench/evaluator/evaluator.py evalbench/reporting/report.py datasets/bat/example_run_config.yaml |
| 21. | hardikgupta@google.com | 76586767+dvnshgupta@users.noreply.github.com |
19 shared files
evalbench/databases/__init__.py evalbench/generators/prompts/mysql_dbschema.py evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/comparator.py evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/scorers/llmrater.py evalbench/scorers/vertextmatcher.py evalbench/scorers/exactmatcher.py evalbench/generators/prompts/pg_dbschema.py evalbench/dataset/evalinput.py evalbench/scorers/recallmatcher.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/scorers/returnedsql.py evalbench/databases/mysql.py evalbench/reporting/analyzer.py evalbench/evaluator/evaluator.py |
| 22. | ismailmehdi@gmail.com | 76586767+dvnshgupta@users.noreply.github.com |
17 shared files
evalbench/databases/__init__.py evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/comparator.py evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/scorers/vertextmatcher.py evalbench/scorers/exactmatcher.py evalbench/dataset/evalinput.py evalbench/scorers/recallmatcher.py evalbench/databases/db.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/generators/prompts/__init__.py evalbench/databases/mysql.py evalbench/reporting/analyzer.py evalbench/evaluator/evaluator.py datasets/bat/example_run_config.yaml |
| 23. | 51998522+viditchopra1500@users.noreply.github.com | viditchopra@google.com |
17 shared files
evalbench/configs/newDatasetFormat.yaml evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/util.py evalbench/scorers/comparator.py evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/scorers/vertextmatcher.py evalbench/scorers/exactmatcher.py requirements.txt evalbench/scorers/recallmatcher.py evalbench/generators/models/gemini.py evalbench/reporting/analyzer.py evalbench/configs/base_experiment_gemini.yaml evalbench/eval_service.py evalbench/configs/base_experiment_service.yaml evalbench/configs/base_experiment_magick.yaml |
| 24. | hardikgupta@google.com | 90177675+jahnavi2k@users.noreply.github.com |
16 shared files
evalbench/databases/postgres.py evalbench/databases/__init__.py evalbench/reporting/bqstore.py evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/scorers/llmrater.py evalbench/databases/sqlserver.py evalbench/util/config.py README.md requirements.txt evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/databases/mysql.py evalbench/generators/models/gemini.py evalbench/evaluator/evaluator.py |
| 25. | 75753836+hardikgu23@users.noreply.github.com | 76586767+dvnshgupta@users.noreply.github.com |
16 shared files
evalbench/databases/__init__.py evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/comparator.py evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/scorers/vertextmatcher.py evalbench/scorers/exactmatcher.py evalbench/dataset/evalinput.py evalbench/scorers/recallmatcher.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/scorers/returnedsql.py evalbench/databases/mysql.py evalbench/reporting/analyzer.py evalbench/evaluator/evaluator.py |
| 26. | ismailmehdi@gmail.com | jahnaviii@google.com |
15 shared files
evalbench/databases/postgres.py evalbench/databases/__init__.py run_client.sh evalbench/reporting/bqstore.py evalbench/dataset/dataset.py evalbench/util/config.py evalbench/generators/models/__init__.py requirements.txt evalbench/databases/db.py evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/generators/prompts/__init__.py evalbench/databases/mysql.py evalbench/generators/models/gemini.py datasets/bat/example_run_config.yaml |
| 27. | viditchopra@google.com | 75753836+hardikgu23@users.noreply.github.com |
15 shared files
evalbench/configs/newDatasetFormat.yaml evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/util.py evalbench/scorers/comparator.py evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/scorers/vertextmatcher.py evalbench/scorers/exactmatcher.py requirements.txt evalbench/scorers/recallmatcher.py evalbench/evalbench.py evalbench/generators/models/gemini.py evalbench/reporting/analyzer.py evalbench/eval_service.py |
| 28. | viditchopra@google.com | hardikgupta@google.com |
15 shared files
evalbench/configs/newDatasetFormat.yaml evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/util.py evalbench/scorers/comparator.py evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/scorers/vertextmatcher.py evalbench/scorers/exactmatcher.py requirements.txt evalbench/scorers/recallmatcher.py evalbench/evalbench.py evalbench/generators/models/gemini.py evalbench/reporting/analyzer.py evalbench/eval_service.py |
| 29. | 51998522+viditchopra1500@users.noreply.github.com | 75753836+hardikgu23@users.noreply.github.com |
14 shared files
evalbench/configs/newDatasetFormat.yaml evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/util.py evalbench/scorers/comparator.py evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/scorers/vertextmatcher.py evalbench/scorers/exactmatcher.py requirements.txt evalbench/scorers/recallmatcher.py evalbench/generators/models/gemini.py evalbench/reporting/analyzer.py evalbench/eval_service.py |
| 30. | 51998522+viditchopra1500@users.noreply.github.com | hardikgupta@google.com |
14 shared files
evalbench/configs/newDatasetFormat.yaml evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/util.py evalbench/scorers/comparator.py evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/scorers/vertextmatcher.py evalbench/scorers/exactmatcher.py requirements.txt evalbench/scorers/recallmatcher.py evalbench/generators/models/gemini.py evalbench/reporting/analyzer.py evalbench/eval_service.py |
| 31. | ismailmehdi@gmail.com | viditchopra@google.com |
14 shared files
evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/comparator.py evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/scorers/vertextmatcher.py evalbench/scorers/exactmatcher.py requirements.txt evalbench/scorers/recallmatcher.py evalbench/evalbench.py evalbench/generators/models/gemini.py evalbench/reporting/analyzer.py evalbench/configs/base_experiment_gemini.yaml evalbench/eval_service.py evalbench/configs/base_experiment_magick.yaml |
| 32. | 75753836+hardikgu23@users.noreply.github.com | 90177675+jahnavi2k@users.noreply.github.com |
13 shared files
evalbench/databases/postgres.py evalbench/databases/__init__.py evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/databases/sqlserver.py README.md requirements.txt evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/databases/mysql.py evalbench/generators/models/gemini.py evalbench/evaluator/evaluator.py |
| 33. | hardikgupta@google.com | jahnaviii@google.com |
13 shared files
evalbench/databases/postgres.py evalbench/databases/__init__.py evalbench/reporting/bqstore.py evalbench/dataset/dataset.py evalbench/generators/prompts/sqlserver_dbschema.py evalbench/scorers/llmrater.py evalbench/databases/sqlserver.py evalbench/util/config.py requirements.txt evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/databases/mysql.py evalbench/generators/models/gemini.py |
| 34. | 42976936+mahyareb@users.noreply.github.com | hailong.leon@gmail.com |
13 shared files
evalbench/databases/postgres.py evalbench/scorers/util.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/databases/sqlserver.py evalbench/scorers/setmatcher.py evalbench/databases/alloydb.py evalbench/databases/util.py requirements.txt evalbench/databases/db.py evalbench/work/sqlexecwork.py evalbench/databases/mysql.py evalbench/reporting/analyzer.py |
| 35. | hailong.leon@gmail.com | mebadi@google.com |
13 shared files
evalbench/databases/postgres.py evalbench/scorers/util.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/databases/sqlserver.py evalbench/scorers/setmatcher.py evalbench/databases/alloydb.py evalbench/databases/util.py requirements.txt evalbench/databases/db.py evalbench/work/sqlexecwork.py evalbench/databases/mysql.py evalbench/reporting/analyzer.py |
| 36. | ismailmehdi@gmail.com | 51998522+viditchopra1500@users.noreply.github.com |
13 shared files
evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/comparator.py evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/scorers/vertextmatcher.py evalbench/scorers/exactmatcher.py requirements.txt evalbench/scorers/recallmatcher.py evalbench/generators/models/gemini.py evalbench/reporting/analyzer.py evalbench/configs/base_experiment_gemini.yaml evalbench/eval_service.py evalbench/configs/base_experiment_magick.yaml |
| 37. | viditchopra@google.com | mebadi@google.com |
13 shared files
evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/util.py evalbench/scorers/comparator.py evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/scorers/exactmatcher.py requirements.txt evalbench/scorers/recallmatcher.py evalbench/evalbench.py evalbench/generators/models/gemini.py evalbench/reporting/analyzer.py evalbench/eval_service.py |
| 38. | viditchopra@google.com | 42976936+mahyareb@users.noreply.github.com |
13 shared files
evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/util.py evalbench/scorers/comparator.py evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/scorers/exactmatcher.py requirements.txt evalbench/scorers/recallmatcher.py evalbench/evalbench.py evalbench/generators/models/gemini.py evalbench/reporting/analyzer.py evalbench/eval_service.py |
| 39. | 76586767+dvnshgupta@users.noreply.github.com | dvnshgupta@google.com |
13 shared files
evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/comparator.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/scorers/vertextmatcher.py evalbench/scorers/exactmatcher.py docs/examples/GCP_CloudSQL_Example.ipynb evalbench/scorers/setmatcher.py evalbench/dataset/evalinput.py evalbench/scorers/recallmatcher.py evalbench/scorers/returnedsql.py evalbench/reporting/analyzer.py evalbench/evaluator/evaluator.py |
| 40. | 51998522+viditchopra1500@users.noreply.github.com | mebadi@google.com |
12 shared files
evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/util.py evalbench/scorers/comparator.py evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/scorers/exactmatcher.py requirements.txt evalbench/scorers/recallmatcher.py evalbench/generators/models/gemini.py evalbench/reporting/analyzer.py evalbench/eval_service.py |
| 41. | 51998522+viditchopra1500@users.noreply.github.com | 42976936+mahyareb@users.noreply.github.com |
12 shared files
evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/util.py evalbench/scorers/comparator.py evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/scorers/exactmatcher.py requirements.txt evalbench/scorers/recallmatcher.py evalbench/generators/models/gemini.py evalbench/reporting/analyzer.py evalbench/eval_service.py |
| 42. | 75753836+hardikgu23@users.noreply.github.com | hailong.leon@gmail.com |
11 shared files
evalbench/databases/postgres.py evalbench/scorers/util.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/databases/sqlserver.py evalbench/databases/alloydb.py evalbench/databases/util.py requirements.txt evalbench/work/sqlexecwork.py evalbench/databases/mysql.py evalbench/reporting/analyzer.py |
| 43. | hardikgupta@google.com | hailong.leon@gmail.com |
11 shared files
evalbench/databases/postgres.py evalbench/scorers/util.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/databases/sqlserver.py evalbench/databases/alloydb.py evalbench/databases/util.py requirements.txt evalbench/work/sqlexecwork.py evalbench/databases/mysql.py evalbench/reporting/analyzer.py |
| 44. | prernakakkar@google.com | 158031829+prernakakkar-google@users.noreply.github.com |
11 shared files
evalbench/evalproto/eval_request.proto evalbench/configs/model/base_nl2code_model.yaml evalbench/repository/nldRepo.py evalbench/configs/base_experiment_nl2code_hibernate.yaml evalbench/evalproto/eval_response.proto evalbench/configs/base_experiment_nl2code_jdbc.yaml evalbench/configs/db/nl2code_postgres.yaml evalbench/evalproto/eval_service.proto evalbench/evalproto/eval_config.proto evalbench/repository/__init__.py evalbench/evalproto/eval_connect.proto |
| 45. | hardikgupta@google.com | dvnshgupta@google.com |
11 shared files
evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/comparator.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/scorers/vertextmatcher.py evalbench/scorers/exactmatcher.py evalbench/dataset/evalinput.py evalbench/scorers/recallmatcher.py evalbench/scorers/returnedsql.py evalbench/reporting/analyzer.py evalbench/evaluator/evaluator.py |
| 46. | 75753836+hardikgu23@users.noreply.github.com | dvnshgupta@google.com |
11 shared files
evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/comparator.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/scorers/vertextmatcher.py evalbench/scorers/exactmatcher.py evalbench/dataset/evalinput.py evalbench/scorers/recallmatcher.py evalbench/scorers/returnedsql.py evalbench/reporting/analyzer.py evalbench/evaluator/evaluator.py |
| 47. | mebadi@google.com | dvnshgupta@google.com |
11 shared files
evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/comparator.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/scorers/exactmatcher.py evalbench/scorers/setmatcher.py evalbench/dataset/evalinput.py evalbench/scorers/recallmatcher.py evalbench/scorers/returnedsql.py evalbench/reporting/analyzer.py evalbench/evaluator/evaluator.py |
| 48. | dvnshgupta@google.com | 42976936+mahyareb@users.noreply.github.com |
11 shared files
evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/comparator.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/scorers/exactmatcher.py evalbench/scorers/setmatcher.py evalbench/dataset/evalinput.py evalbench/scorers/recallmatcher.py evalbench/scorers/returnedsql.py evalbench/reporting/analyzer.py evalbench/evaluator/evaluator.py |
| 49. | 75753836+hardikgu23@users.noreply.github.com | jahnaviii@google.com |
10 shared files
evalbench/databases/postgres.py evalbench/databases/__init__.py evalbench/dataset/dataset.py evalbench/scorers/llmrater.py evalbench/databases/sqlserver.py requirements.txt evalbench/evalbench.py evalbench/work/sqlexecwork.py evalbench/databases/mysql.py evalbench/generators/models/gemini.py |
| 50. | 42976936+mahyareb@users.noreply.github.com | prernakakkar@google.com |
10 shared files
evalbench/evalproto/eval_request.proto evalbench/repository/nldRepo.py evalbench/configs/base_experiment_nl2code_hibernate.yaml evalbench/evalproto/eval_response.proto evalbench/configs/base_experiment_nl2code_jdbc.yaml evalbench/configs/db/nl2code_postgres.yaml evalbench/evalproto/eval_service.proto evalbench/evalproto/eval_config.proto evalbench/repository/__init__.py evalbench/evalproto/eval_connect.proto |
| 51. | 42976936+mahyareb@users.noreply.github.com | 158031829+prernakakkar-google@users.noreply.github.com |
10 shared files
evalbench/evalproto/eval_request.proto evalbench/repository/nldRepo.py evalbench/configs/base_experiment_nl2code_hibernate.yaml evalbench/evalproto/eval_response.proto evalbench/configs/base_experiment_nl2code_jdbc.yaml evalbench/configs/db/nl2code_postgres.yaml evalbench/evalproto/eval_service.proto evalbench/evalproto/eval_config.proto evalbench/repository/__init__.py evalbench/evalproto/eval_connect.proto |
| 52. | viditchopra@google.com | 76586767+dvnshgupta@users.noreply.github.com |
10 shared files
evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/comparator.py evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/scorers/vertextmatcher.py evalbench/scorers/exactmatcher.py evalbench/scorers/recallmatcher.py evalbench/evalbench.py evalbench/reporting/analyzer.py |
| 53. | ismailmehdi@gmail.com | hailong.leon@gmail.com |
9 shared files
evalbench/databases/postgres.py evalbench/scorers/score.py evalbench/databases/alloydb.py evalbench/databases/util.py requirements.txt evalbench/databases/db.py evalbench/work/sqlexecwork.py evalbench/databases/mysql.py evalbench/reporting/analyzer.py |
| 54. | ismailmehdi@gmail.com | dvnshgupta@google.com |
9 shared files
evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/comparator.py evalbench/scorers/score.py evalbench/scorers/vertextmatcher.py evalbench/scorers/exactmatcher.py evalbench/dataset/evalinput.py evalbench/scorers/recallmatcher.py evalbench/reporting/analyzer.py evalbench/evaluator/evaluator.py |
| 55. | 51998522+viditchopra1500@users.noreply.github.com | 76586767+dvnshgupta@users.noreply.github.com |
9 shared files
evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/comparator.py evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/scorers/vertextmatcher.py evalbench/scorers/exactmatcher.py evalbench/scorers/recallmatcher.py evalbench/reporting/analyzer.py |
| 56. | yangtian@google.com | ismailmehdi@gmail.com |
9 shared files
evalbench/reporting/bqstore.py evalbench/generators/models/passthrough.py evalbench/work/sqlgenwork.py evalbench/dataset/evalinput.py evalbench/generators/models/__init__.py requirements.txt evalbench/evaluator/evaluator.py evalbench/eval_service.py evalbench/eval_server.py |
| 57. | 42976936+mahyareb@users.noreply.github.com | m1378.prz@gmail.com |
8 shared files
docs/configs/db-config.md evalbench/databases/__init__.py datasets/bat/db_configs/alloydb.yaml evalbench/databases/alloydb.py evalbench/generators/models/__init__.py evalbench/generators/models/alloydb_ai_nl.py evalbench/evaluator/orchestrator.py evalbench/databases/bigquery.py |
| 58. | hailong.leon@gmail.com | 90177675+jahnavi2k@users.noreply.github.com |
8 shared files
evalbench/databases/postgres.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/databases/sqlserver.py requirements.txt evalbench/databases/db.py evalbench/work/sqlexecwork.py evalbench/databases/mysql.py |
| 59. | 75753836+hardikgu23@users.noreply.github.com | prernakakkar@google.com |
8 shared files
evalbench/evalproto/eval_request.proto evalbench/configs/model/base_nl2code_model.yaml evalbench/configs/base_experiment_nl2code_hibernate.yaml evalbench/evalproto/eval_response.proto evalbench/configs/base_experiment_nl2code_jdbc.yaml evalbench/configs/db/nl2code_postgres.yaml evalbench/evalproto/eval_service.proto evalbench/repository/__init__.py |
| 60. | 75753836+hardikgu23@users.noreply.github.com | 158031829+prernakakkar-google@users.noreply.github.com |
8 shared files
evalbench/evalproto/eval_request.proto evalbench/configs/model/base_nl2code_model.yaml evalbench/configs/base_experiment_nl2code_hibernate.yaml evalbench/evalproto/eval_response.proto evalbench/configs/base_experiment_nl2code_jdbc.yaml evalbench/configs/db/nl2code_postgres.yaml evalbench/evalproto/eval_service.proto evalbench/repository/__init__.py |
| 61. | viditchopra@google.com | dvnshgupta@google.com |
8 shared files
evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/comparator.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/scorers/vertextmatcher.py evalbench/scorers/exactmatcher.py evalbench/scorers/recallmatcher.py evalbench/reporting/analyzer.py |
| 62. | 51998522+viditchopra1500@users.noreply.github.com | dvnshgupta@google.com |
8 shared files
evalbench/scorers/generatedqueryregexpmatcher.py evalbench/scorers/comparator.py evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/scorers/vertextmatcher.py evalbench/scorers/exactmatcher.py evalbench/scorers/recallmatcher.py evalbench/reporting/analyzer.py |
| 63. | 42976936+mahyareb@users.noreply.github.com | yangtian@google.com |
8 shared files
evalbench/reporting/bqstore.py evalbench/generators/models/passthrough.py evalbench/dataset/evalinput.py evalbench/generators/models/__init__.py requirements.txt evalbench/evaluator/evaluator.py evalbench/eval_service.py evalbench/eval_server.py |
| 64. | mebadi@google.com | yangtian@google.com |
8 shared files
evalbench/reporting/bqstore.py evalbench/generators/models/passthrough.py evalbench/dataset/evalinput.py evalbench/generators/models/__init__.py requirements.txt evalbench/evaluator/evaluator.py evalbench/eval_service.py evalbench/eval_server.py |
| 65. | 75753836+hardikgu23@users.noreply.github.com | mahyar@google.com |
7 shared files
evalbench/databases/postgres.py evalbench/databases/alloydb.py evalbench/configs/db/nl2code_postgres.yaml evalbench/databases/util.py evalbench/configs/db/postgres.yaml evalbench/databases/mysql.py evalbench/configs/db/alloydb.yaml |
| 66. | hardikgupta@google.com | mahyar@google.com |
7 shared files
evalbench/databases/postgres.py evalbench/databases/alloydb.py evalbench/configs/db/nl2code_postgres.yaml evalbench/databases/util.py evalbench/configs/db/postgres.yaml evalbench/databases/mysql.py evalbench/configs/db/alloydb.yaml |
| 67. | 42976936+mahyareb@users.noreply.github.com | mahyar@google.com |
7 shared files
evalbench/databases/postgres.py evalbench/databases/alloydb.py evalbench/configs/db/nl2code_postgres.yaml evalbench/databases/util.py evalbench/configs/db/postgres.yaml evalbench/databases/mysql.py evalbench/configs/db/alloydb.yaml |
| 68. | hailong.leon@gmail.com | jahnaviii@google.com |
7 shared files
evalbench/databases/postgres.py evalbench/scorers/llmrater.py evalbench/databases/sqlserver.py requirements.txt evalbench/databases/db.py evalbench/work/sqlexecwork.py evalbench/databases/mysql.py |
| 69. | hardikgupta@google.com | prernakakkar@google.com |
7 shared files
evalbench/evalproto/eval_request.proto evalbench/configs/model/base_nl2code_model.yaml evalbench/configs/base_experiment_nl2code_hibernate.yaml evalbench/configs/base_experiment_nl2code_jdbc.yaml evalbench/configs/db/nl2code_postgres.yaml evalbench/evalproto/eval_config.proto evalbench/repository/__init__.py |
| 70. | hardikgupta@google.com | 158031829+prernakakkar-google@users.noreply.github.com |
7 shared files
evalbench/evalproto/eval_request.proto evalbench/configs/model/base_nl2code_model.yaml evalbench/configs/base_experiment_nl2code_hibernate.yaml evalbench/configs/base_experiment_nl2code_jdbc.yaml evalbench/configs/db/nl2code_postgres.yaml evalbench/evalproto/eval_config.proto evalbench/repository/__init__.py |
| 71. | hardikgupta@google.com | yangtian@google.com |
7 shared files
evalbench/reporting/bqstore.py evalbench/generators/models/passthrough.py evalbench/work/sqlgenwork.py evalbench/dataset/evalinput.py requirements.txt evalbench/evaluator/evaluator.py evalbench/eval_service.py |
| 72. | hailong.leon@gmail.com | 76586767+dvnshgupta@users.noreply.github.com |
7 shared files
evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/scorers/setmatcher.py evalbench/databases/db.py evalbench/work/sqlexecwork.py evalbench/databases/mysql.py evalbench/reporting/analyzer.py |
| 73. | ismailmehdi@gmail.com | mahyar@google.com |
6 shared files
evalbench/databases/postgres.py evalbench/databases/alloydb.py evalbench/databases/util.py evalbench/configs/db/postgres.yaml evalbench/databases/mysql.py evalbench/configs/db/alloydb.yaml |
| 74. | viditchopra@google.com | 90177675+jahnavi2k@users.noreply.github.com |
6 shared files
evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/scorers/llmrater.py requirements.txt evalbench/evalbench.py evalbench/generators/models/gemini.py |
| 75. | m1378.prz@gmail.com | 90177675+jahnavi2k@users.noreply.github.com |
5 shared files
docs/configs/db-config.md evalbench/databases/__init__.py evalbench/generators/models/__init__.py evalbench/evaluator/orchestrator.py evalbench/databases/bigquery.py |
| 76. | m1378.prz@gmail.com | mebadi@google.com |
5 shared files
docs/configs/db-config.md evalbench/databases/__init__.py evalbench/databases/alloydb.py evalbench/generators/models/__init__.py evalbench/evaluator/orchestrator.py |
| 77. | ismailmehdi@gmail.com | prernakakkar@google.com |
5 shared files
evalbench/evalproto/eval_request.proto evalbench/evalproto/eval_response.proto evalbench/evalproto/eval_service.proto evalbench/evalproto/eval_config.proto evalbench/evalproto/eval_connect.proto |
| 78. | ismailmehdi@gmail.com | 158031829+prernakakkar-google@users.noreply.github.com |
5 shared files
evalbench/evalproto/eval_request.proto evalbench/evalproto/eval_response.proto evalbench/evalproto/eval_service.proto evalbench/evalproto/eval_config.proto evalbench/evalproto/eval_connect.proto |
| 79. | 51998522+viditchopra1500@users.noreply.github.com | hailong.leon@gmail.com |
5 shared files
evalbench/scorers/util.py evalbench/scorers/score.py evalbench/scorers/llmrater.py requirements.txt evalbench/reporting/analyzer.py |
| 80. | viditchopra@google.com | hailong.leon@gmail.com |
5 shared files
evalbench/scorers/util.py evalbench/scorers/score.py evalbench/scorers/llmrater.py requirements.txt evalbench/reporting/analyzer.py |
| 81. | 51998522+viditchopra1500@users.noreply.github.com | 90177675+jahnavi2k@users.noreply.github.com |
5 shared files
evalbench/dataset/dataset.py evalbench/scorers/score.py evalbench/scorers/llmrater.py requirements.txt evalbench/generators/models/gemini.py |
| 82. | viditchopra@google.com | jahnaviii@google.com |
5 shared files
evalbench/dataset/dataset.py evalbench/scorers/llmrater.py requirements.txt evalbench/evalbench.py evalbench/generators/models/gemini.py |
| 83. | m1378.prz@gmail.com | jahnaviii@google.com |
4 shared files
docs/configs/db-config.md evalbench/databases/__init__.py evalbench/generators/models/__init__.py evalbench/databases/bigquery.py |
| 84. | mahyar@google.com | hailong.leon@gmail.com |
4 shared files
evalbench/databases/postgres.py evalbench/databases/alloydb.py evalbench/databases/util.py evalbench/databases/mysql.py |
| 85. | mahyar@google.com | mebadi@google.com |
4 shared files
evalbench/databases/postgres.py evalbench/databases/alloydb.py evalbench/databases/util.py evalbench/databases/mysql.py |
| 86. | mebadi@google.com | prernakakkar@google.com |
4 shared files
evalbench/evalproto/eval_request.proto evalbench/repository/nldRepo.py evalbench/evalproto/eval_service.proto evalbench/evalproto/eval_config.proto |
| 87. | mebadi@google.com | 158031829+prernakakkar-google@users.noreply.github.com |
4 shared files
evalbench/evalproto/eval_request.proto evalbench/repository/nldRepo.py evalbench/evalproto/eval_service.proto evalbench/evalproto/eval_config.proto |
| 88. | 90177675+jahnavi2k@users.noreply.github.com | yangtian@google.com |
4 shared files
evalbench/reporting/bqstore.py evalbench/generators/models/__init__.py requirements.txt evalbench/evaluator/evaluator.py |
| 89. | 51998522+viditchopra1500@users.noreply.github.com | jahnaviii@google.com |
4 shared files
evalbench/dataset/dataset.py evalbench/scorers/llmrater.py requirements.txt evalbench/generators/models/gemini.py |
| 90. | hailong.leon@gmail.com | dvnshgupta@google.com |
4 shared files
evalbench/scorers/score.py evalbench/scorers/llmrater.py evalbench/scorers/setmatcher.py evalbench/reporting/analyzer.py |
| 91. | dvnshgupta@google.com | 90177675+jahnavi2k@users.noreply.github.com |
4 shared files
evalbench/scorers/score.py evalbench/scorers/llmrater.py docs/examples/GCP_CloudSQL_Example.ipynb evalbench/evaluator/evaluator.py |
| 92. | 75753836+hardikgu23@users.noreply.github.com | yangtian@google.com |
4 shared files
evalbench/dataset/evalinput.py requirements.txt evalbench/evaluator/evaluator.py evalbench/eval_service.py |
| 93. | ismailmehdi@gmail.com | m1378.prz@gmail.com |
3 shared files
evalbench/databases/__init__.py evalbench/databases/alloydb.py evalbench/generators/models/__init__.py |
| 94. | jahnaviii@google.com | yangtian@google.com |
3 shared files
evalbench/reporting/bqstore.py evalbench/generators/models/__init__.py requirements.txt |
| 95. | 51998522+viditchopra1500@users.noreply.github.com | yangtian@google.com |
3 shared files
requirements.txt evalbench/eval_service.py evalbench/configs/base_experiment_service.yaml |
| 96. | viditchopra@google.com | yangtian@google.com |
3 shared files
requirements.txt evalbench/eval_service.py evalbench/configs/base_experiment_service.yaml |
| 97. | m1378.prz@gmail.com | 76586767+dvnshgupta@users.noreply.github.com |
2 shared files
docs/configs/db-config.md evalbench/databases/__init__.py |
| 98. | mahyar@google.com | jahnaviii@google.com |
2 shared files
evalbench/databases/postgres.py evalbench/databases/mysql.py |
| 99. | mahyar@google.com | 90177675+jahnavi2k@users.noreply.github.com |
2 shared files
evalbench/databases/postgres.py evalbench/databases/mysql.py |
| 100. | hardikgupta@google.com | m1378.prz@gmail.com |
2 shared files
evalbench/databases/__init__.py evalbench/databases/alloydb.py |
| Contributor | # connections | # commits | |
|---|---|---|---|
| 1. | mebadi@google.com | 17 | 142 |
| 2. | hardikgupta@google.com | 17 | 100 |
| 3. | 42976936+mahyareb@users.noreply.github.com | 17 | 67 |
| 4. | 75753836+hardikgu23@users.noreply.github.com | 17 | 36 |
| 5. | ismailmehdi@gmail.com | 17 | 18 |
| 6. | 90177675+jahnavi2k@users.noreply.github.com | 15 | 23 |
| 7. | 76586767+dvnshgupta@users.noreply.github.com | 15 | 22 |
| 8. | hailong.leon@gmail.com | 15 | 3 |
| 9. | jahnaviii@google.com | 14 | 46 |
| 10. | dvnshgupta@google.com | 13 | 26 |
| 11. | viditchopra@google.com | 13 | 11 |
| 12. | 51998522+viditchopra1500@users.noreply.github.com | 13 | 8 |
| 13. | yangtian@google.com | 13 | 4 |
| 14. | mahyar@google.com | 12 | 1 |
| 15. | m1378.prz@gmail.com | 11 | 5 |
| 16. | hailongli@google.com | 11 | 1 |
| 17. | prernakakkar@google.com | 7 | 6 |
| 18. | 158031829+prernakakkar-google@users.noreply.github.com | 7 | 4 |
| 19. | ismailmehdi@google.com | 0 | 1 |
C-median: 13.5
A half of the contributors has more than 13.5 connections, and a half has less than this number.
C-mean: 13.5
An average number of connections a contributor has with other contributors.
C-index: 12.0
There are 12.0 contributors with 12.0 or more connections.
