GoogleCloudPlatform / evalbench
File Change Frequency

File change frequency (churn) shows the distribution of file updates (days with at least one commit).

Overview
File Change Frequency Overall
  • There are 114 files with 6,971 lines of code.
    • 0 files changed more than 100 times (0 lines of code)
    • 0 files changed 51-100 times (0 lines of code)
    • 10 files changed 21-50 times (1,295 lines of code)
    • 29 files changed 6-20 times (1,774 lines of code)
    • 75 files changed 1-5 times (3,902 lines of code)
0% | 0% | 18% | 25% | 55%
Legend:
101+
51-100
21-50
6-20
1-5

explore: grouped by folders | grouped by update frequency | data
Contributors Count Frequency Overall
  • There are 114 files with 6,971 lines of code.
    • 0 files changed by more than 25 contributors (0 lines of code)
    • 2 files changed by 11-25 contributors (181 lines of code)
    • 29 files changed by 6-10 contributors (2,270 lines of code)
    • 72 files changed by 2-5 contributors (4,432 lines of code)
    • 11 files changed by 1 contributor (88 lines of code)
0% | 2% | 32% | 63% | 1%
Legend:
26+
11-25
6-10
2-5
1

explore: grouped by folders | grouped by contributors count | data
File Change Frequency per File Extension
py, yaml, sql, md, sh, proto, txt, json, ipynb, gitignore, toml
File Change Frequency per Extension
The number of recorded file updates
101+
51-100
21-50
6-20
1-5
py0% | 0% | 33% | 42% | 24%
proto0% | 0% | 0% | 94% | 5%
yaml0% | 0% | 0% | 6% | 93%
sql0% | 0% | 0% | 0% | 100%
toml0% | 0% | 0% | 0% | 100%
File Change Frequency per Logical Decomposition
primary
primary (file change frequency)
The number of recorded file updates
101+
51-100
21-50
6-20
1-5
evalbench0% | 0% | 32% | 43% | 24%
datasets0% | 0% | 0% | <1% | 99%
evalbench_service0% | 0% | 0% | 0% | 100%
ROOT0% | 0% | 0% | 0% | 100%
Most Frequently Changed Files (Top 50)

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
evalbench.py
in evalbench
 64 1 2024-07-31 2025-04-15 30 9 ismailmehdi@gmail.com 90177675+jahnavi2k@users.no...
evaluator.py
in evalbench/evaluator
 90 2 2024-07-31 2025-04-15 30 9 ismailmehdi@gmail.com 90177675+jahnavi2k@users.no...
mysql.py
in evalbench/databases
 197 15 2024-09-04 2025-04-28 30 10 hardikgupta@google.com jahnaviii@google.com
sqlexecwork.py
in evalbench/work
 99 6 2024-07-31 2025-04-22 29 9 ismailmehdi@gmail.com jahnaviii@google.com
llmrater.py
in evalbench/scorers
 113 5 2024-08-26 2025-03-30 29 11 viditchopra@google.com 42976936+mahyareb@users.nor...
eval_service.py
in evalbench
 141 4 2024-08-20 2025-03-28 28 8 yangtian@google.com 42976936+mahyareb@users.nor...
dataset.py
in evalbench/dataset
 112 9 2024-07-31 2025-04-21 27 10 ismailmehdi@gmail.com 76586767+dvnshgupta@users.n...
score.py
in evalbench/scorers
 68 1 2024-07-31 2025-04-15 25 12 ismailmehdi@gmail.com 90177675+jahnavi2k@users.no...
postgres.py
in evalbench/databases
 192 15 2024-07-31 2025-04-28 25 9 ismailmehdi@gmail.com jahnaviii@google.com
sqlserver.py
in evalbench/databases
 219 16 2024-10-02 2025-04-28 24 7 42976936+mahyareb@users.nor... jahnaviii@google.com
alloydb.py
in evalbench/databases
 35 1 2024-07-31 2025-04-29 19 8 ismailmehdi@gmail.com m1378.prz@gmail.com
evalinput.py
in evalbench/dataset
 117 9 2024-07-31 2025-03-28 19 8 ismailmehdi@gmail.com mebadi@google.com
gemini.py
in evalbench/generators/models
 38 2 2024-07-31 2025-04-15 16 9 ismailmehdi@gmail.com 90177675+jahnavi2k@users.no...
config.py
in evalbench/util
 143 11 2024-07-31 2025-04-28 16 6 ismailmehdi@gmail.com 90177675+jahnavi2k@users.no...
__init__.py
in evalbench/databases
 23 1 2024-07-31 2025-04-29 15 9 ismailmehdi@gmail.com 42976936+mahyareb@users.nor...
analyzer.py
in evalbench/reporting
 84 2 2024-07-31 2025-03-24 14 10 ismailmehdi@gmail.com mebadi@google.com
db.py
in evalbench/databases
 132 23 2024-07-31 2025-04-28 14 7 ismailmehdi@gmail.com 90177675+jahnavi2k@users.no...
__init__.py
in evalbench/generators/models
 26 1 2024-07-31 2025-04-29 13 7 ismailmehdi@gmail.com 42976936+mahyareb@users.nor...
proto
eval_request.proto
in evalbench/evalproto
 52 - 2024-08-29 2025-03-28 13 7 ismailmehdi@gmail.com mebadi@google.com
comparator.py
in evalbench/scorers
 70 6 2024-07-31 2025-03-10 13 9 ismailmehdi@gmail.com 76586767+dvnshgupta@users.n...
sqlite.py
in evalbench/databases
 196 16 2025-03-17 2025-04-28 13 5 jahnaviii@google.com jahnaviii@google.com
exactmatcher.py
in evalbench/scorers
 27 2 2024-07-31 2025-03-24 12 9 ismailmehdi@gmail.com mebadi@google.com
util.py
in evalbench/databases
 115 5 2024-07-31 2025-03-24 12 7 ismailmehdi@gmail.com mebadi@google.com
recallmatcher.py
in evalbench/scorers
 61 3 2024-07-31 2025-03-24 11 9 ismailmehdi@gmail.com mebadi@google.com
db_manager.py
in evalbench/evaluator
 94 6 2025-02-28 2025-04-28 11 4 mebadi@google.com 90177675+jahnavi2k@users.no...
20 - 2025-03-31 2025-04-23 10 6 mebadi@google.com 90177675+jahnavi2k@users.no...
returnedsql.py
in evalbench/scorers
 30 2 2024-10-10 2025-03-24 10 6 hardikgupta@google.com 42976936+mahyareb@users.nor...
orchestrator.py
in evalbench/evaluator
 190 4 2025-03-27 2025-04-29 10 4 mebadi@google.com 42976936+mahyareb@users.nor...
generatedqueryregexpmatcher.py
in evalbench/scorers
 57 3 2024-07-31 2025-03-01 9 9 ismailmehdi@gmail.com 42976936+mahyareb@users.nor...
__init__.py
in evalbench/generators/prompts
 7 1 2024-07-31 2025-03-30 8 6 ismailmehdi@gmail.com 42976936+mahyareb@users.nor...
proto
eval_service.proto
in evalbench/evalproto
 37 - 2024-08-29 2025-02-05 8 6 ismailmehdi@gmail.com mebadi@google.com
passthrough.py
in evalbench/generators/models
 7 2 2024-08-20 2025-03-24 7 5 yangtian@google.com mebadi@google.com
proto
eval_response.proto
in evalbench/evalproto
 7 - 2024-08-29 2025-02-01 7 5 ismailmehdi@gmail.com 42976936+mahyareb@users.nor...
proto
eval_config.proto
in evalbench/evalproto
 11 - 2024-08-29 2025-02-01 7 6 ismailmehdi@gmail.com 42976936+mahyareb@users.nor...
report.py
in evalbench/reporting
 28 5 2024-07-31 2025-04-15 7 4 ismailmehdi@gmail.com 90177675+jahnavi2k@users.no...
util.py
in evalbench/scorers
 35 2 2024-11-15 2025-03-24 7 7 51998522+viditchopra1500@us... mebadi@google.com
generator.py
in evalbench/generators/models
 27 3 2024-07-31 2025-04-02 6 3 ismailmehdi@gmail.com mebadi@google.com
setmatcher.py
in evalbench/scorers
 36 2 2024-12-07 2025-03-24 6 6 hailong.leon@gmail.com 42976936+mahyareb@users.nor...
sessionmgr.py
in evalbench/util
 69 11 2024-08-31 2025-03-01 6 4 ismailmehdi@gmail.com 42976936+mahyareb@users.nor...
__init__.py
in evalbench/repository
 3 1 2024-10-07 2025-02-01 5 5 hardikgupta@google.com 42976936+mahyareb@users.nor...
sqlite.yaml
in datasets/bird/db_configs
 5 - 2025-04-01 2025-04-21 5 3 jahnaviii@google.com 76586767+dvnshgupta@users.n...
sanitizer.py
in evalbench/util
 11 1 2025-02-28 2025-04-15 5 4 mebadi@google.com 90177675+jahnavi2k@users.no...
service.py
in evalbench/util
 13 1 2025-02-28 2025-03-28 5 2 mebadi@google.com 42976936+mahyareb@users.nor...
example_run_config.yaml
in datasets/bird
 19 - 2025-04-01 2025-04-21 5 3 jahnaviii@google.com 76586767+dvnshgupta@users.n...
loghandler.py
in evalbench/util
 22 1 2024-11-15 2025-04-15 5 3 mebadi@google.com 90177675+jahnavi2k@users.no...
scorework.py
in evalbench/work
 23 2 2024-07-31 2025-03-30 5 3 ismailmehdi@gmail.com 42976936+mahyareb@users.nor...
sqlgenwork.py
in evalbench/work
 25 2 2024-07-31 2024-09-28 5 3 ismailmehdi@gmail.com hardikgupta@google.com
nldRepo.py
in evalbench/repository
 32 5 2025-01-24 2025-03-01 5 4 prernakakkar@google.com 42976936+mahyareb@users.nor...
eval_server.py
in evalbench
 53 1 2024-08-20 2025-03-01 5 4 yangtian@google.com 42976936+mahyareb@users.nor...
bigquery.py
in evalbench/databases
 220 17 2025-04-18 2025-04-29 5 4 jahnaviii@google.com m1378.prz@gmail.com
Files With Most Contributors (Top 50)
Based on the number of unique email addresses found in commits.

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
score.py
in evalbench/scorers
 68 1 2024-07-31 2025-04-15 25 12 ismailmehdi@gmail.com 90177675+jahnavi2k@users.no...
llmrater.py
in evalbench/scorers
 113 5 2024-08-26 2025-03-30 29 11 viditchopra@google.com 42976936+mahyareb@users.nor...
mysql.py
in evalbench/databases
 197 15 2024-09-04 2025-04-28 30 10 hardikgupta@google.com jahnaviii@google.com
dataset.py
in evalbench/dataset
 112 9 2024-07-31 2025-04-21 27 10 ismailmehdi@gmail.com 76586767+dvnshgupta@users.n...
analyzer.py
in evalbench/reporting
 84 2 2024-07-31 2025-03-24 14 10 ismailmehdi@gmail.com mebadi@google.com
evaluator.py
in evalbench/evaluator
 90 2 2024-07-31 2025-04-15 30 9 ismailmehdi@gmail.com 90177675+jahnavi2k@users.no...
evalbench.py
in evalbench
 64 1 2024-07-31 2025-04-15 30 9 ismailmehdi@gmail.com 90177675+jahnavi2k@users.no...
sqlexecwork.py
in evalbench/work
 99 6 2024-07-31 2025-04-22 29 9 ismailmehdi@gmail.com jahnaviii@google.com
postgres.py
in evalbench/databases
 192 15 2024-07-31 2025-04-28 25 9 ismailmehdi@gmail.com jahnaviii@google.com
gemini.py
in evalbench/generators/models
 38 2 2024-07-31 2025-04-15 16 9 ismailmehdi@gmail.com 90177675+jahnavi2k@users.no...
__init__.py
in evalbench/databases
 23 1 2024-07-31 2025-04-29 15 9 ismailmehdi@gmail.com 42976936+mahyareb@users.nor...
comparator.py
in evalbench/scorers
 70 6 2024-07-31 2025-03-10 13 9 ismailmehdi@gmail.com 76586767+dvnshgupta@users.n...
exactmatcher.py
in evalbench/scorers
 27 2 2024-07-31 2025-03-24 12 9 ismailmehdi@gmail.com mebadi@google.com
recallmatcher.py
in evalbench/scorers
 61 3 2024-07-31 2025-03-24 11 9 ismailmehdi@gmail.com mebadi@google.com
generatedqueryregexpmatcher.py
in evalbench/scorers
 57 3 2024-07-31 2025-03-01 9 9 ismailmehdi@gmail.com 42976936+mahyareb@users.nor...
eval_service.py
in evalbench
 141 4 2024-08-20 2025-03-28 28 8 yangtian@google.com 42976936+mahyareb@users.nor...
evalinput.py
in evalbench/dataset
 117 9 2024-07-31 2025-03-28 19 8 ismailmehdi@gmail.com mebadi@google.com
alloydb.py
in evalbench/databases
 35 1 2024-07-31 2025-04-29 19 8 ismailmehdi@gmail.com m1378.prz@gmail.com
sqlserver.py
in evalbench/databases
 219 16 2024-10-02 2025-04-28 24 7 42976936+mahyareb@users.nor... jahnaviii@google.com
db.py
in evalbench/databases
 132 23 2024-07-31 2025-04-28 14 7 ismailmehdi@gmail.com 90177675+jahnavi2k@users.no...
proto
eval_request.proto
in evalbench/evalproto
 52 - 2024-08-29 2025-03-28 13 7 ismailmehdi@gmail.com mebadi@google.com
__init__.py
in evalbench/generators/models
 26 1 2024-07-31 2025-04-29 13 7 ismailmehdi@gmail.com 42976936+mahyareb@users.nor...
util.py
in evalbench/databases
 115 5 2024-07-31 2025-03-24 12 7 ismailmehdi@gmail.com mebadi@google.com
util.py
in evalbench/scorers
 35 2 2024-11-15 2025-03-24 7 7 51998522+viditchopra1500@us... mebadi@google.com
config.py
in evalbench/util
 143 11 2024-07-31 2025-04-28 16 6 ismailmehdi@gmail.com 90177675+jahnavi2k@users.no...
returnedsql.py
in evalbench/scorers
 30 2 2024-10-10 2025-03-24 10 6 hardikgupta@google.com 42976936+mahyareb@users.nor...
20 - 2025-03-31 2025-04-23 10 6 mebadi@google.com 90177675+jahnavi2k@users.no...
proto
eval_service.proto
in evalbench/evalproto
 37 - 2024-08-29 2025-02-05 8 6 ismailmehdi@gmail.com mebadi@google.com
__init__.py
in evalbench/generators/prompts
 7 1 2024-07-31 2025-03-30 8 6 ismailmehdi@gmail.com 42976936+mahyareb@users.nor...
proto
eval_config.proto
in evalbench/evalproto
 11 - 2024-08-29 2025-02-01 7 6 ismailmehdi@gmail.com 42976936+mahyareb@users.nor...
setmatcher.py
in evalbench/scorers
 36 2 2024-12-07 2025-03-24 6 6 hailong.leon@gmail.com 42976936+mahyareb@users.nor...
sqlite.py
in evalbench/databases
 196 16 2025-03-17 2025-04-28 13 5 jahnaviii@google.com jahnaviii@google.com
proto
eval_response.proto
in evalbench/evalproto
 7 - 2024-08-29 2025-02-01 7 5 ismailmehdi@gmail.com 42976936+mahyareb@users.nor...
passthrough.py
in evalbench/generators/models
 7 2 2024-08-20 2025-03-24 7 5 yangtian@google.com mebadi@google.com
__init__.py
in evalbench/repository
 3 1 2024-10-07 2025-02-01 5 5 hardikgupta@google.com 42976936+mahyareb@users.nor...
db_manager.py
in evalbench/evaluator
 94 6 2025-02-28 2025-04-28 11 4 mebadi@google.com 90177675+jahnavi2k@users.no...
orchestrator.py
in evalbench/evaluator
 190 4 2025-03-27 2025-04-29 10 4 mebadi@google.com 42976936+mahyareb@users.nor...
report.py
in evalbench/reporting
 28 5 2024-07-31 2025-04-15 7 4 ismailmehdi@gmail.com 90177675+jahnavi2k@users.no...
sessionmgr.py
in evalbench/util
 69 11 2024-08-31 2025-03-01 6 4 ismailmehdi@gmail.com 42976936+mahyareb@users.nor...
eval_server.py
in evalbench
 53 1 2024-08-20 2025-03-01 5 4 yangtian@google.com 42976936+mahyareb@users.nor...
sanitizer.py
in evalbench/util
 11 1 2025-02-28 2025-04-15 5 4 mebadi@google.com 90177675+jahnavi2k@users.no...
nldRepo.py
in evalbench/repository
 32 5 2025-01-24 2025-03-01 5 4 prernakakkar@google.com 42976936+mahyareb@users.nor...
bigquery.py
in evalbench/databases
 220 17 2025-04-18 2025-04-29 5 4 jahnaviii@google.com m1378.prz@gmail.com
proto
eval_connect.proto
in evalbench/evalproto
 6 - 2024-08-31 2025-02-01 4 4 ismailmehdi@gmail.com 42976936+mahyareb@users.nor...
sqlgenbase.py
in evalbench/generators/prompts
 23 3 2025-03-29 2025-04-28 4 4 42976936+mahyareb@users.nor... 90177675+jahnavi2k@users.no...
evalbench.yaml
in evalbench_service/k8s
 48 - 2024-08-26 2024-10-07 3 4 ismailmehdi@gmail.com hardikgupta@google.com
claude.py
in evalbench/generators/models
 32 2 2025-03-04 2025-03-24 2 4 90177675+jahnavi2k@users.no... mebadi@google.com
generator.py
in evalbench/generators/models
 27 3 2024-07-31 2025-04-02 6 3 ismailmehdi@gmail.com mebadi@google.com
loghandler.py
in evalbench/util
 22 1 2024-11-15 2025-04-15 5 3 mebadi@google.com 90177675+jahnavi2k@users.no...
scorework.py
in evalbench/work
 23 2 2024-07-31 2025-03-30 5 3 ismailmehdi@gmail.com 42976936+mahyareb@users.nor...
Files With Least Contributors (Top 50)
Based on the number of unique email addresses found in commits.

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
service.yaml
in evalbench_service/k8s
 20 - 2024-08-26 2024-08-26 1 1 ismailmehdi@gmail.com ismailmehdi@gmail.com
progress.py
in evalbench/util
 16 1 2024-07-31 2024-07-31 1 1 ismailmehdi@gmail.com ismailmehdi@gmail.com
promptgenwork.py
in evalbench/work
 16 2 2024-07-31 2024-07-31 1 1 ismailmehdi@gmail.com ismailmehdi@gmail.com
mprunner.py
in evalbench/mp
 11 3 2024-07-31 2024-07-31 1 1 ismailmehdi@gmail.com ismailmehdi@gmail.com
ksa.yaml
in evalbench_service/k8s
 7 - 2024-08-26 2024-08-26 1 1 ismailmehdi@gmail.com ismailmehdi@gmail.com
noxfile.py
in root
 7 1 2024-08-31 2024-08-31 1 1 ismailmehdi@gmail.com ismailmehdi@gmail.com
__init__.py
in evalbench/work
 4 - 2024-07-31 2024-07-31 1 1 ismailmehdi@gmail.com ismailmehdi@gmail.com
namespace.yaml
in evalbench_service/k8s
 4 - 2024-08-26 2024-08-26 1 1 ismailmehdi@gmail.com ismailmehdi@gmail.com
__init__.py
in evalbench/dataset
 1 - 2024-07-31 2024-07-31 1 1 ismailmehdi@gmail.com ismailmehdi@gmail.com
__init__.py
in evalbench/mp
 1 - 2024-07-31 2024-07-31 1 1 ismailmehdi@gmail.com ismailmehdi@gmail.com
__init__.py
in evalbench/scorers
 1 - 2024-07-31 2024-07-31 1 1 ismailmehdi@gmail.com ismailmehdi@gmail.com
setup.sql
in datasets/bat/setup/db_blog/mysql
 811 - 2025-03-31 2025-04-01 2 2 mebadi@google.com 90177675+jahnavi2k@users.no...
setup.sql
in datasets/bat/setup/db_blog/postgres
 499 - 2025-03-31 2025-04-01 2 2 mebadi@google.com 90177675+jahnavi2k@users.no...
setup.sql
in datasets/bat/setup/db_blog/sqlite
 406 - 2025-03-31 2025-04-01 2 2 mebadi@google.com 90177675+jahnavi2k@users.no...
setup.sql
in datasets/bat/setup/db_blog/bigquery
 385 - 2025-04-18 2025-04-28 3 2 jahnaviii@google.com 90177675+jahnavi2k@users.no...
progress_reporter.py
in evalbench/evaluator
 202 15 2025-03-28 2025-03-30 3 2 42976936+mahyareb@users.nor... 42976936+mahyareb@users.nor...
eval_client.py
in evalbench/client
 83 1 2024-08-31 2024-09-09 4 2 ismailmehdi@gmail.com 75753836+hardikgu23@users.n...
post_setup.sql
in datasets/bat/setup/db_blog/postgres
 80 - 2025-03-31 2025-04-01 2 2 mebadi@google.com 90177675+jahnavi2k@users.no...
evalbench-test.yaml
in evalbench_service/k8s
 48 - 2024-10-15 2024-10-20 2 2 ismailmehdi@gmail.com hardikgupta@google.com
post_setup.sql
in datasets/bat/setup/db_blog/sqlserver
 38 - 2025-03-31 2025-04-01 2 2 mebadi@google.com 90177675+jahnavi2k@users.no...
post_setup.sql
in datasets/bat/setup/db_blog/bigquery
 36 - 2025-04-18 2025-04-28 2 2 jahnaviii@google.com 90177675+jahnavi2k@users.no...
rate_limit.py
in evalbench/util
 31 1 2025-03-24 2025-04-02 3 2 42976936+mahyareb@users.nor... mebadi@google.com
csv.py
in evalbench/reporting
 28 2 2025-03-24 2025-03-24 1 2 42976936+mahyareb@users.nor... mebadi@google.com
vertical-autoscale-test.yaml
in evalbench_service/k8s
 23 - 2024-11-16 2024-11-18 2 2 mebadi@google.com 42976936+mahyareb@users.nor...
vertical-autoscale.yaml
in evalbench_service/k8s
 23 - 2024-11-16 2024-11-18 2 2 mebadi@google.com 42976936+mahyareb@users.nor...
alloydb_ai_nl.py
in evalbench/generators/models
 22 3 2025-04-28 2025-04-29 2 2 m1378.prz@gmail.com m1378.prz@gmail.com
service-test.yaml
in evalbench_service/k8s
 20 - 2024-10-15 2024-10-20 2 2 ismailmehdi@gmail.com hardikgupta@google.com
gcp.py
in evalbench/util
 17 2 2025-03-24 2025-03-25 2 2 42976936+mahyareb@users.nor... 42976936+mahyareb@users.nor...
service.py
in evalbench/util
 13 1 2025-02-28 2025-03-28 5 2 mebadi@google.com 42976936+mahyareb@users.nor...
evaloutput.py
in evalbench/dataset
 7 1 2024-07-31 2024-09-09 3 2 ismailmehdi@gmail.com 75753836+hardikgu23@users.n...
base.py
in evalbench/repository
 7 2 2024-10-07 2024-10-08 2 2 hardikgupta@google.com 75753836+hardikgu23@users.n...
ksa-test.yaml
in evalbench_service/k8s
 7 - 2024-10-15 2024-10-20 2 2 ismailmehdi@gmail.com hardikgupta@google.com
alloydb.yaml
in datasets/bat/db_configs
 7 - 2025-04-29 2025-04-29 1 2 42976936+mahyareb@users.nor... m1378.prz@gmail.com
sqlserver.yaml
in datasets/bat/db_configs
 6 - 2025-03-31 2025-04-01 2 2 mebadi@google.com 90177675+jahnavi2k@users.no...
mysql.yaml
in datasets/bat/db_configs
 6 - 2025-03-31 2025-04-01 2 2 mebadi@google.com 90177675+jahnavi2k@users.no...
postgres.yaml
in datasets/bat/db_configs
 6 - 2025-03-31 2025-04-01 2 2 mebadi@google.com 90177675+jahnavi2k@users.no...
bigquery.yaml
in datasets/bat/db_configs
 5 - 2025-04-18 2025-04-28 2 2 jahnaviii@google.com 90177675+jahnavi2k@users.no...
namespace-test.yaml
in evalbench_service/k8s
 4 - 2024-10-15 2024-10-20 2 2 ismailmehdi@gmail.com hardikgupta@google.com
4 - 2025-03-24 2025-03-24 1 2 42976936+mahyareb@users.nor... mebadi@google.com
sqlite.yaml
in datasets/bat/db_configs
 4 - 2025-03-31 2025-04-01 2 2 mebadi@google.com 90177675+jahnavi2k@users.no...
gemini_2.5_pro_model.yaml
in datasets/model_configs
 4 - 2025-04-21 2025-04-22 2 2 90177675+jahnavi2k@users.no... 90177675+jahnavi2k@users.no...
pre_setup.sql
in datasets/bat/setup/db_blog/bigquery
 1 - 2025-04-18 2025-04-28 2 2 jahnaviii@google.com 90177675+jahnavi2k@users.no...
pre_setup.sql
in datasets/bat/setup/db_blog/sqlite
 1 - 2025-03-31 2025-04-01 2 2 mebadi@google.com 90177675+jahnavi2k@users.no...
post_setup.sql
in datasets/bat/setup/db_blog/sqlite
 1 - 2025-03-31 2025-04-01 2 2 mebadi@google.com 90177675+jahnavi2k@users.no...
pre_setup.sql
in datasets/bat/setup/db_blog/mysql
 1 - 2025-03-31 2025-04-01 2 2 mebadi@google.com 90177675+jahnavi2k@users.no...
post_setup.sql
in datasets/bat/setup/db_blog/mysql
 1 - 2025-03-31 2025-04-01 2 2 mebadi@google.com 90177675+jahnavi2k@users.no...
pre_setup.sql
in datasets/bat/setup/db_blog/sqlserver
 1 - 2025-03-31 2025-04-01 2 2 mebadi@google.com 90177675+jahnavi2k@users.no...
pre_setup.sql
in datasets/bat/setup/db_blog/postgres
 1 - 2025-03-31 2025-04-01 2 2 mebadi@google.com 90177675+jahnavi2k@users.no...
setup.sql
in datasets/bat/setup/db_blog/sqlserver
 366 - 2025-03-31 2025-04-15 5 3 mebadi@google.com 90177675+jahnavi2k@users.no...
generator.py
in evalbench/generators/models
 27 3 2024-07-31 2025-04-02 6 3 ismailmehdi@gmail.com mebadi@google.com
Correlations

File Size vs. Number of Changes: 114 points

evalbench/databases/bigquery.py x: 220 lines of code y: 5 # changes datasets/bat/db_configs/alloydb.yaml x: 7 lines of code y: 1 # changes evalbench/databases/__init__.py x: 23 lines of code y: 15 # changes evalbench/databases/alloydb.py x: 35 lines of code y: 19 # changes evalbench/evaluator/orchestrator.py x: 190 lines of code y: 10 # changes evalbench/generators/models/__init__.py x: 26 lines of code y: 13 # changes evalbench/generators/models/alloydb_ai_nl.py x: 22 lines of code y: 2 # changes datasets/bat/db_configs/bigquery.yaml x: 5 lines of code y: 2 # changes datasets/bat/setup/db_blog/bigquery/post_setup.sql x: 36 lines of code y: 2 # changes datasets/bat/setup/db_blog/bigquery/pre_setup.sql x: 1 lines of code y: 2 # changes datasets/bat/setup/db_blog/bigquery/setup.sql x: 385 lines of code y: 3 # changes evalbench/databases/db.py x: 132 lines of code y: 14 # changes evalbench/databases/mysql.py x: 197 lines of code y: 30 # changes evalbench/databases/postgres.py x: 192 lines of code y: 25 # changes evalbench/databases/sqlite.py x: 196 lines of code y: 13 # changes evalbench/databases/sqlserver.py x: 219 lines of code y: 24 # changes evalbench/evaluator/db_manager.py x: 94 lines of code y: 11 # changes evalbench/generators/prompts/sqlgenbase.py x: 23 lines of code y: 4 # changes evalbench/util/config.py x: 143 lines of code y: 16 # changes datasets/bat/example_run_config.yaml x: 20 lines of code y: 10 # changes datasets/model_configs/gemini_2.5_pro_model.yaml x: 4 lines of code y: 2 # changes evalbench/work/sqlexecwork.py x: 99 lines of code y: 29 # changes datasets/bird/db_configs/sqlite.yaml x: 5 lines of code y: 5 # changes datasets/bird/example_run_config.yaml x: 19 lines of code y: 5 # changes datasets/model_configs/claude_3.5_model.yaml x: 4 lines of code y: 4 # changes evalbench/dataset/dataset.py x: 112 lines of code y: 27 # changes datasets/bat/setup/db_blog/sqlserver/setup.sql x: 366 lines of code y: 5 # changes evalbench/evalbench.py x: 64 lines of code y: 30 # changes evalbench/evaluator/evaluator.py x: 90 lines of code y: 30 # changes evalbench/generators/models/gemini.py x: 38 lines of code y: 16 # changes evalbench/reporting/report.py x: 28 lines of code y: 7 # changes evalbench/scorers/score.py x: 68 lines of code y: 25 # changes evalbench/util/loghandler.py x: 22 lines of code y: 5 # changes evalbench/util/sanitizer.py x: 11 lines of code y: 5 # changes evalbench/generators/models/generator.py x: 27 lines of code y: 6 # changes evalbench/util/rate_limit.py x: 31 lines of code y: 3 # changes datasets/bat/db_configs/mysql.yaml x: 6 lines of code y: 2 # changes datasets/bat/setup/db_blog/mysql/setup.sql x: 811 lines of code y: 2 # changes datasets/bat/setup/db_blog/postgres/post_setup.sql x: 80 lines of code y: 2 # changes datasets/bat/setup/db_blog/postgres/setup.sql x: 499 lines of code y: 2 # changes datasets/bat/setup/db_blog/sqlite/setup.sql x: 406 lines of code y: 2 # changes datasets/bat/setup/db_blog/sqlserver/post_setup.sql x: 38 lines of code y: 2 # changes evalbench/evaluator/progress_reporter.py x: 202 lines of code y: 3 # changes evalbench/generators/prompts/__init__.py x: 7 lines of code y: 8 # changes evalbench/scorers/llmrater.py x: 113 lines of code y: 29 # changes evalbench/dataset/evalinput.py x: 117 lines of code y: 19 # changes evalbench/eval_service.py x: 141 lines of code y: 28 # changes evalbench/evalproto/eval_request.proto x: 52 lines of code y: 13 # changes evalbench/util/service.py x: 13 lines of code y: 5 # changes evalbench/util/gcp.py x: 17 lines of code y: 2 # changes evalbench/reporting/csv.py x: 28 lines of code y: 1 # changes evalbench/scorers/returnedsql.py x: 30 lines of code y: 10 # changes evalbench/generators/models/claude.py x: 32 lines of code y: 2 # changes evalbench/scorers/setmatcher.py x: 36 lines of code y: 6 # changes evalbench/databases/util.py x: 115 lines of code y: 12 # changes evalbench/generators/models/passthrough.py x: 7 lines of code y: 7 # changes evalbench/generators/prompts/generator.py x: 10 lines of code y: 2 # changes evalbench/generators/prompts/passthrough.py x: 8 lines of code y: 2 # changes evalbench/reporting/__init__.py x: 12 lines of code y: 2 # changes evalbench/reporting/analyzer.py x: 84 lines of code y: 14 # changes evalbench/scorers/exactmatcher.py x: 27 lines of code y: 12 # changes evalbench/scorers/recallmatcher.py x: 61 lines of code y: 11 # changes evalbench/scorers/util.py x: 35 lines of code y: 7 # changes pyproject.toml x: 4 lines of code y: 1 # changes evalbench/scorers/comparator.py x: 70 lines of code y: 13 # changes evalbench/eval_server.py x: 53 lines of code y: 5 # changes evalbench/repository/nldRepo.py x: 32 lines of code y: 5 # changes evalbench/scorers/generatedqueryregexpmatcher.py x: 57 lines of code y: 9 # changes evalbench/util/sessionmgr.py x: 69 lines of code y: 6 # changes evalbench/work/work.py x: 6 lines of code y: 3 # changes evalbench/evalproto/eval_service.proto x: 37 lines of code y: 8 # changes evalbench/evalproto/eval_config.proto x: 11 lines of code y: 7 # changes evalbench/evalproto/eval_connect.proto x: 6 lines of code y: 4 # changes evalbench/repository/__init__.py x: 3 lines of code y: 5 # changes evalbench_service/k8s/evalbench-test.yaml x: 48 lines of code y: 2 # changes evalbench_service/k8s/service-test.yaml x: 20 lines of code y: 2 # changes evalbench_service/k8s/evalbench.yaml x: 48 lines of code y: 3 # changes evalbench/work/sqlgenwork.py x: 25 lines of code y: 5 # changes evalbench/client/eval_client.py x: 83 lines of code y: 4 # changes evalbench_service/k8s/service.yaml x: 20 lines of code y: 1 # changes evalbench/dataset/__init__.py x: 1 lines of code y: 1 # changes evalbench/mp/mprunner.py x: 11 lines of code y: 1 # changes evalbench/util/progress.py x: 16 lines of code y: 1 # changes
30.0
# changes
  min: 1.0
  average: 6.98
  25th percentile: 2.0
  median: 4.0
  75th percentile: 9.25
  max: 30.0
0 811.0
lines of code
min: 1.0 | average: 61.15 | 25th percentile: 6.0 | median: 23.0 | 75th percentile: 65.0 | max: 811.0

Number of Contributors vs. Number of Changes: 114 points

evalbench/databases/bigquery.py x: 4 # contributors y: 5 # changes datasets/bat/db_configs/alloydb.yaml x: 2 # contributors y: 1 # changes evalbench/databases/__init__.py x: 9 # contributors y: 15 # changes evalbench/databases/alloydb.py x: 8 # contributors y: 19 # changes evalbench/evaluator/orchestrator.py x: 4 # contributors y: 10 # changes evalbench/generators/models/__init__.py x: 7 # contributors y: 13 # changes evalbench/generators/models/alloydb_ai_nl.py x: 2 # contributors y: 2 # changes datasets/bat/setup/db_blog/bigquery/setup.sql x: 2 # contributors y: 3 # changes evalbench/databases/db.py x: 7 # contributors y: 14 # changes evalbench/databases/mysql.py x: 10 # contributors y: 30 # changes evalbench/databases/postgres.py x: 9 # contributors y: 25 # changes evalbench/databases/sqlite.py x: 5 # contributors y: 13 # changes evalbench/databases/sqlserver.py x: 7 # contributors y: 24 # changes evalbench/evaluator/db_manager.py x: 4 # contributors y: 11 # changes evalbench/generators/prompts/sqlgenbase.py x: 4 # contributors y: 4 # changes evalbench/util/config.py x: 6 # contributors y: 16 # changes datasets/bat/example_run_config.yaml x: 6 # contributors y: 10 # changes evalbench/work/sqlexecwork.py x: 9 # contributors y: 29 # changes datasets/bird/db_configs/sqlite.yaml x: 3 # contributors y: 5 # changes datasets/model_configs/claude_3.5_model.yaml x: 3 # contributors y: 4 # changes evalbench/dataset/dataset.py x: 10 # contributors y: 27 # changes evalbench/evalbench.py x: 9 # contributors y: 30 # changes evalbench/generators/models/gemini.py x: 9 # contributors y: 16 # changes evalbench/reporting/report.py x: 4 # contributors y: 7 # changes evalbench/scorers/score.py x: 12 # contributors y: 25 # changes evalbench/generators/models/generator.py x: 3 # contributors y: 6 # changes evalbench/generators/prompts/__init__.py x: 6 # contributors y: 8 # changes evalbench/scorers/llmrater.py x: 11 # contributors y: 29 # changes evalbench/eval_service.py x: 8 # contributors y: 28 # changes evalbench/util/service.py x: 2 # contributors y: 5 # changes evalbench/generators/models/claude.py x: 4 # contributors y: 2 # changes evalbench/scorers/setmatcher.py x: 6 # contributors y: 6 # changes evalbench/databases/util.py x: 7 # contributors y: 12 # changes evalbench/generators/models/passthrough.py x: 5 # contributors y: 7 # changes evalbench/generators/prompts/generator.py x: 3 # contributors y: 2 # changes evalbench/reporting/analyzer.py x: 10 # contributors y: 14 # changes evalbench/scorers/exactmatcher.py x: 9 # contributors y: 12 # changes evalbench/scorers/recallmatcher.py x: 9 # contributors y: 11 # changes evalbench/scorers/util.py x: 7 # contributors y: 7 # changes evalbench/scorers/comparator.py x: 9 # contributors y: 13 # changes evalbench/scorers/generatedqueryregexpmatcher.py x: 9 # contributors y: 9 # changes evalbench/util/sessionmgr.py x: 4 # contributors y: 6 # changes evalbench/work/work.py x: 3 # contributors y: 3 # changes evalbench/evalproto/eval_config.proto x: 6 # contributors y: 7 # changes evalbench/repository/__init__.py x: 5 # contributors y: 5 # changes evalbench_service/k8s/evalbench.yaml x: 4 # contributors y: 3 # changes evalbench/client/eval_client.py x: 2 # contributors y: 4 # changes noxfile.py x: 1 # contributors y: 1 # changes
30.0
# changes
  min: 1.0
  average: 6.98
  25th percentile: 2.0
  median: 4.0
  75th percentile: 9.25
  max: 30.0
0 12.0
# contributors
min: 1.0 | average: 4.04 | 25th percentile: 2.0 | median: 3.0 | 75th percentile: 6.0 | max: 12.0

Number of Contributors vs. File Size: 114 points

evalbench/databases/bigquery.py x: 4 # contributors y: 220 lines of code datasets/bat/db_configs/alloydb.yaml x: 2 # contributors y: 7 lines of code evalbench/databases/__init__.py x: 9 # contributors y: 23 lines of code evalbench/databases/alloydb.py x: 8 # contributors y: 35 lines of code evalbench/evaluator/orchestrator.py x: 4 # contributors y: 190 lines of code evalbench/generators/models/__init__.py x: 7 # contributors y: 26 lines of code evalbench/generators/models/alloydb_ai_nl.py x: 2 # contributors y: 22 lines of code datasets/bat/db_configs/bigquery.yaml x: 2 # contributors y: 5 lines of code datasets/bat/setup/db_blog/bigquery/post_setup.sql x: 2 # contributors y: 36 lines of code datasets/bat/setup/db_blog/bigquery/pre_setup.sql x: 2 # contributors y: 1 lines of code datasets/bat/setup/db_blog/bigquery/setup.sql x: 2 # contributors y: 385 lines of code evalbench/databases/db.py x: 7 # contributors y: 132 lines of code evalbench/databases/mysql.py x: 10 # contributors y: 197 lines of code evalbench/databases/postgres.py x: 9 # contributors y: 192 lines of code evalbench/databases/sqlite.py x: 5 # contributors y: 196 lines of code evalbench/databases/sqlserver.py x: 7 # contributors y: 219 lines of code evalbench/evaluator/db_manager.py x: 4 # contributors y: 94 lines of code evalbench/generators/prompts/sqlgenbase.py x: 4 # contributors y: 23 lines of code evalbench/util/config.py x: 6 # contributors y: 143 lines of code datasets/bat/example_run_config.yaml x: 6 # contributors y: 20 lines of code evalbench/work/sqlexecwork.py x: 9 # contributors y: 99 lines of code datasets/bird/db_configs/sqlite.yaml x: 3 # contributors y: 5 lines of code datasets/bird/example_run_config.yaml x: 3 # contributors y: 19 lines of code datasets/model_configs/gemini_1.0_pro_model.yaml x: 3 # contributors y: 3 lines of code evalbench/dataset/dataset.py x: 10 # contributors y: 112 lines of code datasets/bat/setup/db_blog/sqlserver/setup.sql x: 3 # contributors y: 366 lines of code evalbench/evalbench.py x: 9 # contributors y: 64 lines of code evalbench/evaluator/evaluator.py x: 9 # contributors y: 90 lines of code evalbench/generators/models/gemini.py x: 9 # contributors y: 38 lines of code evalbench/reporting/report.py x: 4 # contributors y: 28 lines of code evalbench/scorers/executablesql.py x: 3 # contributors y: 23 lines of code evalbench/scorers/score.py x: 12 # contributors y: 68 lines of code evalbench/util/loghandler.py x: 3 # contributors y: 22 lines of code evalbench/util/sanitizer.py x: 4 # contributors y: 11 lines of code evalbench/generators/models/generator.py x: 3 # contributors y: 27 lines of code evalbench/util/rate_limit.py x: 2 # contributors y: 31 lines of code datasets/bat/setup/db_blog/mysql/setup.sql x: 2 # contributors y: 811 lines of code datasets/bat/setup/db_blog/postgres/post_setup.sql x: 2 # contributors y: 80 lines of code datasets/bat/setup/db_blog/postgres/setup.sql x: 2 # contributors y: 499 lines of code datasets/bat/setup/db_blog/sqlite/setup.sql x: 2 # contributors y: 406 lines of code evalbench/evaluator/progress_reporter.py x: 2 # contributors y: 202 lines of code evalbench/generators/prompts/__init__.py x: 6 # contributors y: 7 lines of code evalbench/scorers/llmrater.py x: 11 # contributors y: 113 lines of code evalbench/dataset/evalinput.py x: 8 # contributors y: 117 lines of code evalbench/eval_service.py x: 8 # contributors y: 141 lines of code evalbench/evalproto/eval_request.proto x: 7 # contributors y: 52 lines of code evalbench/util/service.py x: 2 # contributors y: 13 lines of code evalbench/util/gcp.py x: 2 # contributors y: 17 lines of code evalbench/reporting/csv.py x: 2 # contributors y: 28 lines of code evalbench/scorers/returnedsql.py x: 6 # contributors y: 30 lines of code evalbench/generators/models/claude.py x: 4 # contributors y: 32 lines of code evalbench/scorers/setmatcher.py x: 6 # contributors y: 36 lines of code evalbench/databases/util.py x: 7 # contributors y: 115 lines of code evalbench/generators/models/passthrough.py x: 5 # contributors y: 7 lines of code evalbench/generators/prompts/generator.py x: 3 # contributors y: 10 lines of code evalbench/generators/prompts/passthrough.py x: 3 # contributors y: 8 lines of code evalbench/reporting/analyzer.py x: 10 # contributors y: 84 lines of code evalbench/scorers/exactmatcher.py x: 9 # contributors y: 27 lines of code evalbench/scorers/recallmatcher.py x: 9 # contributors y: 61 lines of code evalbench/scorers/util.py x: 7 # contributors y: 35 lines of code evalbench/scorers/comparator.py x: 9 # contributors y: 70 lines of code evalbench/eval_server.py x: 4 # contributors y: 53 lines of code evalbench/scorers/generatedqueryregexpmatcher.py x: 9 # contributors y: 57 lines of code evalbench/util/sessionmgr.py x: 4 # contributors y: 69 lines of code evalbench/evalproto/eval_config.proto x: 6 # contributors y: 11 lines of code evalbench/evalproto/eval_connect.proto x: 4 # contributors y: 6 lines of code evalbench/repository/__init__.py x: 5 # contributors y: 3 lines of code evalbench_service/k8s/vertical-autoscale-test.yaml x: 2 # contributors y: 23 lines of code evalbench_service/k8s/evalbench-test.yaml x: 2 # contributors y: 48 lines of code evalbench_service/k8s/evalbench.yaml x: 4 # contributors y: 48 lines of code noxfile.py x: 1 # contributors y: 7 lines of code evalbench_service/k8s/namespace.yaml x: 1 # contributors y: 4 lines of code evalbench_service/k8s/service.yaml x: 1 # contributors y: 20 lines of code evalbench/dataset/__init__.py x: 1 # contributors y: 1 lines of code evalbench/mp/mprunner.py x: 1 # contributors y: 11 lines of code evalbench/util/progress.py x: 1 # contributors y: 16 lines of code
811.0
lines of code
  min: 1.0
  average: 61.15
  25th percentile: 6.0
  median: 23.0
  75th percentile: 65.0
  max: 811.0
0 12.0
# contributors
min: 1.0 | average: 4.04 | 25th percentile: 2.0 | median: 3.0 | 75th percentile: 6.0 | max: 12.0