GoogleCloudPlatform / evalbench
File Size

The distribution of size of files (measured in lines of code).

Intro
Learn more...
File Size Overall
0% | 11% | 32% | 23% | 31%
Legend:
1001+
501-1000
201-500
101-200
1-100


explore: grouped by folders | grouped by size | sunburst | 3D view
File Size per Extension
1001+
501-1000
201-500
101-200
1-100
sql0% | 30% | 63% | 0% | 6%
py0% | 0% | 16% | 42% | 41%
yaml0% | 0% | 0% | 0% | 100%
proto0% | 0% | 0% | 0% | 100%
toml0% | 0% | 0% | 0% | 100%
File Size per Logical Decomposition
primary
1001+
501-1000
201-500
101-200
1-100
datasets0% | 29% | 60% | 0% | 9%
evalbench0% | 0% | 15% | 40% | 43%
evalbench_service0% | 0% | 0% | 0% | 100%
ROOT0% | 0% | 0% | 0% | 100%
Longest Files (Top 50)
File# lines# units
setup.sql
in datasets/bat/setup/db_blog/mysql
 811 -
setup.sql
in datasets/bat/setup/db_blog/postgres
 499 -
setup.sql
in datasets/bat/setup/db_blog/sqlite
 406 -
setup.sql
in datasets/bat/setup/db_blog/bigquery
 385 -
setup.sql
in datasets/bat/setup/db_blog/sqlserver
 366 -
bigquery.py
in evalbench/databases
 220 17
sqlserver.py
in evalbench/databases
 219 16
progress_reporter.py
in evalbench/evaluator
 202 15
mysql.py
in evalbench/databases
 197 15
sqlite.py
in evalbench/databases
 196 16
postgres.py
in evalbench/databases
 192 15
orchestrator.py
in evalbench/evaluator
 190 4
config.py
in evalbench/util
 143 11
eval_service.py
in evalbench
 141 4
db.py
in evalbench/databases
 132 23
evalinput.py
in evalbench/dataset
 117 9
util.py
in evalbench/databases
 115 5
llmrater.py
in evalbench/scorers
 113 5
dataset.py
in evalbench/dataset
 112 9
sqlexecwork.py
in evalbench/work
 99 6
db_manager.py
in evalbench/evaluator
 94 6
evaluator.py
in evalbench/evaluator
 90 2
analyzer.py
in evalbench/reporting
 84 2
eval_client.py
in evalbench/client
 83 1
post_setup.sql
in datasets/bat/setup/db_blog/postgres
 80 -
comparator.py
in evalbench/scorers
 70 6
sessionmgr.py
in evalbench/util
 69 11
score.py
in evalbench/scorers
 68 1
evalbench.py
in evalbench
 64 1
recallmatcher.py
in evalbench/scorers
 61 3
generatedqueryregexpmatcher.py
in evalbench/scorers
 57 3
eval_server.py
in evalbench
 53 1
proto
eval_request.proto
in evalbench/evalproto
 52 -
evalbench.yaml
in evalbench_service/k8s
 48 -
evalbench-test.yaml
in evalbench_service/k8s
 48 -
gemini.py
in evalbench/generators/models
 38 2
post_setup.sql
in datasets/bat/setup/db_blog/sqlserver
 38 -
proto
eval_service.proto
in evalbench/evalproto
 37 -
setmatcher.py
in evalbench/scorers
 36 2
post_setup.sql
in datasets/bat/setup/db_blog/bigquery
 36 -
util.py
in evalbench/scorers
 35 2
alloydb.py
in evalbench/databases
 35 1
claude.py
in evalbench/generators/models
 32 2
nldRepo.py
in evalbench/repository
 32 5
rate_limit.py
in evalbench/util
 31 1
returnedsql.py
in evalbench/scorers
 30 2
csv.py
in evalbench/reporting
 28 2
report.py
in evalbench/reporting
 28 5
generator.py
in evalbench/generators/models
 27 3
exactmatcher.py
in evalbench/scorers
 27 2
Files With Most Units (Top 50)
File# lines# units
db.py
in evalbench/databases
 132 23
bigquery.py
in evalbench/databases
 220 17
sqlserver.py
in evalbench/databases
 219 16
sqlite.py
in evalbench/databases
 196 16
progress_reporter.py
in evalbench/evaluator
 202 15
mysql.py
in evalbench/databases
 197 15
postgres.py
in evalbench/databases
 192 15
sessionmgr.py
in evalbench/util
 69 11
config.py
in evalbench/util
 143 11
dataset.py
in evalbench/dataset
 112 9
evalinput.py
in evalbench/dataset
 117 9
db_manager.py
in evalbench/evaluator
 94 6
sqlexecwork.py
in evalbench/work
 99 6
comparator.py
in evalbench/scorers
 70 6
report.py
in evalbench/reporting
 28 5
nldRepo.py
in evalbench/repository
 32 5
llmrater.py
in evalbench/scorers
 113 5
util.py
in evalbench/databases
 115 5
orchestrator.py
in evalbench/evaluator
 190 4
eval_service.py
in evalbench
 141 4
mprunner.py
in evalbench/mp
 11 3
passthrough.py
in evalbench/generators/prompts
 8 3
generator.py
in evalbench/generators/prompts
 10 3
sqlgenbase.py
in evalbench/generators/prompts
 23 3
generator.py
in evalbench/generators/models
 27 3
alloydb_ai_nl.py
in evalbench/generators/models
 22 3
generatedqueryregexpmatcher.py
in evalbench/scorers
 57 3
recallmatcher.py
in evalbench/scorers
 61 3
evaluator.py
in evalbench/evaluator
 90 2
csv.py
in evalbench/reporting
 28 2
analyzer.py
in evalbench/reporting
 84 2
passthrough.py
in evalbench/generators/models
 7 2
claude.py
in evalbench/generators/models
 32 2
gemini.py
in evalbench/generators/models
 38 2
gcp.py
in evalbench/util
 17 2
work.py
in evalbench/work
 6 2
promptgenwork.py
in evalbench/work
 16 2
scorework.py
in evalbench/work
 23 2
sqlgenwork.py
in evalbench/work
 25 2
base.py
in evalbench/repository
 7 2
executablesql.py
in evalbench/scorers
 23 2
util.py
in evalbench/scorers
 35 2
setmatcher.py
in evalbench/scorers
 36 2
returnedsql.py
in evalbench/scorers
 30 2
exactmatcher.py
in evalbench/scorers
 27 2
evaloutput.py
in evalbench/dataset
 7 1
evalbench.py
in evalbench
 64 1
eval_server.py
in evalbench
 53 1
__init__.py
in evalbench/reporting
 12 1
__init__.py
in evalbench/generators/prompts
 7 1
Files With Long Lines (Top 2)

There are 2 files with lines longer than 120 characters. In total, there are 3 long lines.

File# lines# units# long lines
bigquery.py
in evalbench/databases
 220 17 2
util.py
in evalbench/databases
 115 5 1
Correlations

File Size vs. Commits (all time): 114 points

evalbench/databases/bigquery.py x: 8 commits (all time) y: 220 lines of code datasets/bat/db_configs/alloydb.yaml x: 2 commits (all time) y: 7 lines of code evalbench/databases/__init__.py x: 23 commits (all time) y: 23 lines of code evalbench/databases/alloydb.py x: 28 commits (all time) y: 35 lines of code evalbench/evaluator/orchestrator.py x: 29 commits (all time) y: 190 lines of code evalbench/generators/models/__init__.py x: 21 commits (all time) y: 26 lines of code evalbench/generators/models/alloydb_ai_nl.py x: 4 commits (all time) y: 22 lines of code datasets/bat/db_configs/bigquery.yaml x: 2 commits (all time) y: 5 lines of code datasets/bat/setup/db_blog/bigquery/post_setup.sql x: 2 commits (all time) y: 36 lines of code datasets/bat/setup/db_blog/bigquery/pre_setup.sql x: 2 commits (all time) y: 1 lines of code datasets/bat/setup/db_blog/bigquery/setup.sql x: 3 commits (all time) y: 385 lines of code evalbench/databases/db.py x: 21 commits (all time) y: 132 lines of code evalbench/databases/mysql.py x: 52 commits (all time) y: 197 lines of code evalbench/databases/postgres.py x: 42 commits (all time) y: 192 lines of code evalbench/databases/sqlite.py x: 30 commits (all time) y: 196 lines of code evalbench/databases/sqlserver.py x: 41 commits (all time) y: 219 lines of code evalbench/evaluator/db_manager.py x: 15 commits (all time) y: 94 lines of code evalbench/generators/prompts/sqlgenbase.py x: 6 commits (all time) y: 23 lines of code evalbench/util/config.py x: 30 commits (all time) y: 143 lines of code datasets/bat/example_run_config.yaml x: 21 commits (all time) y: 20 lines of code datasets/model_configs/gemini_2.5_pro_model.yaml x: 3 commits (all time) y: 4 lines of code evalbench/work/sqlexecwork.py x: 48 commits (all time) y: 99 lines of code datasets/bird/db_configs/sqlite.yaml x: 5 commits (all time) y: 5 lines of code datasets/bird/example_run_config.yaml x: 5 commits (all time) y: 19 lines of code datasets/model_configs/claude_3.5_model.yaml x: 4 commits (all time) y: 4 lines of code datasets/model_configs/gemini_1.0_pro_model.yaml x: 4 commits (all time) y: 3 lines of code evalbench/dataset/dataset.py x: 49 commits (all time) y: 112 lines of code datasets/bat/setup/db_blog/sqlserver/setup.sql x: 5 commits (all time) y: 366 lines of code evalbench/evalbench.py x: 59 commits (all time) y: 64 lines of code evalbench/evaluator/evaluator.py x: 48 commits (all time) y: 90 lines of code evalbench/generators/models/gemini.py x: 33 commits (all time) y: 38 lines of code evalbench/reporting/report.py x: 12 commits (all time) y: 28 lines of code evalbench/scorers/executablesql.py x: 4 commits (all time) y: 23 lines of code evalbench/scorers/score.py x: 33 commits (all time) y: 68 lines of code evalbench/util/loghandler.py x: 9 commits (all time) y: 22 lines of code evalbench/util/sanitizer.py x: 8 commits (all time) y: 11 lines of code evalbench/generators/models/generator.py x: 11 commits (all time) y: 27 lines of code evalbench/util/rate_limit.py x: 7 commits (all time) y: 31 lines of code datasets/bat/setup/db_blog/mysql/setup.sql x: 2 commits (all time) y: 811 lines of code datasets/bat/setup/db_blog/postgres/post_setup.sql x: 2 commits (all time) y: 80 lines of code datasets/bat/setup/db_blog/postgres/setup.sql x: 2 commits (all time) y: 499 lines of code datasets/bat/setup/db_blog/sqlite/setup.sql x: 2 commits (all time) y: 406 lines of code evalbench/evaluator/progress_reporter.py x: 13 commits (all time) y: 202 lines of code evalbench/generators/prompts/__init__.py x: 12 commits (all time) y: 7 lines of code evalbench/scorers/llmrater.py x: 46 commits (all time) y: 113 lines of code evalbench/work/scorework.py x: 5 commits (all time) y: 23 lines of code evalbench/dataset/evalinput.py x: 31 commits (all time) y: 117 lines of code evalbench/eval_service.py x: 50 commits (all time) y: 141 lines of code evalbench/evalproto/eval_request.proto x: 20 commits (all time) y: 52 lines of code evalbench/util/service.py x: 6 commits (all time) y: 13 lines of code evalbench/util/gcp.py x: 3 commits (all time) y: 17 lines of code evalbench/reporting/csv.py x: 5 commits (all time) y: 28 lines of code evalbench/scorers/returnedsql.py x: 13 commits (all time) y: 30 lines of code evalbench/generators/models/claude.py x: 11 commits (all time) y: 32 lines of code evalbench/scorers/setmatcher.py x: 9 commits (all time) y: 36 lines of code evalbench/databases/util.py x: 20 commits (all time) y: 115 lines of code evalbench/generators/models/passthrough.py x: 10 commits (all time) y: 7 lines of code evalbench/generators/prompts/generator.py x: 5 commits (all time) y: 10 lines of code evalbench/generators/prompts/passthrough.py x: 4 commits (all time) y: 8 lines of code evalbench/reporting/__init__.py x: 4 commits (all time) y: 12 lines of code evalbench/reporting/analyzer.py x: 20 commits (all time) y: 84 lines of code evalbench/scorers/exactmatcher.py x: 23 commits (all time) y: 27 lines of code evalbench/scorers/recallmatcher.py x: 18 commits (all time) y: 61 lines of code evalbench/scorers/util.py x: 10 commits (all time) y: 35 lines of code evalbench/scorers/comparator.py x: 17 commits (all time) y: 70 lines of code evalbench/eval_server.py x: 6 commits (all time) y: 53 lines of code evalbench/repository/nldRepo.py x: 7 commits (all time) y: 32 lines of code evalbench/scorers/generatedqueryregexpmatcher.py x: 14 commits (all time) y: 57 lines of code evalbench/util/sessionmgr.py x: 12 commits (all time) y: 69 lines of code evalbench/evalproto/eval_service.proto x: 10 commits (all time) y: 37 lines of code evalbench/evalproto/eval_config.proto x: 10 commits (all time) y: 11 lines of code evalbench/evalproto/eval_response.proto x: 8 commits (all time) y: 7 lines of code evalbench/repository/__init__.py x: 7 commits (all time) y: 3 lines of code evalbench_service/k8s/vertical-autoscale-test.yaml x: 2 commits (all time) y: 23 lines of code evalbench_service/k8s/evalbench-test.yaml x: 2 commits (all time) y: 48 lines of code evalbench_service/k8s/service-test.yaml x: 2 commits (all time) y: 20 lines of code evalbench_service/k8s/evalbench.yaml x: 5 commits (all time) y: 48 lines of code evalbench/client/eval_client.py x: 5 commits (all time) y: 83 lines of code evalbench/dataset/evaloutput.py x: 3 commits (all time) y: 7 lines of code evalbench_service/k8s/ksa.yaml x: 1 commits (all time) y: 7 lines of code evalbench_service/k8s/namespace.yaml x: 1 commits (all time) y: 4 lines of code evalbench_service/k8s/service.yaml x: 1 commits (all time) y: 20 lines of code evalbench/dataset/__init__.py x: 1 commits (all time) y: 1 lines of code evalbench/mp/mprunner.py x: 1 commits (all time) y: 11 lines of code evalbench/util/progress.py x: 1 commits (all time) y: 16 lines of code
811.0
lines of code
  min: 1.0
  average: 61.15
  25th percentile: 6.0
  median: 23.0
  75th percentile: 65.0
  max: 811.0
0 59.0
commits (all time)
min: 1.0 | average: 11.14 | 25th percentile: 2.0 | median: 5.0 | 75th percentile: 13.25 | max: 59.0

File Size vs. Contributors (all time): 114 points

evalbench/databases/bigquery.py x: 4 contributors (all time) y: 220 lines of code datasets/bat/db_configs/alloydb.yaml x: 2 contributors (all time) y: 7 lines of code evalbench/databases/__init__.py x: 9 contributors (all time) y: 23 lines of code evalbench/databases/alloydb.py x: 8 contributors (all time) y: 35 lines of code evalbench/evaluator/orchestrator.py x: 4 contributors (all time) y: 190 lines of code evalbench/generators/models/__init__.py x: 7 contributors (all time) y: 26 lines of code evalbench/generators/models/alloydb_ai_nl.py x: 2 contributors (all time) y: 22 lines of code datasets/bat/db_configs/bigquery.yaml x: 2 contributors (all time) y: 5 lines of code datasets/bat/setup/db_blog/bigquery/post_setup.sql x: 2 contributors (all time) y: 36 lines of code datasets/bat/setup/db_blog/bigquery/pre_setup.sql x: 2 contributors (all time) y: 1 lines of code datasets/bat/setup/db_blog/bigquery/setup.sql x: 2 contributors (all time) y: 385 lines of code evalbench/databases/db.py x: 7 contributors (all time) y: 132 lines of code evalbench/databases/mysql.py x: 10 contributors (all time) y: 197 lines of code evalbench/databases/postgres.py x: 9 contributors (all time) y: 192 lines of code evalbench/databases/sqlite.py x: 5 contributors (all time) y: 196 lines of code evalbench/databases/sqlserver.py x: 7 contributors (all time) y: 219 lines of code evalbench/evaluator/db_manager.py x: 4 contributors (all time) y: 94 lines of code evalbench/generators/prompts/sqlgenbase.py x: 4 contributors (all time) y: 23 lines of code evalbench/util/config.py x: 6 contributors (all time) y: 143 lines of code datasets/bat/example_run_config.yaml x: 6 contributors (all time) y: 20 lines of code evalbench/work/sqlexecwork.py x: 9 contributors (all time) y: 99 lines of code datasets/bird/db_configs/sqlite.yaml x: 3 contributors (all time) y: 5 lines of code datasets/bird/example_run_config.yaml x: 3 contributors (all time) y: 19 lines of code datasets/model_configs/gemini_1.0_pro_model.yaml x: 3 contributors (all time) y: 3 lines of code evalbench/dataset/dataset.py x: 10 contributors (all time) y: 112 lines of code datasets/bat/setup/db_blog/sqlserver/setup.sql x: 3 contributors (all time) y: 366 lines of code evalbench/evalbench.py x: 9 contributors (all time) y: 64 lines of code evalbench/evaluator/evaluator.py x: 9 contributors (all time) y: 90 lines of code evalbench/generators/models/gemini.py x: 9 contributors (all time) y: 38 lines of code evalbench/reporting/report.py x: 4 contributors (all time) y: 28 lines of code evalbench/scorers/executablesql.py x: 3 contributors (all time) y: 23 lines of code evalbench/scorers/score.py x: 12 contributors (all time) y: 68 lines of code evalbench/util/loghandler.py x: 3 contributors (all time) y: 22 lines of code evalbench/util/sanitizer.py x: 4 contributors (all time) y: 11 lines of code evalbench/generators/models/generator.py x: 3 contributors (all time) y: 27 lines of code evalbench/util/rate_limit.py x: 2 contributors (all time) y: 31 lines of code datasets/bat/setup/db_blog/mysql/setup.sql x: 2 contributors (all time) y: 811 lines of code datasets/bat/setup/db_blog/postgres/post_setup.sql x: 2 contributors (all time) y: 80 lines of code datasets/bat/setup/db_blog/postgres/setup.sql x: 2 contributors (all time) y: 499 lines of code datasets/bat/setup/db_blog/sqlite/setup.sql x: 2 contributors (all time) y: 406 lines of code evalbench/evaluator/progress_reporter.py x: 2 contributors (all time) y: 202 lines of code evalbench/generators/prompts/__init__.py x: 6 contributors (all time) y: 7 lines of code evalbench/scorers/llmrater.py x: 11 contributors (all time) y: 113 lines of code evalbench/dataset/evalinput.py x: 8 contributors (all time) y: 117 lines of code evalbench/eval_service.py x: 8 contributors (all time) y: 141 lines of code evalbench/evalproto/eval_request.proto x: 7 contributors (all time) y: 52 lines of code evalbench/util/service.py x: 2 contributors (all time) y: 13 lines of code evalbench/util/gcp.py x: 2 contributors (all time) y: 17 lines of code evalbench/reporting/csv.py x: 2 contributors (all time) y: 28 lines of code evalbench/scorers/returnedsql.py x: 6 contributors (all time) y: 30 lines of code evalbench/generators/models/claude.py x: 4 contributors (all time) y: 32 lines of code evalbench/scorers/setmatcher.py x: 6 contributors (all time) y: 36 lines of code evalbench/databases/util.py x: 7 contributors (all time) y: 115 lines of code evalbench/generators/models/passthrough.py x: 5 contributors (all time) y: 7 lines of code evalbench/generators/prompts/generator.py x: 3 contributors (all time) y: 10 lines of code evalbench/generators/prompts/passthrough.py x: 3 contributors (all time) y: 8 lines of code evalbench/reporting/analyzer.py x: 10 contributors (all time) y: 84 lines of code evalbench/scorers/exactmatcher.py x: 9 contributors (all time) y: 27 lines of code evalbench/scorers/recallmatcher.py x: 9 contributors (all time) y: 61 lines of code evalbench/scorers/util.py x: 7 contributors (all time) y: 35 lines of code evalbench/scorers/comparator.py x: 9 contributors (all time) y: 70 lines of code evalbench/eval_server.py x: 4 contributors (all time) y: 53 lines of code evalbench/scorers/generatedqueryregexpmatcher.py x: 9 contributors (all time) y: 57 lines of code evalbench/util/sessionmgr.py x: 4 contributors (all time) y: 69 lines of code evalbench/evalproto/eval_config.proto x: 6 contributors (all time) y: 11 lines of code evalbench/evalproto/eval_connect.proto x: 4 contributors (all time) y: 6 lines of code evalbench/repository/__init__.py x: 5 contributors (all time) y: 3 lines of code evalbench_service/k8s/vertical-autoscale-test.yaml x: 2 contributors (all time) y: 23 lines of code evalbench_service/k8s/evalbench-test.yaml x: 2 contributors (all time) y: 48 lines of code evalbench_service/k8s/evalbench.yaml x: 4 contributors (all time) y: 48 lines of code noxfile.py x: 1 contributors (all time) y: 7 lines of code evalbench_service/k8s/namespace.yaml x: 1 contributors (all time) y: 4 lines of code evalbench_service/k8s/service.yaml x: 1 contributors (all time) y: 20 lines of code evalbench/dataset/__init__.py x: 1 contributors (all time) y: 1 lines of code evalbench/mp/mprunner.py x: 1 contributors (all time) y: 11 lines of code evalbench/util/progress.py x: 1 contributors (all time) y: 16 lines of code
811.0
lines of code
  min: 1.0
  average: 61.15
  25th percentile: 6.0
  median: 23.0
  75th percentile: 65.0
  max: 811.0
0 12.0
contributors (all time)
min: 1.0 | average: 4.04 | 25th percentile: 2.0 | median: 3.0 | 75th percentile: 6.0 | max: 12.0

File Size vs. Commits (30 days): 40 points

evalbench/databases/bigquery.py x: 8 commits (30d) y: 220 lines of code datasets/bat/db_configs/alloydb.yaml x: 2 commits (30d) y: 7 lines of code evalbench/databases/__init__.py x: 4 commits (30d) y: 23 lines of code evalbench/databases/alloydb.py x: 3 commits (30d) y: 35 lines of code evalbench/evaluator/orchestrator.py x: 4 commits (30d) y: 190 lines of code evalbench/generators/models/__init__.py x: 2 commits (30d) y: 26 lines of code evalbench/generators/models/alloydb_ai_nl.py x: 4 commits (30d) y: 22 lines of code datasets/bat/db_configs/bigquery.yaml x: 2 commits (30d) y: 5 lines of code datasets/bat/setup/db_blog/bigquery/post_setup.sql x: 2 commits (30d) y: 36 lines of code datasets/bat/setup/db_blog/bigquery/pre_setup.sql x: 2 commits (30d) y: 1 lines of code datasets/bat/setup/db_blog/bigquery/setup.sql x: 3 commits (30d) y: 385 lines of code evalbench/databases/db.py x: 9 commits (30d) y: 132 lines of code evalbench/databases/mysql.py x: 5 commits (30d) y: 197 lines of code evalbench/databases/postgres.py x: 5 commits (30d) y: 192 lines of code evalbench/databases/sqlite.py x: 8 commits (30d) y: 196 lines of code evalbench/databases/sqlserver.py x: 5 commits (30d) y: 219 lines of code evalbench/evaluator/db_manager.py x: 4 commits (30d) y: 94 lines of code evalbench/generators/prompts/sqlgenbase.py x: 2 commits (30d) y: 23 lines of code evalbench/util/config.py x: 6 commits (30d) y: 143 lines of code datasets/bat/example_run_config.yaml x: 11 commits (30d) y: 20 lines of code datasets/model_configs/gemini_2.5_pro_model.yaml x: 3 commits (30d) y: 4 lines of code evalbench/work/sqlexecwork.py x: 5 commits (30d) y: 99 lines of code datasets/bird/db_configs/sqlite.yaml x: 3 commits (30d) y: 5 lines of code datasets/bird/example_run_config.yaml x: 3 commits (30d) y: 19 lines of code datasets/model_configs/gemini_1.0_pro_model.yaml x: 3 commits (30d) y: 3 lines of code evalbench/dataset/dataset.py x: 3 commits (30d) y: 112 lines of code datasets/bat/setup/db_blog/sqlserver/setup.sql x: 2 commits (30d) y: 366 lines of code evalbench/evalbench.py x: 5 commits (30d) y: 64 lines of code evalbench/evaluator/evaluator.py x: 2 commits (30d) y: 90 lines of code evalbench/generators/models/gemini.py x: 7 commits (30d) y: 38 lines of code evalbench/reporting/report.py x: 2 commits (30d) y: 28 lines of code evalbench/scorers/score.py x: 2 commits (30d) y: 68 lines of code evalbench/util/loghandler.py x: 2 commits (30d) y: 22 lines of code evalbench/util/sanitizer.py x: 5 commits (30d) y: 11 lines of code
385.0
lines of code
  min: 1.0
  average: 78.43
  25th percentile: 5.5
  median: 27.0
  75th percentile: 127.0
  max: 385.0
0 11.0
commits (30d)
min: 2.0 | average: 3.88 | 25th percentile: 2.0 | median: 3.0 | 75th percentile: 5.0 | max: 11.0

File Size vs. Contributors (30 days): 40 points

evalbench/databases/bigquery.py x: 4 contributors (30d) y: 220 lines of code datasets/bat/db_configs/alloydb.yaml x: 2 contributors (30d) y: 7 lines of code evalbench/databases/__init__.py x: 4 contributors (30d) y: 23 lines of code evalbench/databases/alloydb.py x: 2 contributors (30d) y: 35 lines of code evalbench/evaluator/orchestrator.py x: 3 contributors (30d) y: 190 lines of code evalbench/generators/models/__init__.py x: 2 contributors (30d) y: 26 lines of code evalbench/generators/models/alloydb_ai_nl.py x: 2 contributors (30d) y: 22 lines of code datasets/bat/db_configs/bigquery.yaml x: 2 contributors (30d) y: 5 lines of code datasets/bat/setup/db_blog/bigquery/pre_setup.sql x: 2 contributors (30d) y: 1 lines of code datasets/bat/setup/db_blog/bigquery/setup.sql x: 2 contributors (30d) y: 385 lines of code evalbench/databases/db.py x: 3 contributors (30d) y: 132 lines of code evalbench/databases/mysql.py x: 2 contributors (30d) y: 197 lines of code evalbench/databases/postgres.py x: 2 contributors (30d) y: 192 lines of code evalbench/databases/sqlite.py x: 3 contributors (30d) y: 196 lines of code evalbench/databases/sqlserver.py x: 2 contributors (30d) y: 219 lines of code evalbench/evaluator/db_manager.py x: 2 contributors (30d) y: 94 lines of code evalbench/generators/prompts/sqlgenbase.py x: 2 contributors (30d) y: 23 lines of code evalbench/util/config.py x: 2 contributors (30d) y: 143 lines of code datasets/bat/example_run_config.yaml x: 4 contributors (30d) y: 20 lines of code datasets/model_configs/gemini_2.5_pro_model.yaml x: 2 contributors (30d) y: 4 lines of code evalbench/work/sqlexecwork.py x: 2 contributors (30d) y: 99 lines of code datasets/bird/example_run_config.yaml x: 2 contributors (30d) y: 19 lines of code datasets/model_configs/gemini_1.0_pro_model.yaml x: 2 contributors (30d) y: 3 lines of code evalbench/dataset/dataset.py x: 2 contributors (30d) y: 112 lines of code datasets/bat/setup/db_blog/sqlserver/setup.sql x: 1 contributors (30d) y: 366 lines of code evalbench/evalbench.py x: 3 contributors (30d) y: 64 lines of code evalbench/evaluator/evaluator.py x: 1 contributors (30d) y: 90 lines of code evalbench/generators/models/gemini.py x: 2 contributors (30d) y: 38 lines of code evalbench/reporting/report.py x: 1 contributors (30d) y: 28 lines of code evalbench/scorers/executablesql.py x: 1 contributors (30d) y: 23 lines of code evalbench/scorers/score.py x: 1 contributors (30d) y: 68 lines of code evalbench/util/loghandler.py x: 1 contributors (30d) y: 22 lines of code evalbench/util/sanitizer.py x: 2 contributors (30d) y: 11 lines of code
385.0
lines of code
  min: 1.0
  average: 78.43
  25th percentile: 5.5
  median: 27.0
  75th percentile: 127.0
  max: 385.0
0 4.0
contributors (30d)
min: 1.0 | average: 2.1 | 25th percentile: 2.0 | median: 2.0 | 75th percentile: 2.0 | max: 4.0

File Size vs. Commits (90 days): 87 points

evalbench/databases/bigquery.py x: 8 commits (90d) y: 220 lines of code datasets/bat/db_configs/alloydb.yaml x: 2 commits (90d) y: 7 lines of code evalbench/databases/__init__.py x: 16 commits (90d) y: 23 lines of code evalbench/databases/alloydb.py x: 7 commits (90d) y: 35 lines of code evalbench/evaluator/orchestrator.py x: 29 commits (90d) y: 190 lines of code evalbench/generators/models/__init__.py x: 19 commits (90d) y: 26 lines of code evalbench/generators/models/alloydb_ai_nl.py x: 4 commits (90d) y: 22 lines of code datasets/bat/db_configs/bigquery.yaml x: 2 commits (90d) y: 5 lines of code datasets/bat/setup/db_blog/bigquery/post_setup.sql x: 2 commits (90d) y: 36 lines of code datasets/bat/setup/db_blog/bigquery/pre_setup.sql x: 2 commits (90d) y: 1 lines of code datasets/bat/setup/db_blog/bigquery/setup.sql x: 3 commits (90d) y: 385 lines of code evalbench/databases/db.py x: 18 commits (90d) y: 132 lines of code evalbench/databases/mysql.py x: 24 commits (90d) y: 197 lines of code evalbench/databases/postgres.py x: 19 commits (90d) y: 192 lines of code evalbench/databases/sqlite.py x: 30 commits (90d) y: 196 lines of code evalbench/databases/sqlserver.py x: 24 commits (90d) y: 219 lines of code evalbench/evaluator/db_manager.py x: 15 commits (90d) y: 94 lines of code evalbench/generators/prompts/sqlgenbase.py x: 6 commits (90d) y: 23 lines of code evalbench/util/config.py x: 25 commits (90d) y: 143 lines of code datasets/bat/example_run_config.yaml x: 21 commits (90d) y: 20 lines of code datasets/model_configs/gemini_2.5_pro_model.yaml x: 3 commits (90d) y: 4 lines of code evalbench/work/sqlexecwork.py x: 12 commits (90d) y: 99 lines of code datasets/bird/db_configs/sqlite.yaml x: 5 commits (90d) y: 5 lines of code datasets/bird/example_run_config.yaml x: 5 commits (90d) y: 19 lines of code datasets/model_configs/claude_3.5_model.yaml x: 4 commits (90d) y: 4 lines of code datasets/model_configs/gemini_1.0_pro_model.yaml x: 4 commits (90d) y: 3 lines of code evalbench/dataset/dataset.py x: 24 commits (90d) y: 112 lines of code datasets/bat/setup/db_blog/sqlserver/setup.sql x: 5 commits (90d) y: 366 lines of code evalbench/evalbench.py x: 35 commits (90d) y: 64 lines of code evalbench/evaluator/evaluator.py x: 26 commits (90d) y: 90 lines of code evalbench/generators/models/gemini.py x: 23 commits (90d) y: 38 lines of code evalbench/reporting/report.py x: 10 commits (90d) y: 28 lines of code evalbench/scorers/executablesql.py x: 4 commits (90d) y: 23 lines of code evalbench/scorers/score.py x: 16 commits (90d) y: 68 lines of code evalbench/util/sanitizer.py x: 8 commits (90d) y: 11 lines of code evalbench/util/rate_limit.py x: 7 commits (90d) y: 31 lines of code datasets/bat/setup/db_blog/mysql/setup.sql x: 2 commits (90d) y: 811 lines of code datasets/bat/setup/db_blog/postgres/post_setup.sql x: 2 commits (90d) y: 80 lines of code datasets/bat/setup/db_blog/postgres/setup.sql x: 2 commits (90d) y: 499 lines of code datasets/bat/setup/db_blog/sqlite/setup.sql x: 2 commits (90d) y: 406 lines of code evalbench/evaluator/progress_reporter.py x: 13 commits (90d) y: 202 lines of code evalbench/generators/prompts/__init__.py x: 11 commits (90d) y: 7 lines of code evalbench/scorers/llmrater.py x: 12 commits (90d) y: 113 lines of code evalbench/dataset/evalinput.py x: 13 commits (90d) y: 117 lines of code evalbench/eval_service.py x: 12 commits (90d) y: 141 lines of code evalbench/evalproto/eval_request.proto x: 2 commits (90d) y: 52 lines of code evalbench/util/service.py x: 6 commits (90d) y: 13 lines of code evalbench/util/gcp.py x: 3 commits (90d) y: 17 lines of code evalbench/reporting/csv.py x: 5 commits (90d) y: 28 lines of code evalbench/scorers/returnedsql.py x: 6 commits (90d) y: 30 lines of code evalbench/generators/models/claude.py x: 11 commits (90d) y: 32 lines of code evalbench/scorers/setmatcher.py x: 7 commits (90d) y: 36 lines of code evalbench/databases/util.py x: 6 commits (90d) y: 115 lines of code evalbench/generators/models/passthrough.py x: 6 commits (90d) y: 7 lines of code evalbench/generators/prompts/generator.py x: 4 commits (90d) y: 10 lines of code evalbench/generators/prompts/passthrough.py x: 3 commits (90d) y: 8 lines of code evalbench/reporting/__init__.py x: 3 commits (90d) y: 12 lines of code evalbench/reporting/analyzer.py x: 12 commits (90d) y: 84 lines of code evalbench/scorers/exactmatcher.py x: 8 commits (90d) y: 27 lines of code evalbench/scorers/recallmatcher.py x: 10 commits (90d) y: 61 lines of code evalbench/scorers/util.py x: 4 commits (90d) y: 35 lines of code evalbench/scorers/comparator.py x: 5 commits (90d) y: 70 lines of code evalbench/repository/nldRepo.py x: 2 commits (90d) y: 32 lines of code evalbench/scorers/generatedqueryregexpmatcher.py x: 6 commits (90d) y: 57 lines of code evalbench/util/sessionmgr.py x: 4 commits (90d) y: 69 lines of code
811.0
lines of code
  min: 1.0
  average: 75.34
  25th percentile: 6.0
  median: 28.0
  75th percentile: 90.0
  max: 811.0
0 35.0
commits (90d)
min: 2.0 | average: 8.25 | 25th percentile: 2.0 | median: 5.0 | 75th percentile: 12.0 | max: 35.0

File Size vs. Contributors (90 days): 87 points

evalbench/databases/bigquery.py x: 4 contributors (90d) y: 220 lines of code datasets/bat/db_configs/alloydb.yaml x: 2 contributors (90d) y: 7 lines of code evalbench/databases/__init__.py x: 6 contributors (90d) y: 23 lines of code evalbench/databases/alloydb.py x: 3 contributors (90d) y: 35 lines of code evalbench/evaluator/orchestrator.py x: 4 contributors (90d) y: 190 lines of code evalbench/generators/models/__init__.py x: 5 contributors (90d) y: 26 lines of code evalbench/generators/models/alloydb_ai_nl.py x: 2 contributors (90d) y: 22 lines of code datasets/bat/db_configs/bigquery.yaml x: 2 contributors (90d) y: 5 lines of code datasets/bat/setup/db_blog/bigquery/post_setup.sql x: 2 contributors (90d) y: 36 lines of code datasets/bat/setup/db_blog/bigquery/pre_setup.sql x: 2 contributors (90d) y: 1 lines of code datasets/bat/setup/db_blog/bigquery/setup.sql x: 2 contributors (90d) y: 385 lines of code evalbench/databases/db.py x: 5 contributors (90d) y: 132 lines of code evalbench/databases/mysql.py x: 7 contributors (90d) y: 197 lines of code evalbench/databases/postgres.py x: 4 contributors (90d) y: 192 lines of code evalbench/databases/sqlite.py x: 5 contributors (90d) y: 196 lines of code evalbench/evaluator/db_manager.py x: 4 contributors (90d) y: 94 lines of code evalbench/generators/prompts/sqlgenbase.py x: 4 contributors (90d) y: 23 lines of code evalbench/util/config.py x: 4 contributors (90d) y: 143 lines of code datasets/bat/example_run_config.yaml x: 6 contributors (90d) y: 20 lines of code evalbench/work/sqlexecwork.py x: 5 contributors (90d) y: 99 lines of code datasets/bird/db_configs/sqlite.yaml x: 3 contributors (90d) y: 5 lines of code datasets/bird/example_run_config.yaml x: 3 contributors (90d) y: 19 lines of code datasets/model_configs/gemini_1.0_pro_model.yaml x: 3 contributors (90d) y: 3 lines of code evalbench/dataset/dataset.py x: 5 contributors (90d) y: 112 lines of code datasets/bat/setup/db_blog/sqlserver/setup.sql x: 3 contributors (90d) y: 366 lines of code evalbench/evalbench.py x: 7 contributors (90d) y: 64 lines of code evalbench/evaluator/evaluator.py x: 5 contributors (90d) y: 90 lines of code evalbench/generators/models/gemini.py x: 4 contributors (90d) y: 38 lines of code evalbench/reporting/report.py x: 3 contributors (90d) y: 28 lines of code evalbench/scorers/executablesql.py x: 3 contributors (90d) y: 23 lines of code evalbench/scorers/score.py x: 6 contributors (90d) y: 68 lines of code evalbench/util/loghandler.py x: 3 contributors (90d) y: 22 lines of code evalbench/util/sanitizer.py x: 4 contributors (90d) y: 11 lines of code evalbench/generators/models/generator.py x: 2 contributors (90d) y: 27 lines of code evalbench/util/rate_limit.py x: 2 contributors (90d) y: 31 lines of code datasets/bat/setup/db_blog/mysql/setup.sql x: 2 contributors (90d) y: 811 lines of code datasets/bat/setup/db_blog/postgres/post_setup.sql x: 2 contributors (90d) y: 80 lines of code datasets/bat/setup/db_blog/postgres/setup.sql x: 2 contributors (90d) y: 499 lines of code datasets/bat/setup/db_blog/sqlite/setup.sql x: 2 contributors (90d) y: 406 lines of code evalbench/evaluator/progress_reporter.py x: 2 contributors (90d) y: 202 lines of code evalbench/generators/prompts/__init__.py x: 5 contributors (90d) y: 7 lines of code evalbench/scorers/llmrater.py x: 6 contributors (90d) y: 113 lines of code evalbench/work/scorework.py x: 2 contributors (90d) y: 23 lines of code evalbench/dataset/evalinput.py x: 4 contributors (90d) y: 117 lines of code evalbench/eval_service.py x: 2 contributors (90d) y: 141 lines of code evalbench/evalproto/eval_request.proto x: 2 contributors (90d) y: 52 lines of code evalbench/util/service.py x: 2 contributors (90d) y: 13 lines of code evalbench/util/gcp.py x: 2 contributors (90d) y: 17 lines of code evalbench/scorers/returnedsql.py x: 4 contributors (90d) y: 30 lines of code evalbench/generators/models/claude.py x: 4 contributors (90d) y: 32 lines of code evalbench/databases/util.py x: 2 contributors (90d) y: 115 lines of code evalbench/generators/prompts/generator.py x: 2 contributors (90d) y: 10 lines of code evalbench/reporting/analyzer.py x: 5 contributors (90d) y: 84 lines of code evalbench/scorers/exactmatcher.py x: 4 contributors (90d) y: 27 lines of code evalbench/scorers/recallmatcher.py x: 5 contributors (90d) y: 61 lines of code evalbench/scorers/util.py x: 2 contributors (90d) y: 35 lines of code evalbench/scorers/comparator.py x: 5 contributors (90d) y: 70 lines of code evalbench/scorers/generatedqueryregexpmatcher.py x: 4 contributors (90d) y: 57 lines of code evalbench/util/sessionmgr.py x: 2 contributors (90d) y: 69 lines of code
811.0
lines of code
  min: 1.0
  average: 75.34
  25th percentile: 6.0
  median: 28.0
  75th percentile: 90.0
  max: 811.0
0 7.0
contributors (90d)
min: 2.0 | average: 3.14 | 25th percentile: 2.0 | median: 3.0 | 75th percentile: 4.0 | max: 7.0