huggingface / lighteval
File Change Frequency

File change frequency (churn) shows the distribution of file updates (days with at least one commit).

Overview
File Change Frequency Overall
  • There are 112 files with 23,903 lines of code.
    • 0 files changed more than 100 times (0 lines of code)
    • 1 file changed 51-100 times (115 lines of code)
    • 8 files changed 21-50 times (3,105 lines of code)
    • 43 files changed 6-20 times (12,555 lines of code)
    • 60 files changed 1-5 times (8,128 lines of code)
0% | <1% | 12% | 52% | 34%
Legend:
101+
51-100
21-50
6-20
1-5

explore: grouped by folders | grouped by update frequency | data
Contributors Count Frequency Overall
  • There are 112 files with 23,903 lines of code.
    • 0 files changed by more than 25 contributors (0 lines of code)
    • 6 files changed by 11-25 contributors (3,032 lines of code)
    • 17 files changed by 6-10 contributors (4,725 lines of code)
    • 59 files changed by 2-5 contributors (12,846 lines of code)
    • 30 files changed by 1 contributor (3,300 lines of code)
0% | 12% | 19% | 53% | 13%
Legend:
26+
11-25
6-10
2-5
1

explore: grouped by folders | grouped by contributors count | data
File Change Frequency per File Extension
py, txt, mdx, yaml, json, md, svg, in, gitignore, gitattributes, toml, jsonl
File Change Frequency per Extension
The number of recorded file updates
101+
51-100
21-50
6-20
1-5
toml0% | 100% | 0% | 0% | 0%
py0% | 0% | 13% | 52% | 34%
in0% | 0% | 0% | 0% | 100%
File Change Frequency per Logical Decomposition
primary
primary (file change frequency)
The number of recorded file updates
101+
51-100
21-50
6-20
1-5
ROOT0% | 96% | 0% | 0% | 3%
src0% | 0% | 14% | 52% | 33%
community_tasks0% | 0% | 0% | 54% | 45%
Most Frequently Changed Files (Top 50)

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
115 - 2024-02-01 2025-06-25 54 14 nathan.habib@huggingface.co 30601243+nathanhb@users.nor...
lighteval_task.py
in src/lighteval/tasks
 222 12 2024-02-06 2025-06-25 46 12 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
metrics_sample.py
in src/lighteval/metrics
 813 63 2024-01-26 2025-06-25 33 16 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
main_accelerate.py
in src/lighteval
 123 1 2024-02-07 2025-06-25 29 11 thomwolf@users.noreply.gith... 30601243+nathanhb@users.nor...
metrics.py
in src/lighteval/metrics
 776 4 2024-01-26 2025-06-25 29 9 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
evaluation_tracker.py
in src/lighteval/logging
 520 17 2024-02-06 2025-06-25 27 13 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
info_loggers.py
in src/lighteval/logging
 219 11 2024-02-06 2025-06-25 24 6 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
model_loader.py
in src/lighteval/models
 121 9 2024-02-07 2025-06-25 21 7 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
pipeline.py
in src/lighteval
 311 17 2024-08-21 2025-06-25 21 8 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
registry.py
in src/lighteval/tasks
 158 11 2024-02-06 2025-06-25 20 7 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
translation_literals.py
in src/lighteval/tasks/templates/utils
 1239 1 2024-09-30 2025-06-26 20 14 kydlicek.hynek@gmail.com sampo.pyysalo@gmail.com
vllm_model.py
in src/lighteval/models/vllm
 410 15 2024-12-10 2025-06-25 19 10 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
data.py
in src/lighteval
 121 13 2024-02-01 2025-06-25 18 8 thomas@huggingface.co 30601243+nathanhb@users.nor...
main_endpoint.py
in src/lighteval
 409 4 2024-12-04 2025-06-25 18 4 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
arabic_evals.py
in community_tasks
 725 28 2024-02-26 2025-06-25 18 7 58257628+alielfilali01@user... 30601243+nathanhb@users.nor...
__init__.py
in src/lighteval/metrics
 26 1 2024-02-01 2025-06-25 17 8 clementine@huggingface.co 30601243+nathanhb@users.nor...
requests.py
in src/lighteval/tasks
 42 2 2024-02-07 2025-06-25 15 5 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
main_nanotron.py
in src/lighteval
 70 1 2024-02-07 2025-06-25 15 5 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
llm_as_judge.py
in src/lighteval/metrics
 262 11 2024-04-11 2025-05-22 15 5 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
main_vllm.py
in src/lighteval
 112 1 2024-12-04 2025-06-25 14 8 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
transformers_model.py
in src/lighteval/models/transformers
 731 28 2025-01-02 2025-06-25 14 9 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
abstract_model.py
in src/lighteval/models
 82 11 2024-02-07 2025-06-25 13 4 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
tasks.py
in src/lighteval/tasks/multilingual
 3872 1 2024-09-30 2025-06-25 13 5 kydlicek.hynek@gmail.com 30601243+nathanhb@users.nor...
_template.py
in community_tasks
 54 2 2024-02-24 2025-06-25 12 6 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
prompt_manager.py
in src/lighteval/tasks
 203 15 2024-08-27 2025-06-25 12 6 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
__main__.py
in src/lighteval
 57 - 2024-07-17 2025-05-05 11 5 30601243+nathanhb@users.nor... joel@harvey.ai
model_output.py
in src/lighteval/models
 24 - 2024-02-28 2025-06-25 10 4 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
sample_preparator.py
in src/lighteval/metrics
 75 10 2024-02-01 2025-06-25 10 8 clementine@huggingface.co 30601243+nathanhb@users.nor...
main.py
in src/lighteval/tasks/extended/ifeval
 112 3 2024-03-27 2025-06-25 10 5 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
dynamic_metrics.py
in src/lighteval/metrics
 167 8 2024-09-02 2025-06-25 10 3 kydlicek.hynek@gmail.com 30601243+nathanhb@users.nor...
litellm_model.py
in src/lighteval/models
 194 11 2025-01-02 2025-06-25 10 3 joel@harvey.ai 30601243+nathanhb@users.nor...
endpoint_model.py
in src/lighteval/models/endpoints
 453 18 2024-12-10 2025-06-25 10 6 8515462+albertvillanova@use... 30601243+nathanhb@users.nor...
main.py
in src/lighteval/tasks/extended/mt_bench
 61 3 2024-03-29 2025-06-25 9 3 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
metrics_corpus.py
in src/lighteval/metrics
 76 8 2024-01-26 2025-05-22 9 5 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
model_input.py
in src/lighteval/models
 118 9 2025-01-02 2025-06-20 8 5 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
german_rag_evals.py
in community_tasks
 124 4 2024-04-09 2025-06-24 8 6 eniak.info@gmail.com 136604165+leopardracer@user...
main.py
in src/lighteval/tasks/extended/tiny_benchmarks
 201 7 2024-03-27 2025-06-25 8 4 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
extractive_match_utils.py
in src/lighteval/metrics/utils
 360 16 2025-01-15 2025-06-26 8 3 kydlicek.hynek@gmail.com 22726840+clefourrier@users....
imports.py
in src/lighteval/utils
 71 17 2024-08-21 2025-03-19 7 5 22726840+clefourrier@users.... 22726840+clefourrier@users....
main.py
in src/lighteval/tasks/extended/lcb
 106 3 2025-02-18 2025-06-25 7 6 agustin.piqueres@gmail.com 30601243+nathanhb@users.nor...
utils.py
in src/lighteval/utils
 131 11 2024-08-21 2025-06-04 7 5 22726840+clefourrier@users.... lewis.c.tunstall@gmail.com
inference_providers_model.py
in src/lighteval/models/endpoints
 137 7 2025-03-18 2025-06-25 7 3 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
bert_scorer.py
in src/lighteval/metrics/imports
 309 17 2024-03-06 2025-05-28 7 4 30601243+nathanhb@users.nor... rodiondenmark@gmail.com
language.py
in src/lighteval/utils
 321 1 2024-09-27 2025-05-19 7 4 kydlicek.hynek@gmail.com 22726840+clefourrier@users....
__init__.py
in src/lighteval/tasks/extended
 12 - 2024-03-27 2025-02-18 6 3 22726840+clefourrier@users.... agustin.piqueres@gmail.com
lighteval_config.py
in src/lighteval/config
 60 2 2024-09-04 2025-05-22 6 3 kydlicek.hynek@gmail.com kydlicek.hynek@gmail.com
adapter_model.py
in src/lighteval/models/transformers
 70 3 2024-12-10 2025-06-25 6 3 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
utils.py
in src/lighteval/models
 72 7 2024-03-06 2025-06-25 6 2 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
tgi_model.py
in src/lighteval/models/endpoints
 88 10 2024-12-10 2025-06-25 6 4 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
main_sglang.py
in src/lighteval
 108 1 2025-02-18 2025-06-25 6 3 12012211@mail.sustech.edu.cn 30601243+nathanhb@users.nor...
Files With Most Contributors (Top 50)
Based on the number of unique email addresses found in commits.

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
metrics_sample.py
in src/lighteval/metrics
 813 63 2024-01-26 2025-06-25 33 16 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
115 - 2024-02-01 2025-06-25 54 14 nathan.habib@huggingface.co 30601243+nathanhb@users.nor...
translation_literals.py
in src/lighteval/tasks/templates/utils
 1239 1 2024-09-30 2025-06-26 20 14 kydlicek.hynek@gmail.com sampo.pyysalo@gmail.com
evaluation_tracker.py
in src/lighteval/logging
 520 17 2024-02-06 2025-06-25 27 13 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
lighteval_task.py
in src/lighteval/tasks
 222 12 2024-02-06 2025-06-25 46 12 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
main_accelerate.py
in src/lighteval
 123 1 2024-02-07 2025-06-25 29 11 thomwolf@users.noreply.gith... 30601243+nathanhb@users.nor...
vllm_model.py
in src/lighteval/models/vllm
 410 15 2024-12-10 2025-06-25 19 10 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
metrics.py
in src/lighteval/metrics
 776 4 2024-01-26 2025-06-25 29 9 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
transformers_model.py
in src/lighteval/models/transformers
 731 28 2025-01-02 2025-06-25 14 9 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
pipeline.py
in src/lighteval
 311 17 2024-08-21 2025-06-25 21 8 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
data.py
in src/lighteval
 121 13 2024-02-01 2025-06-25 18 8 thomas@huggingface.co 30601243+nathanhb@users.nor...
__init__.py
in src/lighteval/metrics
 26 1 2024-02-01 2025-06-25 17 8 clementine@huggingface.co 30601243+nathanhb@users.nor...
main_vllm.py
in src/lighteval
 112 1 2024-12-04 2025-06-25 14 8 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
sample_preparator.py
in src/lighteval/metrics
 75 10 2024-02-01 2025-06-25 10 8 clementine@huggingface.co 30601243+nathanhb@users.nor...
model_loader.py
in src/lighteval/models
 121 9 2024-02-07 2025-06-25 21 7 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
registry.py
in src/lighteval/tasks
 158 11 2024-02-06 2025-06-25 20 7 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
arabic_evals.py
in community_tasks
 725 28 2024-02-26 2025-06-25 18 7 58257628+alielfilali01@user... 30601243+nathanhb@users.nor...
info_loggers.py
in src/lighteval/logging
 219 11 2024-02-06 2025-06-25 24 6 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
prompt_manager.py
in src/lighteval/tasks
 203 15 2024-08-27 2025-06-25 12 6 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
_template.py
in community_tasks
 54 2 2024-02-24 2025-06-25 12 6 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
endpoint_model.py
in src/lighteval/models/endpoints
 453 18 2024-12-10 2025-06-25 10 6 8515462+albertvillanova@use... 30601243+nathanhb@users.nor...
german_rag_evals.py
in community_tasks
 124 4 2024-04-09 2025-06-24 8 6 eniak.info@gmail.com 136604165+leopardracer@user...
main.py
in src/lighteval/tasks/extended/lcb
 106 3 2025-02-18 2025-06-25 7 6 agustin.piqueres@gmail.com 30601243+nathanhb@users.nor...
llm_as_judge.py
in src/lighteval/metrics
 262 11 2024-04-11 2025-05-22 15 5 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
main_nanotron.py
in src/lighteval
 70 1 2024-02-07 2025-06-25 15 5 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
requests.py
in src/lighteval/tasks
 42 2 2024-02-07 2025-06-25 15 5 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
tasks.py
in src/lighteval/tasks/multilingual
 3872 1 2024-09-30 2025-06-25 13 5 kydlicek.hynek@gmail.com 30601243+nathanhb@users.nor...
__main__.py
in src/lighteval
 57 - 2024-07-17 2025-05-05 11 5 30601243+nathanhb@users.nor... joel@harvey.ai
main.py
in src/lighteval/tasks/extended/ifeval
 112 3 2024-03-27 2025-06-25 10 5 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
metrics_corpus.py
in src/lighteval/metrics
 76 8 2024-01-26 2025-05-22 9 5 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
model_input.py
in src/lighteval/models
 118 9 2025-01-02 2025-06-20 8 5 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
imports.py
in src/lighteval/utils
 71 17 2024-08-21 2025-03-19 7 5 22726840+clefourrier@users.... 22726840+clefourrier@users....
utils.py
in src/lighteval/utils
 131 11 2024-08-21 2025-06-04 7 5 22726840+clefourrier@users.... lewis.c.tunstall@gmail.com
main_endpoint.py
in src/lighteval
 409 4 2024-12-04 2025-06-25 18 4 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
abstract_model.py
in src/lighteval/models
 82 11 2024-02-07 2025-06-25 13 4 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
model_output.py
in src/lighteval/models
 24 - 2024-02-28 2025-06-25 10 4 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
main.py
in src/lighteval/tasks/extended/tiny_benchmarks
 201 7 2024-03-27 2025-06-25 8 4 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
bert_scorer.py
in src/lighteval/metrics/imports
 309 17 2024-03-06 2025-05-28 7 4 30601243+nathanhb@users.nor... rodiondenmark@gmail.com
language.py
in src/lighteval/utils
 321 1 2024-09-27 2025-05-19 7 4 kydlicek.hynek@gmail.com 22726840+clefourrier@users....
normalizations.py
in src/lighteval/metrics
 275 11 2024-03-06 2025-06-25 6 4 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
sglang_model.py
in src/lighteval/models/sglang
 257 13 2025-02-18 2025-06-25 6 4 12012211@mail.sustech.edu.cn 30601243+nathanhb@users.nor...
tgi_model.py
in src/lighteval/models/endpoints
 88 10 2024-12-10 2025-06-25 6 4 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
aimo_evals.py
in community_tasks
 25 1 2024-05-03 2024-12-16 5 4 30601243+nathanhb@users.nor... 8515462+albertvillanova@use...
nanotron_model.py
in src/lighteval/models/nanotron
 956 28 2024-12-10 2025-05-22 4 4 22726840+clefourrier@users.... kydlicek.hynek@gmail.com
dynamic_metrics.py
in src/lighteval/metrics
 167 8 2024-09-02 2025-06-25 10 3 kydlicek.hynek@gmail.com 30601243+nathanhb@users.nor...
litellm_model.py
in src/lighteval/models
 194 11 2025-01-02 2025-06-25 10 3 joel@harvey.ai 30601243+nathanhb@users.nor...
main.py
in src/lighteval/tasks/extended/mt_bench
 61 3 2024-03-29 2025-06-25 9 3 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
extractive_match_utils.py
in src/lighteval/metrics/utils
 360 16 2025-01-15 2025-06-26 8 3 kydlicek.hynek@gmail.com 22726840+clefourrier@users....
inference_providers_model.py
in src/lighteval/models/endpoints
 137 7 2025-03-18 2025-06-25 7 3 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
adapter_model.py
in src/lighteval/models/transformers
 70 3 2024-12-10 2025-06-25 6 3 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
Files With Least Contributors (Top 50)
Based on the number of unique email addresses found in commits.

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
instructions_utils.py
in src/lighteval/tasks/extended/ifeval
 1634 6 2024-03-27 2024-03-27 1 1 22726840+clefourrier@users.... 22726840+clefourrier@users....
vlm_transformers_model.py
in src/lighteval/models/transformers
 282 19 2025-05-19 2025-06-25 2 1 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
summac.py
in src/lighteval/metrics/imports
 251 22 2024-03-06 2024-12-05 2 1 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
adapters.py
in src/lighteval/tasks/multilingual
 185 10 2024-10-02 2025-05-22 4 1 kydlicek.hynek@gmail.com kydlicek.hynek@gmail.com
main.py
in src/lighteval/tasks/extended/olympiade_bench
 172 3 2025-01-31 2025-06-25 2 1 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
turkic_evals.py
in community_tasks
 86 2 2025-06-24 2025-06-24 1 1 60838378+ceferisbarov@users... 60838378+ceferisbarov@users...
data_stats_utils.py
in src/lighteval/metrics/imports
 79 8 2024-03-06 2024-03-06 1 1 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
translation.py
in src/lighteval/tasks/templates
 67 2 2024-11-18 2024-11-18 1 1 kydlicek.hynek@gmail.com kydlicek.hynek@gmail.com
multichoice.py
in src/lighteval/tasks/templates
 65 2 2024-09-30 2025-05-22 3 1 kydlicek.hynek@gmail.com kydlicek.hynek@gmail.com
formulation.py
in src/lighteval/tasks/templates/utils
 60 3 2024-09-30 2024-09-30 1 1 kydlicek.hynek@gmail.com kydlicek.hynek@gmail.com
prompts.py
in src/lighteval/tasks/extended/mix_eval
 56 3 2024-10-07 2024-10-07 1 1 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
boolq.py
in src/lighteval/tasks/templates
 54 2 2024-10-10 2024-10-10 1 1 kydlicek.hynek@gmail.com kydlicek.hynek@gmail.com
adapters_utils.py
in src/lighteval/tasks/multilingual/utils
 50 3 2024-10-02 2024-10-02 1 1 kydlicek.hynek@gmail.com kydlicek.hynek@gmail.com
main_tasks.py
in src/lighteval
 46 3 2024-12-04 2025-06-25 4 1 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
timeout.py
in src/lighteval/utils
 43 1 2025-01-15 2025-01-15 1 1 kydlicek.hynek@gmail.com kydlicek.hynek@gmail.com
formatting_utils.py
in src/lighteval/tasks/templates/utils
 39 5 2024-09-30 2024-09-30 1 1 kydlicek.hynek@gmail.com kydlicek.hynek@gmail.com
judge_prompts.py
in src/lighteval/tasks/extended/mix_eval
 35 4 2024-10-07 2024-10-07 1 1 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
qa.py
in src/lighteval/tasks/templates
 29 1 2024-10-02 2025-05-22 3 1 kydlicek.hynek@gmail.com kydlicek.hynek@gmail.com
judge_utils.py
in src/lighteval/metrics/utils
 21 2 2025-04-22 2025-04-22 1 1 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
judge_prompt_templates.py
in src/lighteval/tasks/extended/mt_bench
 16 2 2024-10-07 2024-10-07 1 1 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
task_utils.py
in src/lighteval/tasks/multilingual/utils
 11 2 2024-10-02 2024-10-22 2 1 kydlicek.hynek@gmail.com kydlicek.hynek@gmail.com
adapter_utils.py
in src/lighteval/tasks/templates/utils
 10 2 2024-09-30 2024-10-01 2 1 kydlicek.hynek@gmail.com kydlicek.hynek@gmail.com
setup.py
in root
 2 - 2024-03-06 2024-03-06 1 1 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
__init__.py
in src/lighteval/metrics/utils
 1 - 2025-01-29 2025-01-29 1 1 kydlicek.hynek@gmail.com kydlicek.hynek@gmail.com
__init__.py
in src/lighteval/metrics/imports
 1 - 2025-01-29 2025-01-29 1 1 kydlicek.hynek@gmail.com kydlicek.hynek@gmail.com
__init__.py
in src/lighteval/utils
 1 - 2025-01-29 2025-01-29 1 1 kydlicek.hynek@gmail.com kydlicek.hynek@gmail.com
__init__.py
in src/lighteval/tasks/templates/utils
 1 - 2025-01-29 2025-01-29 1 1 kydlicek.hynek@gmail.com kydlicek.hynek@gmail.com
__init__.py
in src/lighteval/tasks/templates
 1 - 2025-01-29 2025-01-29 1 1 kydlicek.hynek@gmail.com kydlicek.hynek@gmail.com
__init__.py
in src/lighteval/tasks/multilingual/utils
 1 - 2025-01-29 2025-01-29 1 1 kydlicek.hynek@gmail.com kydlicek.hynek@gmail.com
__init__.py
in src/lighteval/tasks/multilingual
 1 - 2025-01-29 2025-01-29 1 1 kydlicek.hynek@gmail.com kydlicek.hynek@gmail.com
instructions.py
in src/lighteval/tasks/extended/ifeval
 757 123 2024-03-27 2025-05-22 2 2 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
codegen_metrics.py
in src/lighteval/tasks/extended/lcb
 439 22 2025-02-18 2025-05-06 2 2 agustin.piqueres@gmail.com 73983677+omahs@users.norepl...
math_comparison.py
in src/lighteval/metrics/utils
 304 20 2025-01-15 2025-05-22 3 2 kydlicek.hynek@gmail.com 30601243+nathanhb@users.nor...
linguistic_tokenizers.py
in src/lighteval/metrics/utils
 218 24 2024-09-27 2024-12-05 2 2 kydlicek.hynek@gmail.com 30601243+nathanhb@users.nor...
main.py
in src/lighteval/tasks/extended/hle
 144 7 2025-02-18 2025-06-25 3 2 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
nli.py
in src/lighteval/tasks/templates
 124 6 2024-09-30 2025-01-22 4 2 kydlicek.hynek@gmail.com 57645283+mariagrandury@user...
instructions_registry.py
in src/lighteval/tasks/extended/ifeval
 111 1 2024-03-27 2025-05-22 2 2 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
drop.py
in src/lighteval/metrics/harness_compatibility
 106 1 2024-03-06 2025-06-25 3 2 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
continuation.py
in src/lighteval/tasks/templates
 102 4 2024-09-30 2025-01-22 4 2 kydlicek.hynek@gmail.com 57645283+mariagrandury@user...
data_stats_metric.py
in src/lighteval/metrics/imports
 77 7 2024-03-06 2025-03-19 3 2 30601243+nathanhb@users.nor... 22726840+clefourrier@users....
utils.py
in src/lighteval/models
 72 7 2024-03-06 2025-06-25 6 2 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
copa.py
in src/lighteval/tasks/templates
 59 2 2024-09-30 2025-01-22 3 2 kydlicek.hynek@gmail.com 57645283+mariagrandury@user...
delta_model.py
in src/lighteval/models/transformers
 56 3 2024-12-10 2025-06-25 5 2 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
dummy_model.py
in src/lighteval/models/dummy
 50 7 2024-12-10 2025-06-25 3 2 22726840+clefourrier@users.... 30601243+nathanhb@users.nor...
metric_utils.py
in src/lighteval/metrics/utils
 36 2 2024-09-27 2025-06-25 2 2 kydlicek.hynek@gmail.com 30601243+nathanhb@users.nor...
oz_evals.py
in community_tasks
 35 1 2024-10-16 2024-12-16 2 2 51213388+stopwolf@users.nor... 8515462+albertvillanova@use...
truthful_qa.py
in src/lighteval/metrics/harness_compatibility
 24 1 2024-03-06 2025-06-25 3 2 30601243+nathanhb@users.nor... 30601243+nathanhb@users.nor...
custom_model.py
in src/lighteval/models/custom
 4 - 2025-05-05 2025-06-25 2 2 joel@harvey.ai 30601243+nathanhb@users.nor...
__init__.py
in src/lighteval
 2 - 2024-02-09 2024-03-06 2 2 thomas@huggingface.co 30601243+nathanhb@users.nor...
in
 2 - 2024-02-09 2024-08-14 2 2 thomas@huggingface.co 30601243+nathanhb@users.nor...