huggingface / lighteval File Age & Freshness

File age measurements show the distribution of file ages (days since the first commit) and the file freshness (days since the latest commit).

Summary

Number of files: 112
Daily file updates (only one update per file and date counted): 319
First update: 2024-01-26
Latest update: 2025-06-26
Days between first and latest update: 518 (74 weeks, estimated 370 working days)
Active days (at least one file change): 189
Data:

Organized per file

File Change History Overall

File Age Distribution Overall

Days since first update

There are 112 files with 23,903 lines of code in files.

42 files that are 366+ days old (8,924 lines of code)
44 files that are 181-365 days old (11,287 lines of code)
21 files that are 91-180 days old (3,211 lines of code)
4 files that are 31-90 days old (395 lines of code)
1 files that are 1-30 days old (86 lines of code)

Legend:

366+

181-365

91-180

31-90

1-30

explore: grouped by folders | grouped by age

File Freshness Distribution Overall

Days since last update

There are 112 files with 23,903 lines of code in files.

4 files have been last changed 366+ days ago (1,717 lines of code)
16 files have been last changed 181-365 days ago (1,455 lines of code)
15 files have been last changed 91-180 days ago (496 lines of code)
17 files have been last changed 31-90 days ago (4,106 lines of code)
60 files have been last changed 1-30 days ago (16,129 lines of code)

Legend:

366+

181-365

91-180

31-90

1-30

explore: grouped by folders | grouped by freshness

File Change History per File Extension

py, txt, mdx, yaml, json, md, svg, in, gitignore, gitattributes, toml, jsonl

File Age Distribution per Extension

Days since first update

366+

181-365

91-180

31-90

1-30

File Freshness Distribution per Extension

Days since last update

366+

181-365

91-180

31-90

1-30

File Change History per Logical Decomposition

primary

primary (file age distribution)

Days since first update

366+

181-365

91-180

31-90

1-30

primary (file freshness distribution)

Days since last update

366+

181-365

91-180

31-90

1-30

Oldest Files (Top 50)

File	# lines	# units	created	last modified	# changes (days)	# contributors	first contributor	latest contributor
metrics_sample.py in src/lighteval/metrics	813	63	2024-01-26	2025-06-25	33	16	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
metrics.py in src/lighteval/metrics	776	4	2024-01-26	2025-06-25	29	9	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
metrics_corpus.py in src/lighteval/metrics	76	8	2024-01-26	2025-05-22	9	5	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
data.py in src/lighteval	121	13	2024-02-01	2025-06-25	18	8	thomas@huggingface.co	30601243+nathanhb@users.nor...
pyproject.toml in root	115	-	2024-02-01	2025-06-25	54	14	nathan.habib@huggingface.co	30601243+nathanhb@users.nor...
sample_preparator.py in src/lighteval/metrics	75	10	2024-02-01	2025-06-25	10	8	clementine@huggingface.co	30601243+nathanhb@users.nor...
__init__.py in src/lighteval/metrics	26	1	2024-02-01	2025-06-25	17	8	clementine@huggingface.co	30601243+nathanhb@users.nor...
evaluation_tracker.py in src/lighteval/logging	520	17	2024-02-06	2025-06-25	27	13	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
lighteval_task.py in src/lighteval/tasks	222	12	2024-02-06	2025-06-25	46	12	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
info_loggers.py in src/lighteval/logging	219	11	2024-02-06	2025-06-25	24	6	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
registry.py in src/lighteval/tasks	158	11	2024-02-06	2025-06-25	20	7	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
main_accelerate.py in src/lighteval	123	1	2024-02-07	2025-06-25	29	11	thomwolf@users.noreply.gith...	30601243+nathanhb@users.nor...
model_loader.py in src/lighteval/models	121	9	2024-02-07	2025-06-25	21	7	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
abstract_model.py in src/lighteval/models	82	11	2024-02-07	2025-06-25	13	4	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
main_nanotron.py in src/lighteval	70	1	2024-02-07	2025-06-25	15	5	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
requests.py in src/lighteval/tasks	42	2	2024-02-07	2025-06-25	15	5	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
__init__.py in src/lighteval/tasks	1	-	2024-02-07	2025-03-27	2	2	thomas@huggingface.co	22726840+clefourrier@users....
__init__.py in src/lighteval	2	-	2024-02-09	2024-03-06	2	2	thomas@huggingface.co	30601243+nathanhb@users.nor...
in MANIFEST.in in root	2	-	2024-02-09	2024-08-14	2	2	thomas@huggingface.co	30601243+nathanhb@users.nor...
_template.py in community_tasks	54	2	2024-02-24	2025-06-25	12	6	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
arabic_evals.py in community_tasks	725	28	2024-02-26	2025-06-25	18	7	58257628+alielfilali01@user...	30601243+nathanhb@users.nor...
model_output.py in src/lighteval/models	24	-	2024-02-28	2025-06-25	10	4	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
bert_scorer.py in src/lighteval/metrics/imports	309	17	2024-03-06	2025-05-28	7	4	30601243+nathanhb@users.nor...	rodiondenmark@gmail.com
normalizations.py in src/lighteval/metrics	275	11	2024-03-06	2025-06-25	6	4	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
summac.py in src/lighteval/metrics/imports	251	22	2024-03-06	2024-12-05	2	1	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
drop.py in src/lighteval/metrics/harness_compatibility	106	1	2024-03-06	2025-06-25	3	2	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
data_stats_utils.py in src/lighteval/metrics/imports	79	8	2024-03-06	2024-03-06	1	1	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
data_stats_metric.py in src/lighteval/metrics/imports	77	7	2024-03-06	2025-03-19	3	2	30601243+nathanhb@users.nor...	22726840+clefourrier@users....
utils.py in src/lighteval/models	72	7	2024-03-06	2025-06-25	6	2	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
stderr.py in src/lighteval/metrics	63	7	2024-03-06	2025-05-22	5	3	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
truthful_qa.py in src/lighteval/metrics/harness_compatibility	24	1	2024-03-06	2025-06-25	3	2	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
setup.py in root	2	-	2024-03-06	2024-03-06	1	1	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
instructions_utils.py in src/lighteval/tasks/extended/ifeval	1634	6	2024-03-27	2024-03-27	1	1	22726840+clefourrier@users....	22726840+clefourrier@users....
instructions.py in src/lighteval/tasks/extended/ifeval	757	123	2024-03-27	2025-05-22	2	2	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
main.py in src/lighteval/tasks/extended/tiny_benchmarks	201	7	2024-03-27	2025-06-25	8	4	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
main.py in src/lighteval/tasks/extended/ifeval	112	3	2024-03-27	2025-06-25	10	5	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
instructions_registry.py in src/lighteval/tasks/extended/ifeval	111	1	2024-03-27	2025-05-22	2	2	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
__init__.py in src/lighteval/tasks/extended	12	-	2024-03-27	2025-02-18	6	3	22726840+clefourrier@users....	agustin.piqueres@gmail.com
main.py in src/lighteval/tasks/extended/mt_bench	61	3	2024-03-29	2025-06-25	9	3	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
german_rag_evals.py in community_tasks	124	4	2024-04-09	2025-06-24	8	6	eniak.info@gmail.com	136604165+leopardracer@user...
llm_as_judge.py in src/lighteval/metrics	262	11	2024-04-11	2025-05-22	15	5	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
aimo_evals.py in community_tasks	25	1	2024-05-03	2024-12-16	5	4	30601243+nathanhb@users.nor...	8515462+albertvillanova@use...
__main__.py in src/lighteval	57	-	2024-07-17	2025-05-05	11	5	30601243+nathanhb@users.nor...	joel@harvey.ai
pipeline.py in src/lighteval	311	17	2024-08-21	2025-06-25	21	8	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
utils.py in src/lighteval/utils	131	11	2024-08-21	2025-06-04	7	5	22726840+clefourrier@users....	lewis.c.tunstall@gmail.com
parallelism.py in src/lighteval/utils	87	3	2024-08-21	2025-06-23	3	3	22726840+clefourrier@users....	113347905+mcleish7@users.no...
imports.py in src/lighteval/utils	71	17	2024-08-21	2025-03-19	7	5	22726840+clefourrier@users....	22726840+clefourrier@users....
prompt_manager.py in src/lighteval/tasks	203	15	2024-08-27	2025-06-25	12	6	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
dynamic_metrics.py in src/lighteval/metrics	167	8	2024-09-02	2025-06-25	10	3	kydlicek.hynek@gmail.com	30601243+nathanhb@users.nor...
lighteval_config.py in src/lighteval/config	60	2	2024-09-04	2025-05-22	6	3	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com

Files Not Recently Changed (Top 50)

File	# lines	# units	created	last modified	# changes (days)	# contributors	first contributor	latest contributor
setup.py in root	2	-	2024-03-06	2024-03-06	1	1	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
__init__.py in src/lighteval	2	-	2024-02-09	2024-03-06	2	2	thomas@huggingface.co	30601243+nathanhb@users.nor...
data_stats_utils.py in src/lighteval/metrics/imports	79	8	2024-03-06	2024-03-06	1	1	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
instructions_utils.py in src/lighteval/tasks/extended/ifeval	1634	6	2024-03-27	2024-03-27	1	1	22726840+clefourrier@users....	22726840+clefourrier@users....
in MANIFEST.in in root	2	-	2024-02-09	2024-08-14	2	2	thomas@huggingface.co	30601243+nathanhb@users.nor...
formatting_utils.py in src/lighteval/tasks/templates/utils	39	5	2024-09-30	2024-09-30	1	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
formulation.py in src/lighteval/tasks/templates/utils	60	3	2024-09-30	2024-09-30	1	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
adapter_utils.py in src/lighteval/tasks/templates/utils	10	2	2024-09-30	2024-10-01	2	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
adapters_utils.py in src/lighteval/tasks/multilingual/utils	50	3	2024-10-02	2024-10-02	1	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
judge_prompt_templates.py in src/lighteval/tasks/extended/mt_bench	16	2	2024-10-07	2024-10-07	1	1	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
judge_prompts.py in src/lighteval/tasks/extended/mix_eval	35	4	2024-10-07	2024-10-07	1	1	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
prompts.py in src/lighteval/tasks/extended/mix_eval	56	3	2024-10-07	2024-10-07	1	1	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
boolq.py in src/lighteval/tasks/templates	54	2	2024-10-10	2024-10-10	1	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
task_utils.py in src/lighteval/tasks/multilingual/utils	11	2	2024-10-02	2024-10-22	2	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
translation.py in src/lighteval/tasks/templates	67	2	2024-11-18	2024-11-18	1	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
linguistic_tokenizers.py in src/lighteval/metrics/utils	218	24	2024-09-27	2024-12-05	2	2	kydlicek.hynek@gmail.com	30601243+nathanhb@users.nor...
summac.py in src/lighteval/metrics/imports	251	22	2024-03-06	2024-12-05	2	1	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
aimo_evals.py in community_tasks	25	1	2024-05-03	2024-12-16	5	4	30601243+nathanhb@users.nor...	8515462+albertvillanova@use...
oz_evals.py in community_tasks	35	1	2024-10-16	2024-12-16	2	2	51213388+stopwolf@users.nor...	8515462+albertvillanova@use...
serbian_eval.py in community_tasks	526	4	2024-10-14	2024-12-16	3	3	deanchugall@users.noreply.g...	8515462+albertvillanova@use...
timeout.py in src/lighteval/utils	43	1	2025-01-15	2025-01-15	1	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
copa.py in src/lighteval/tasks/templates	59	2	2024-09-30	2025-01-22	3	2	kydlicek.hynek@gmail.com	57645283+mariagrandury@user...
continuation.py in src/lighteval/tasks/templates	102	4	2024-09-30	2025-01-22	4	2	kydlicek.hynek@gmail.com	57645283+mariagrandury@user...
nli.py in src/lighteval/tasks/templates	124	6	2024-09-30	2025-01-22	4	2	kydlicek.hynek@gmail.com	57645283+mariagrandury@user...
__init__.py in src/lighteval/tasks/multilingual	1	-	2025-01-29	2025-01-29	1	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
__init__.py in src/lighteval/tasks/multilingual/utils	1	-	2025-01-29	2025-01-29	1	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
__init__.py in src/lighteval/tasks/templates	1	-	2025-01-29	2025-01-29	1	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
__init__.py in src/lighteval/tasks/templates/utils	1	-	2025-01-29	2025-01-29	1	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
__init__.py in src/lighteval/utils	1	-	2025-01-29	2025-01-29	1	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
__init__.py in src/lighteval/metrics/imports	1	-	2025-01-29	2025-01-29	1	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
__init__.py in src/lighteval/metrics/utils	1	-	2025-01-29	2025-01-29	1	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
__init__.py in src/lighteval/tasks/extended	12	-	2024-03-27	2025-02-18	6	3	22726840+clefourrier@users....	agustin.piqueres@gmail.com
imports.py in src/lighteval/utils	71	17	2024-08-21	2025-03-19	7	5	22726840+clefourrier@users....	22726840+clefourrier@users....
data_stats_metric.py in src/lighteval/metrics/imports	77	7	2024-03-06	2025-03-19	3	2	30601243+nathanhb@users.nor...	22726840+clefourrier@users....
__init__.py in src/lighteval/tasks	1	-	2024-02-07	2025-03-27	2	2	thomas@huggingface.co	22726840+clefourrier@users....
judge_utils.py in src/lighteval/metrics/utils	21	2	2025-04-22	2025-04-22	1	1	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
__main__.py in src/lighteval	57	-	2024-07-17	2025-05-05	11	5	30601243+nathanhb@users.nor...	joel@harvey.ai
hellaswag.py in src/lighteval/tasks/templates	91	4	2024-10-01	2025-05-06	4	3	kydlicek.hynek@gmail.com	73983677+omahs@users.norepl...
codegen_metrics.py in src/lighteval/tasks/extended/lcb	439	22	2025-02-18	2025-05-06	2	2	agustin.piqueres@gmail.com	73983677+omahs@users.norepl...
language.py in src/lighteval/utils	321	1	2024-09-27	2025-05-19	7	4	kydlicek.hynek@gmail.com	22726840+clefourrier@users....
qa.py in src/lighteval/tasks/templates	29	1	2024-10-02	2025-05-22	3	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
lighteval_config.py in src/lighteval/config	60	2	2024-09-04	2025-05-22	6	3	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
stderr.py in src/lighteval/metrics	63	7	2024-03-06	2025-05-22	5	3	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
multichoice.py in src/lighteval/tasks/templates	65	2	2024-09-30	2025-05-22	3	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
metrics_corpus.py in src/lighteval/metrics	76	8	2024-01-26	2025-05-22	9	5	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
instructions_registry.py in src/lighteval/tasks/extended/ifeval	111	1	2024-03-27	2025-05-22	2	2	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
adapters.py in src/lighteval/tasks/multilingual	185	10	2024-10-02	2025-05-22	4	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
llm_as_judge.py in src/lighteval/metrics	262	11	2024-04-11	2025-05-22	15	5	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
math_comparison.py in src/lighteval/metrics/utils	304	20	2025-01-15	2025-05-22	3	2	kydlicek.hynek@gmail.com	30601243+nathanhb@users.nor...
instructions.py in src/lighteval/tasks/extended/ifeval	757	123	2024-03-27	2025-05-22	2	2	22726840+clefourrier@users....	30601243+nathanhb@users.nor...

Most Recently Created Files (Top 50)

File	# lines	# units	created	last modified	# changes (days)	# contributors	first contributor	latest contributor
turkic_evals.py in community_tasks	86	2	2025-06-24	2025-06-24	1	1	60838378+ceferisbarov@users...	60838378+ceferisbarov@users...
vlm_transformers_model.py in src/lighteval/models/transformers	282	19	2025-05-19	2025-06-25	2	1	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
main_custom.py in src/lighteval	88	1	2025-05-05	2025-06-25	4	3	joel@harvey.ai	30601243+nathanhb@users.nor...
custom_model.py in src/lighteval/models/custom	4	-	2025-05-05	2025-06-25	2	2	joel@harvey.ai	30601243+nathanhb@users.nor...
judge_utils.py in src/lighteval/metrics/utils	21	2	2025-04-22	2025-04-22	1	1	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
inference_providers_model.py in src/lighteval/models/endpoints	137	7	2025-03-18	2025-06-25	7	3	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
codegen_metrics.py in src/lighteval/tasks/extended/lcb	439	22	2025-02-18	2025-05-06	2	2	agustin.piqueres@gmail.com	73983677+omahs@users.norepl...
sglang_model.py in src/lighteval/models/sglang	257	13	2025-02-18	2025-06-25	6	4	12012211@mail.sustech.edu.cn	30601243+nathanhb@users.nor...
main.py in src/lighteval/tasks/extended/hle	144	7	2025-02-18	2025-06-25	3	2	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
main_sglang.py in src/lighteval	108	1	2025-02-18	2025-06-25	6	3	12012211@mail.sustech.edu.cn	30601243+nathanhb@users.nor...
main.py in src/lighteval/tasks/extended/lcb	106	3	2025-02-18	2025-06-25	7	6	agustin.piqueres@gmail.com	30601243+nathanhb@users.nor...
main.py in src/lighteval/tasks/extended/olympiade_bench	172	3	2025-01-31	2025-06-25	2	1	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
__init__.py in src/lighteval/metrics/utils	1	-	2025-01-29	2025-01-29	1	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
__init__.py in src/lighteval/metrics/imports	1	-	2025-01-29	2025-01-29	1	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
__init__.py in src/lighteval/utils	1	-	2025-01-29	2025-01-29	1	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
__init__.py in src/lighteval/tasks/templates/utils	1	-	2025-01-29	2025-01-29	1	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
__init__.py in src/lighteval/tasks/templates	1	-	2025-01-29	2025-01-29	1	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
__init__.py in src/lighteval/tasks/multilingual/utils	1	-	2025-01-29	2025-01-29	1	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
__init__.py in src/lighteval/tasks/multilingual	1	-	2025-01-29	2025-01-29	1	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
french_evals.py in community_tasks	91	3	2025-01-23	2025-06-25	3	3	mauricio.diaz@inria.fr	30601243+nathanhb@users.nor...
extractive_match_utils.py in src/lighteval/metrics/utils	360	16	2025-01-15	2025-06-26	8	3	kydlicek.hynek@gmail.com	22726840+clefourrier@users....
math_comparison.py in src/lighteval/metrics/utils	304	20	2025-01-15	2025-05-22	3	2	kydlicek.hynek@gmail.com	30601243+nathanhb@users.nor...
timeout.py in src/lighteval/utils	43	1	2025-01-15	2025-01-15	1	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
transformers_model.py in src/lighteval/models/transformers	731	28	2025-01-02	2025-06-25	14	9	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
litellm_model.py in src/lighteval/models	194	11	2025-01-02	2025-06-25	10	3	joel@harvey.ai	30601243+nathanhb@users.nor...
model_input.py in src/lighteval/models	118	9	2025-01-02	2025-06-20	8	5	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
nanotron_model.py in src/lighteval/models/nanotron	956	28	2024-12-10	2025-05-22	4	4	22726840+clefourrier@users....	kydlicek.hynek@gmail.com
endpoint_model.py in src/lighteval/models/endpoints	453	18	2024-12-10	2025-06-25	10	6	8515462+albertvillanova@use...	30601243+nathanhb@users.nor...
vllm_model.py in src/lighteval/models/vllm	410	15	2024-12-10	2025-06-25	19	10	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
tgi_model.py in src/lighteval/models/endpoints	88	10	2024-12-10	2025-06-25	6	4	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
adapter_model.py in src/lighteval/models/transformers	70	3	2024-12-10	2025-06-25	6	3	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
delta_model.py in src/lighteval/models/transformers	56	3	2024-12-10	2025-06-25	5	2	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
dummy_model.py in src/lighteval/models/dummy	50	7	2024-12-10	2025-06-25	3	2	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
main_endpoint.py in src/lighteval	409	4	2024-12-04	2025-06-25	18	4	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
main_vllm.py in src/lighteval	112	1	2024-12-04	2025-06-25	14	8	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
main_tasks.py in src/lighteval	46	3	2024-12-04	2025-06-25	4	1	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
translation.py in src/lighteval/tasks/templates	67	2	2024-11-18	2024-11-18	1	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
main_baseline.py in src/lighteval	63	1	2024-10-23	2025-06-25	4	3	kydlicek.hynek@gmail.com	30601243+nathanhb@users.nor...
oz_evals.py in community_tasks	35	1	2024-10-16	2024-12-16	2	2	51213388+stopwolf@users.nor...	8515462+albertvillanova@use...
serbian_eval.py in community_tasks	526	4	2024-10-14	2024-12-16	3	3	deanchugall@users.noreply.g...	8515462+albertvillanova@use...
boolq.py in src/lighteval/tasks/templates	54	2	2024-10-10	2024-10-10	1	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
main.py in src/lighteval/tasks/extended/mix_eval	187	6	2024-10-07	2025-06-25	4	3	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
prompts.py in src/lighteval/tasks/extended/mix_eval	56	3	2024-10-07	2024-10-07	1	1	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
judge_prompts.py in src/lighteval/tasks/extended/mix_eval	35	4	2024-10-07	2024-10-07	1	1	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
judge_prompt_templates.py in src/lighteval/tasks/extended/mt_bench	16	2	2024-10-07	2024-10-07	1	1	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
adapters.py in src/lighteval/tasks/multilingual	185	10	2024-10-02	2025-05-22	4	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
adapters_utils.py in src/lighteval/tasks/multilingual/utils	50	3	2024-10-02	2024-10-02	1	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
qa.py in src/lighteval/tasks/templates	29	1	2024-10-02	2025-05-22	3	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
task_utils.py in src/lighteval/tasks/multilingual/utils	11	2	2024-10-02	2024-10-22	2	1	kydlicek.hynek@gmail.com	kydlicek.hynek@gmail.com
hellaswag.py in src/lighteval/tasks/templates	91	4	2024-10-01	2025-05-06	4	3	kydlicek.hynek@gmail.com	73983677+omahs@users.norepl...

Most Recently Changed Files (Top 50)

File	# lines	# units	created	last modified	# changes (days)	# contributors	first contributor	latest contributor
translation_literals.py in src/lighteval/tasks/templates/utils	1239	1	2024-09-30	2025-06-26	20	14	kydlicek.hynek@gmail.com	sampo.pyysalo@gmail.com
extractive_match_utils.py in src/lighteval/metrics/utils	360	16	2025-01-15	2025-06-26	8	3	kydlicek.hynek@gmail.com	22726840+clefourrier@users....
tasks.py in src/lighteval/tasks/multilingual	3872	1	2024-09-30	2025-06-25	13	5	kydlicek.hynek@gmail.com	30601243+nathanhb@users.nor...
metrics_sample.py in src/lighteval/metrics	813	63	2024-01-26	2025-06-25	33	16	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
metrics.py in src/lighteval/metrics	776	4	2024-01-26	2025-06-25	29	9	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
transformers_model.py in src/lighteval/models/transformers	731	28	2025-01-02	2025-06-25	14	9	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
arabic_evals.py in community_tasks	725	28	2024-02-26	2025-06-25	18	7	58257628+alielfilali01@user...	30601243+nathanhb@users.nor...
evaluation_tracker.py in src/lighteval/logging	520	17	2024-02-06	2025-06-25	27	13	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
endpoint_model.py in src/lighteval/models/endpoints	453	18	2024-12-10	2025-06-25	10	6	8515462+albertvillanova@use...	30601243+nathanhb@users.nor...
vllm_model.py in src/lighteval/models/vllm	410	15	2024-12-10	2025-06-25	19	10	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
main_endpoint.py in src/lighteval	409	4	2024-12-04	2025-06-25	18	4	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
pipeline.py in src/lighteval	311	17	2024-08-21	2025-06-25	21	8	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
vlm_transformers_model.py in src/lighteval/models/transformers	282	19	2025-05-19	2025-06-25	2	1	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
normalizations.py in src/lighteval/metrics	275	11	2024-03-06	2025-06-25	6	4	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
sglang_model.py in src/lighteval/models/sglang	257	13	2025-02-18	2025-06-25	6	4	12012211@mail.sustech.edu.cn	30601243+nathanhb@users.nor...
lighteval_task.py in src/lighteval/tasks	222	12	2024-02-06	2025-06-25	46	12	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
info_loggers.py in src/lighteval/logging	219	11	2024-02-06	2025-06-25	24	6	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
prompt_manager.py in src/lighteval/tasks	203	15	2024-08-27	2025-06-25	12	6	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
main.py in src/lighteval/tasks/extended/tiny_benchmarks	201	7	2024-03-27	2025-06-25	8	4	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
litellm_model.py in src/lighteval/models	194	11	2025-01-02	2025-06-25	10	3	joel@harvey.ai	30601243+nathanhb@users.nor...
main.py in src/lighteval/tasks/extended/mix_eval	187	6	2024-10-07	2025-06-25	4	3	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
main.py in src/lighteval/tasks/extended/olympiade_bench	172	3	2025-01-31	2025-06-25	2	1	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
dynamic_metrics.py in src/lighteval/metrics	167	8	2024-09-02	2025-06-25	10	3	kydlicek.hynek@gmail.com	30601243+nathanhb@users.nor...
registry.py in src/lighteval/tasks	158	11	2024-02-06	2025-06-25	20	7	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
main.py in src/lighteval/tasks/extended/hle	144	7	2025-02-18	2025-06-25	3	2	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
inference_providers_model.py in src/lighteval/models/endpoints	137	7	2025-03-18	2025-06-25	7	3	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
main_accelerate.py in src/lighteval	123	1	2024-02-07	2025-06-25	29	11	thomwolf@users.noreply.gith...	30601243+nathanhb@users.nor...
model_loader.py in src/lighteval/models	121	9	2024-02-07	2025-06-25	21	7	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
data.py in src/lighteval	121	13	2024-02-01	2025-06-25	18	8	thomas@huggingface.co	30601243+nathanhb@users.nor...
pyproject.toml in root	115	-	2024-02-01	2025-06-25	54	14	nathan.habib@huggingface.co	30601243+nathanhb@users.nor...
main_vllm.py in src/lighteval	112	1	2024-12-04	2025-06-25	14	8	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
main.py in src/lighteval/tasks/extended/ifeval	112	3	2024-03-27	2025-06-25	10	5	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
main_sglang.py in src/lighteval	108	1	2025-02-18	2025-06-25	6	3	12012211@mail.sustech.edu.cn	30601243+nathanhb@users.nor...
drop.py in src/lighteval/metrics/harness_compatibility	106	1	2024-03-06	2025-06-25	3	2	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
main.py in src/lighteval/tasks/extended/lcb	106	3	2025-02-18	2025-06-25	7	6	agustin.piqueres@gmail.com	30601243+nathanhb@users.nor...
french_evals.py in community_tasks	91	3	2025-01-23	2025-06-25	3	3	mauricio.diaz@inria.fr	30601243+nathanhb@users.nor...
tgi_model.py in src/lighteval/models/endpoints	88	10	2024-12-10	2025-06-25	6	4	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
main_custom.py in src/lighteval	88	1	2025-05-05	2025-06-25	4	3	joel@harvey.ai	30601243+nathanhb@users.nor...
abstract_model.py in src/lighteval/models	82	11	2024-02-07	2025-06-25	13	4	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
sample_preparator.py in src/lighteval/metrics	75	10	2024-02-01	2025-06-25	10	8	clementine@huggingface.co	30601243+nathanhb@users.nor...
utils.py in src/lighteval/models	72	7	2024-03-06	2025-06-25	6	2	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
main_nanotron.py in src/lighteval	70	1	2024-02-07	2025-06-25	15	5	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
adapter_model.py in src/lighteval/models/transformers	70	3	2024-12-10	2025-06-25	6	3	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
main_baseline.py in src/lighteval	63	1	2024-10-23	2025-06-25	4	3	kydlicek.hynek@gmail.com	30601243+nathanhb@users.nor...
main.py in src/lighteval/tasks/extended/mt_bench	61	3	2024-03-29	2025-06-25	9	3	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
delta_model.py in src/lighteval/models/transformers	56	3	2024-12-10	2025-06-25	5	2	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
_template.py in community_tasks	54	2	2024-02-24	2025-06-25	12	6	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
dummy_model.py in src/lighteval/models/dummy	50	7	2024-12-10	2025-06-25	3	2	22726840+clefourrier@users....	30601243+nathanhb@users.nor...
main_tasks.py in src/lighteval	46	3	2024-12-04	2025-06-25	4	1	30601243+nathanhb@users.nor...	30601243+nathanhb@users.nor...
requests.py in src/lighteval/tasks	42	2	2024-02-07	2025-06-25	15	5	22726840+clefourrier@users....	30601243+nathanhb@users.nor...