huggingface / lighteval
Temporal Dependencies

A temporal dependency occurs when developers change two or more files at the same time (i.e. they are a part of the same commit).


Files Most Frequently Changed Together (Top 50)

data...

Pairs # same commits # commits 1 # commits 2 latest commit
src/lighteval/models/vllm/vllm_model.py
src/lighteval/models/transformers/transformers_model.py
2 25 (8%) 15 (13%) 2025-06-25
src/lighteval/models/transformers/transformers_model.py
src/lighteval/models/litellm_model.py
2 15 (13%) 10 (20%) 2025-06-25
src/lighteval/models/vllm/vllm_model.py
src/lighteval/models/litellm_model.py
2 25 (8%) 10 (20%) 2025-06-25
src/lighteval/models/vllm/vllm_model.py
src/lighteval/models/sglang/sglang_model.py
2 25 (8%) 6 (33%) 2025-06-25
src/lighteval/models/transformers/transformers_model.py
src/lighteval/models/sglang/sglang_model.py
2 15 (13%) 6 (33%) 2025-06-25
src/lighteval/models/sglang/sglang_model.py
src/lighteval/models/litellm_model.py
2 6 (33%) 10 (20%) 2025-06-25
src/lighteval/tasks/requests.py
src/lighteval/tasks/extended/mix_eval/main.py
1 17 (5%) 4 (25%) 2025-06-25
src/lighteval/tasks/lighteval_task.py
src/lighteval/logging/info_loggers.py
1 54 (1%) 25 (4%) 2025-06-25
src/lighteval/tasks/extended/ifeval/main.py
src/lighteval/models/transformers/transformers_model.py
1 12 (8%) 15 (6%) 2025-06-25
src/lighteval/models/transformers/transformers_model.py
src/lighteval/main_endpoint.py
1 15 (6%) 22 (4%) 2025-06-25
src/lighteval/tasks/extended/lcb/main.py
src/lighteval/models/litellm_model.py
1 7 (14%) 10 (10%) 2025-06-25
src/lighteval/tasks/extended/lcb/main.py
src/lighteval/main_accelerate.py
1 7 (14%) 30 (3%) 2025-06-25
src/lighteval/models/transformers/vlm_transformers_model.py
src/lighteval/metrics/normalizations.py
1 2 (50%) 7 (14%) 2025-06-25
src/lighteval/models/transformers/transformers_model.py
src/lighteval/models/custom/custom_model.py
1 15 (6%) 2 (50%) 2025-06-25
src/lighteval/metrics/normalizations.py
src/lighteval/metrics/metrics.py
1 7 (14%) 33 (3%) 2025-06-25
src/lighteval/metrics/harness_compatibility/drop.py
src/lighteval/main_endpoint.py
1 3 (33%) 22 (4%) 2025-06-25
src/lighteval/main_tasks.py
community_tasks/french_evals.py
1 4 (25%) 4 (25%) 2025-06-25
src/lighteval/models/endpoints/endpoint_model.py
src/lighteval/main_sglang.py
1 14 (7%) 6 (16%) 2025-06-25
src/lighteval/models/endpoints/endpoint_model.py
src/lighteval/metrics/utils/metric_utils.py
1 14 (7%) 2 (50%) 2025-06-25
src/lighteval/models/transformers/vlm_transformers_model.py
src/lighteval/main_accelerate.py
1 2 (50%) 30 (3%) 2025-06-25
src/lighteval/tasks/extended/ifeval/main.py
community_tasks/_template.py
1 12 (8%) 13 (7%) 2025-06-25
src/lighteval/tasks/lighteval_task.py
src/lighteval/main_custom.py
1 54 (1%) 5 (20%) 2025-06-25
src/lighteval/main_vllm.py
src/lighteval/logging/info_loggers.py
1 14 (7%) 25 (4%) 2025-06-25
src/lighteval/models/model_output.py
community_tasks/arabic_evals.py
1 10 (10%) 19 (5%) 2025-06-25
src/lighteval/tasks/lighteval_task.py
src/lighteval/main_nanotron.py
1 54 (1%) 18 (5%) 2025-06-25
src/lighteval/tasks/extended/mt_bench/main.py
src/lighteval/models/dummy/dummy_model.py
1 10 (10%) 3 (33%) 2025-06-25
src/lighteval/models/transformers/transformers_model.py
src/lighteval/models/endpoints/tgi_model.py
1 15 (6%) 6 (16%) 2025-06-25
src/lighteval/tasks/extended/ifeval/main.py
src/lighteval/models/custom/custom_model.py
1 12 (8%) 2 (50%) 2025-06-25
src/lighteval/tasks/multilingual/tasks.py
src/lighteval/models/dummy/dummy_model.py
1 15 (6%) 3 (33%) 2025-06-25
src/lighteval/main_sglang.py
community_tasks/french_evals.py
1 6 (16%) 4 (25%) 2025-06-25
src/lighteval/models/abstract_model.py
pyproject.toml
1 14 (7%) 66 (1%) 2025-06-25
src/lighteval/tasks/prompt_manager.py
src/lighteval/main_accelerate.py
1 12 (8%) 30 (3%) 2025-06-25
src/lighteval/models/transformers/vlm_transformers_model.py
src/lighteval/metrics/harness_compatibility/truthful_qa.py
1 2 (50%) 3 (33%) 2025-06-25
src/lighteval/tasks/extended/hle/main.py
community_tasks/arabic_evals.py
1 3 (33%) 19 (5%) 2025-06-25
src/lighteval/tasks/extended/lcb/main.py
src/lighteval/models/endpoints/inference_providers_model.py
1 7 (14%) 8 (12%) 2025-06-25
src/lighteval/models/abstract_model.py
community_tasks/french_evals.py
1 14 (7%) 4 (25%) 2025-06-25
src/lighteval/logging/info_loggers.py
src/lighteval/data.py
1 25 (4%) 19 (5%) 2025-06-25
src/lighteval/metrics/__init__.py
community_tasks/arabic_evals.py
1 25 (4%) 19 (5%) 2025-06-25
src/lighteval/tasks/lighteval_task.py
src/lighteval/metrics/utils/metric_utils.py
1 54 (1%) 2 (50%) 2025-06-25
src/lighteval/metrics/dynamic_metrics.py
src/lighteval/logging/evaluation_tracker.py
1 10 (10%) 34 (2%) 2025-06-25
src/lighteval/metrics/metrics.py
src/lighteval/logging/info_loggers.py
1 33 (3%) 25 (4%) 2025-06-25
src/lighteval/models/transformers/delta_model.py
src/lighteval/metrics/sample_preparator.py
1 5 (20%) 11 (9%) 2025-06-25
src/lighteval/tasks/multilingual/tasks.py
src/lighteval/main_sglang.py
1 15 (6%) 6 (16%) 2025-06-25
src/lighteval/models/vllm/vllm_model.py
src/lighteval/metrics/normalizations.py
1 25 (4%) 7 (14%) 2025-06-25
src/lighteval/main_sglang.py
pyproject.toml
1 6 (16%) 66 (1%) 2025-06-25
src/lighteval/tasks/prompt_manager.py
src/lighteval/metrics/dynamic_metrics.py
1 12 (8%) 10 (10%) 2025-06-25
src/lighteval/tasks/registry.py
src/lighteval/tasks/extended/mt_bench/main.py
1 21 (4%) 10 (10%) 2025-06-25
src/lighteval/models/litellm_model.py
src/lighteval/models/endpoints/tgi_model.py
1 10 (10%) 6 (16%) 2025-06-25
src/lighteval/pipeline.py
src/lighteval/models/litellm_model.py
1 27 (3%) 10 (10%) 2025-06-25
src/lighteval/metrics/metrics.py
src/lighteval/main_custom.py
1 33 (3%) 5 (20%) 2025-06-25
Dependencies between files in same commits
The number on the lines shows the number of shared commits.
G [src/lighteval/models/vllm/vllm_model.py] [src/lighteval/models/vllm/vllm_model.py] [src/lighteval/models/transformers/transformers_model.py] [src/lighteval/models/transformers/transformers_model.py] [src/lighteval/models/vllm/vllm_model.py]--[src/lighteval/models/transformers/transformers_model.py] 2 [src/lighteval/models/litellm_model.py] [src/lighteval/models/litellm_model.py] [src/lighteval/models/vllm/vllm_model.py]--[src/lighteval/models/litellm_model.py] 2 [src/lighteval/models/sglang/sglang_model.py] [src/lighteval/models/sglang/sglang_model.py] [src/lighteval/models/vllm/vllm_model.py]--[src/lighteval/models/sglang/sglang_model.py] 2 [src/lighteval/metrics/normalizations.py] [src/lighteval/metrics/normalizations.py] [src/lighteval/models/vllm/vllm_model.py]--[src/lighteval/metrics/normalizations.py] 1 [src/lighteval/models/transformers/transformers_model.py]--[src/lighteval/models/litellm_model.py] 2 [src/lighteval/models/transformers/transformers_model.py]--[src/lighteval/models/sglang/sglang_model.py] 2 [src/lighteval/main_endpoint.py] [src/lighteval/main_endpoint.py] [src/lighteval/models/transformers/transformers_model.py]--[src/lighteval/main_endpoint.py] 1 [src/lighteval/models/custom/custom_model.py] [src/lighteval/models/custom/custom_model.py] [src/lighteval/models/transformers/transformers_model.py]--[src/lighteval/models/custom/custom_model.py] 1 [src/lighteval/models/endpoints/tgi_model.py] [src/lighteval/models/endpoints/tgi_model.py] [src/lighteval/models/transformers/transformers_model.py]--[src/lighteval/models/endpoints/tgi_model.py] 1 [src/lighteval/models/litellm_model.py]--[src/lighteval/models/endpoints/tgi_model.py] 1 [src/lighteval/models/sglang/sglang_model.py]--[src/lighteval/models/litellm_model.py] 2 [src/lighteval/tasks/requests.py] [src/lighteval/tasks/requests.py] [src/lighteval/tasks/extended/mix_eval/main.py] [src/lighteval/tasks/extended/mix_eval/main.py] [src/lighteval/tasks/requests.py]--[src/lighteval/tasks/extended/mix_eval/main.py] 1 [src/lighteval/tasks/lighteval_task.py] [src/lighteval/tasks/lighteval_task.py] [src/lighteval/logging/info_loggers.py] [src/lighteval/logging/info_loggers.py] [src/lighteval/tasks/lighteval_task.py]--[src/lighteval/logging/info_loggers.py] 1 [src/lighteval/metrics/utils/metric_utils.py] [src/lighteval/metrics/utils/metric_utils.py] [src/lighteval/tasks/lighteval_task.py]--[src/lighteval/metrics/utils/metric_utils.py] 1 [src/lighteval/main_custom.py] [src/lighteval/main_custom.py] [src/lighteval/tasks/lighteval_task.py]--[src/lighteval/main_custom.py] 1 [src/lighteval/main_nanotron.py] [src/lighteval/main_nanotron.py] [src/lighteval/tasks/lighteval_task.py]--[src/lighteval/main_nanotron.py] 1 [src/lighteval/data.py] [src/lighteval/data.py] [src/lighteval/logging/info_loggers.py]--[src/lighteval/data.py] 1 [src/lighteval/tasks/extended/ifeval/main.py] [src/lighteval/tasks/extended/ifeval/main.py] [src/lighteval/tasks/extended/ifeval/main.py]--[src/lighteval/models/transformers/transformers_model.py] 1 [src/lighteval/tasks/extended/ifeval/main.py]--[src/lighteval/models/custom/custom_model.py] 1 [community_tasks/_template.py] [community_tasks/_template.py] [src/lighteval/tasks/extended/ifeval/main.py]--[community_tasks/_template.py] 1 [src/lighteval/tasks/extended/lcb/main.py] [src/lighteval/tasks/extended/lcb/main.py] [src/lighteval/tasks/extended/lcb/main.py]--[src/lighteval/models/litellm_model.py] 1 [src/lighteval/main_accelerate.py] [src/lighteval/main_accelerate.py] [src/lighteval/tasks/extended/lcb/main.py]--[src/lighteval/main_accelerate.py] 1 [src/lighteval/models/endpoints/inference_providers_model.py] [src/lighteval/models/endpoints/inference_providers_model.py] [src/lighteval/tasks/extended/lcb/main.py]--[src/lighteval/models/endpoints/inference_providers_model.py] 1 [src/lighteval/models/transformers/vlm_transformers_model.py] [src/lighteval/models/transformers/vlm_transformers_model.py] [src/lighteval/models/transformers/vlm_transformers_model.py]--[src/lighteval/main_accelerate.py] 1 [src/lighteval/models/transformers/vlm_transformers_model.py]--[src/lighteval/metrics/normalizations.py] 1 [src/lighteval/metrics/harness_compatibility/truthful_qa.py] [src/lighteval/metrics/harness_compatibility/truthful_qa.py] [src/lighteval/models/transformers/vlm_transformers_model.py]--[src/lighteval/metrics/harness_compatibility/truthful_qa.py] 1 [src/lighteval/metrics/metrics.py] [src/lighteval/metrics/metrics.py] [src/lighteval/metrics/normalizations.py]--[src/lighteval/metrics/metrics.py] 1 [src/lighteval/metrics/metrics.py]--[src/lighteval/logging/info_loggers.py] 1 [src/lighteval/metrics/metrics.py]--[src/lighteval/main_custom.py] 1 [src/lighteval/metrics/harness_compatibility/drop.py] [src/lighteval/metrics/harness_compatibility/drop.py] [src/lighteval/metrics/harness_compatibility/drop.py]--[src/lighteval/main_endpoint.py] 1 [src/lighteval/main_tasks.py] [src/lighteval/main_tasks.py] [community_tasks/french_evals.py] [community_tasks/french_evals.py] [src/lighteval/main_tasks.py]--[community_tasks/french_evals.py] 1 [src/lighteval/models/endpoints/endpoint_model.py] [src/lighteval/models/endpoints/endpoint_model.py] [src/lighteval/main_sglang.py] [src/lighteval/main_sglang.py] [src/lighteval/models/endpoints/endpoint_model.py]--[src/lighteval/main_sglang.py] 1 [src/lighteval/models/endpoints/endpoint_model.py]--[src/lighteval/metrics/utils/metric_utils.py] 1 [src/lighteval/main_sglang.py]--[community_tasks/french_evals.py] 1 [pyproject.toml] [pyproject.toml] [src/lighteval/main_sglang.py]--[pyproject.toml] 1 [src/lighteval/main_vllm.py] [src/lighteval/main_vllm.py] [src/lighteval/main_vllm.py]--[src/lighteval/logging/info_loggers.py] 1 [src/lighteval/models/model_output.py] [src/lighteval/models/model_output.py] [community_tasks/arabic_evals.py] [community_tasks/arabic_evals.py] [src/lighteval/models/model_output.py]--[community_tasks/arabic_evals.py] 1 [src/lighteval/tasks/extended/mt_bench/main.py] [src/lighteval/tasks/extended/mt_bench/main.py] [src/lighteval/models/dummy/dummy_model.py] [src/lighteval/models/dummy/dummy_model.py] [src/lighteval/tasks/extended/mt_bench/main.py]--[src/lighteval/models/dummy/dummy_model.py] 1 [src/lighteval/tasks/multilingual/tasks.py] [src/lighteval/tasks/multilingual/tasks.py] [src/lighteval/tasks/multilingual/tasks.py]--[src/lighteval/main_sglang.py] 1 [src/lighteval/tasks/multilingual/tasks.py]--[src/lighteval/models/dummy/dummy_model.py] 1 [src/lighteval/models/abstract_model.py] [src/lighteval/models/abstract_model.py] [src/lighteval/models/abstract_model.py]--[community_tasks/french_evals.py] 1 [src/lighteval/models/abstract_model.py]--[pyproject.toml] 1 [src/lighteval/tasks/prompt_manager.py] [src/lighteval/tasks/prompt_manager.py] [src/lighteval/tasks/prompt_manager.py]--[src/lighteval/main_accelerate.py] 1 [src/lighteval/metrics/dynamic_metrics.py] [src/lighteval/metrics/dynamic_metrics.py] [src/lighteval/tasks/prompt_manager.py]--[src/lighteval/metrics/dynamic_metrics.py] 1 [src/lighteval/tasks/extended/hle/main.py] [src/lighteval/tasks/extended/hle/main.py] [src/lighteval/tasks/extended/hle/main.py]--[community_tasks/arabic_evals.py] 1 [src/lighteval/metrics/__init__.py] [src/lighteval/metrics/__init__.py] [src/lighteval/metrics/__init__.py]--[community_tasks/arabic_evals.py] 1 [src/lighteval/logging/evaluation_tracker.py] [src/lighteval/logging/evaluation_tracker.py] [src/lighteval/metrics/dynamic_metrics.py]--[src/lighteval/logging/evaluation_tracker.py] 1 [src/lighteval/models/transformers/delta_model.py] [src/lighteval/models/transformers/delta_model.py] [src/lighteval/metrics/sample_preparator.py] [src/lighteval/metrics/sample_preparator.py] [src/lighteval/models/transformers/delta_model.py]--[src/lighteval/metrics/sample_preparator.py] 1 [src/lighteval/tasks/registry.py] [src/lighteval/tasks/registry.py] [src/lighteval/tasks/registry.py]--[src/lighteval/tasks/extended/mt_bench/main.py] 1 [src/lighteval/pipeline.py] [src/lighteval/pipeline.py] [src/lighteval/pipeline.py]--[src/lighteval/models/litellm_model.py] 1
Download: SVG DOT (open online Graphviz editor)

Open 2D force graph (file dependencies)... Open 3D force graph (file dependencies)...
Open 2D force graph (file dependencies with commits)... Open 3D force graph (file dependencies with commits)...
Dependencies between components in same commits (primary)
The number on the lines shows the number of shared commits.
G src src src--src 3 community_tasks community_tasks src--community_tasks 1 ROOT ROOT src--ROOT 1 community_tasks--community_tasks 1 ROOT--community_tasks 1
Download: SVG DOT (open online Graphviz editor)

Open 2D force graph (file dependencies)... Open 3D force graph (file dependencies)...