aws / fmeval
File Age & Freshness

File age measurements show the distribution of file ages (days since the first commit) and the file freshness (days since the latest commit).

Summary
File Change History Overall
File Age Distribution Overall
Days since first update
  • There are 66 files with 5,854 lines of code in files.
    • 64 files that are 366+ days old (5,691 lines of code)
    • 2 files that are 181-365 days old (163 lines of code)
    • 0 files that are 91-180 days old (0 lines of code)
    • 0 files that are 31-90 days old (0 lines of code)
    • 0 files that are 1-30 days old (0 lines of code)
97% | 2% | 0% | 0% | 0%
Legend:
366+
181-365
91-180
31-90
1-30

explore: grouped by folders | grouped by age
File Freshness Distribution Overall
Days since last update
  • There are 66 files with 5,854 lines of code in files.
    • 29 files have been last changed 366+ days ago (1,233 lines of code)
    • 34 files have been last changed 181-365 days ago (4,045 lines of code)
    • 1 files have been last changed 91-180 days ago (344 lines of code)
    • 2 files have been last changed 31-90 days ago (232 lines of code)
    • 0 files have been last changed 1-30 days ago (0 lines of code)
21% | 69% | 5% | 3% | 0%
Legend:
366+
181-365
91-180
31-90
1-30

explore: grouped by folders | grouped by freshness
File Change History per File Extension
py, jsonl, ipynb, md, yaml, json, txt, cfg, gitignore, toml
File Age Distribution per Extension
Days since first update
366+
181-365
91-180
31-90
1-30
py97% | 2% | 0% | 0% | 0%
toml100% | 0% | 0% | 0% | 0%
cfg100% | 0% | 0% | 0% | 0%
File Freshness Distribution per Extension
Days since last update
366+
181-365
91-180
31-90
1-30
py20% | 70% | 5% | 2% | 0%
cfg100% | 0% | 0% | 0% | 0%
toml0% | 0% | 0% | 100% | 0%
File Change History per Logical Decomposition
primary
primary (file age distribution)
Days since first update
366+
181-365
91-180
31-90
1-30
src97% | 2% | 0% | 0% | 0%
ROOT100% | 0% | 0% | 0% | 0%
primary (file freshness distribution)
Days since last update
366+
181-365
91-180
31-90
1-30
src20% | 70% | 5% | 2% | 0%
ROOT37% | 0% | 0% | 62% | 0%
Oldest Files (Top 50)
File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
65 - 2023-10-10 2025-04-03 35 8 satishgollaprolu@gmail.com satishgollaprolu@gmail.com
cfg
setup.cfg
in root
 39 - 2023-10-10 2023-10-10 1 1 kvasist@amazon.com kvasist@amazon.com
1 - 2023-10-10 2023-10-10 1 1 satishgollaprolu@gmail.com satishgollaprolu@gmail.com
eval_output_cells.py
in src/fmeval/reporting
 344 13 2023-11-08 2025-01-13 8 5 68569612+xiaoyi-cheng@users... satishgollaprolu@gmail.com
constants.py
in src/fmeval/reporting
 258 - 2023-11-08 2024-07-18 10 5 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
__init__.py
in src/fmeval/eval_algorithms
 252 7 2023-11-08 2024-06-27 13 8 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
classification_accuracy.py
in src/fmeval/eval_algorithms
 245 10 2023-11-08 2024-06-14 10 5 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
general_semantic_robustness.py
in src/fmeval/eval_algorithms
 232 7 2023-11-08 2024-08-08 14 7 68569612+xiaoyi-cheng@users... kirupang@amazon.com
qa_accuracy_semantic_robustness.py
in src/fmeval/eval_algorithms
 223 5 2023-11-08 2024-08-15 14 8 68569612+xiaoyi-cheng@users... kirupang@amazon.com
qa_accuracy.py
in src/fmeval/eval_algorithms
 220 14 2023-11-08 2024-08-19 17 8 68569612+xiaoyi-cheng@users... kirupang@amazon.com
util.py
in src/fmeval/eval_algorithms
 199 20 2023-11-08 2024-07-10 17 8 68569612+xiaoyi-cheng@users... kirupang@amazon.com
199 5 2023-11-08 2024-08-08 14 8 68569612+xiaoyi-cheng@users... kirupang@amazon.com
cells.py
in src/fmeval/reporting
 177 15 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
170 5 2023-11-08 2024-06-14 12 6 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
jumpstart_extractor.py
in src/fmeval/model_runners/extractors
 167 6 2023-11-08 2025-04-02 9 5 68569612+xiaoyi-cheng@users... shresthabikash637@gmail.com
prompt_stereotyping.py
in src/fmeval/eval_algorithms
 160 6 2023-11-08 2024-06-14 10 6 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
json_parser.py
in src/fmeval/data_loaders
 160 6 2023-11-08 2024-07-12 5 3 68569612+xiaoyi-cheng@users... 86372475+oyangz@users.norep...
summarization_accuracy.py
in src/fmeval/eval_algorithms
 157 5 2023-11-08 2024-06-14 16 6 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
factual_knowledge.py
in src/fmeval/eval_algorithms
 151 9 2023-11-08 2024-07-18 12 6 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
toxicity.py
in src/fmeval/eval_algorithms
 125 7 2023-11-08 2024-06-14 9 5 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
util.py
in src/fmeval/data_loaders
 119 8 2023-11-08 2024-04-05 5 4 68569612+xiaoyi-cheng@users... 86372475+oyangz@users.norep...
semantic_perturbation_utils.py
in src/fmeval/eval_algorithms
 115 8 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
sm_jumpstart_model_runner.py
in src/fmeval/model_runners
 98 3 2023-11-08 2024-07-11 7 5 kvasist@amazon.com daniel.e.zhu+github@gmail.com
helper_model.py
in src/fmeval/eval_algorithms/helper_models
 96 14 2023-11-08 2024-06-20 9 5 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
util.py
in src/fmeval/model_runners
 92 7 2023-11-08 2024-06-20 8 3 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
sm_model_runner.py
in src/fmeval/model_runners
 80 3 2023-11-08 2024-06-20 4 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
data_sources.py
in src/fmeval/data_loaders
 76 13 2023-11-08 2024-07-18 4 3 68569612+xiaoyi-cheng@users... 86372475+oyangz@users.norep...
bedrock_model_runner.py
in src/fmeval/model_runners
 73 3 2023-11-08 2024-06-20 3 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
constants.py
in src/fmeval
 68 - 2023-11-08 2024-07-18 20 6 68569612+xiaoyi-cheng@users... 86372475+oyangz@users.norep...
json_extractor.py
in src/fmeval/model_runners/extractors
 62 4 2023-11-08 2024-06-20 3 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
util.py
in src/fmeval
 57 10 2023-11-08 2024-04-25 6 2 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
util.py
in src/fmeval/reporting
 51 4 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
json_data_loader.py
in src/fmeval/data_loaders
 50 3 2023-11-08 2024-01-19 3 2 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
__init__.py
in src/fmeval/model_runners/extractors
 44 1 2023-11-08 2024-07-11 3 2 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
composers.py
in src/fmeval/model_runners/composers
 35 7 2023-11-08 2024-05-16 3 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
33 - 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
jmespath_util.py
in src/fmeval/data_loaders
 32 2 2023-11-08 2024-01-19 3 2 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
__init__.py
in src/fmeval/model_runners/composers
 32 1 2023-11-08 2024-06-20 2 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
jumpstart_composer.py
in src/fmeval/model_runners/composers
 32 2 2023-11-08 2024-06-20 3 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
eval_algorithm.py
in src/fmeval/eval_algorithms
 26 3 2023-11-08 2024-06-14 6 4 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
model_runner.py
in src/fmeval/model_runners
 26 2 2023-11-08 2024-06-20 2 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
data_config.py
in src/fmeval/data_loaders
 24 1 2023-11-08 2024-07-12 5 3 68569612+xiaoyi-cheng@users... 86372475+oyangz@users.norep...
template.py
in src/fmeval/model_runners/composers
 19 2 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
qa_toxicity.py
in src/fmeval/eval_algorithms
 15 1 2023-11-08 2024-03-26 2 2 68569612+xiaoyi-cheng@users... schwobel@amazon.de
summarization_toxicity.py
in src/fmeval/eval_algorithms
 15 1 2023-11-08 2024-03-26 2 2 68569612+xiaoyi-cheng@users... schwobel@amazon.de
perf_util.py
in src/fmeval
 12 1 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
extractor.py
in src/fmeval/model_runners/extractors
 11 3 2023-11-08 2024-06-20 2 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
exceptions.py
in src/fmeval
 3 - 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
__init__.py
in src/fmeval/eval_algorithms/helper_models
 1 - 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
__init__.py
in src/fmeval/reporting
 1 - 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
Files Not Recently Changed (Top 50)
File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
1 - 2023-10-10 2023-10-10 1 1 satishgollaprolu@gmail.com satishgollaprolu@gmail.com
cfg
setup.cfg
in root
 39 - 2023-10-10 2023-10-10 1 1 kvasist@amazon.com kvasist@amazon.com
__init__.py
in src/fmeval/model_runners
 1 - 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
__init__.py
in src/fmeval/data_loaders
 1 - 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
__init__.py
in src/fmeval/reporting
 1 - 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
__init__.py
in src/fmeval/eval_algorithms/helper_models
 1 - 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
exceptions.py
in src/fmeval
 3 - 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
perf_util.py
in src/fmeval
 12 1 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
template.py
in src/fmeval/model_runners/composers
 19 2 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
33 - 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
util.py
in src/fmeval/reporting
 51 4 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
semantic_perturbation_utils.py
in src/fmeval/eval_algorithms
 115 8 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
cells.py
in src/fmeval/reporting
 177 15 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
eval.py
in src/fmeval
 25 1 2023-11-09 2023-11-09 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
jmespath_util.py
in src/fmeval/data_loaders
 32 2 2023-11-08 2024-01-19 3 2 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
json_data_loader.py
in src/fmeval/data_loaders
 50 3 2023-11-08 2024-01-19 3 2 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
__init__.py
in src/fmeval/transforms
 1 - 2024-03-11 2024-03-11 1 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
transform.py
in src/fmeval/transforms
 34 4 2024-03-07 2024-03-18 3 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
semantic_perturbations.py
in src/fmeval/transforms
 155 9 2024-03-17 2024-03-18 2 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
summarization_toxicity.py
in src/fmeval/eval_algorithms
 15 1 2023-11-08 2024-03-26 2 2 68569612+xiaoyi-cheng@users... schwobel@amazon.de
qa_toxicity.py
in src/fmeval/eval_algorithms
 15 1 2023-11-08 2024-03-26 2 2 68569612+xiaoyi-cheng@users... schwobel@amazon.de
semantic_robustness_metrics.py
in src/fmeval/transforms
 65 6 2024-03-22 2024-03-27 2 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
semantic_robustness_utils.py
in src/fmeval/eval_algorithms
 86 3 2024-03-25 2024-03-27 3 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
batched_transform.py
in src/fmeval/transforms
 12 3 2024-03-28 2024-03-28 1 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
transform_pipeline.py
in src/fmeval/transforms
 61 3 2024-03-07 2024-03-28 5 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
util.py
in src/fmeval/data_loaders
 119 8 2023-11-08 2024-04-05 5 4 68569612+xiaoyi-cheng@users... 86372475+oyangz@users.norep...
util.py
in src/fmeval/transforms
 51 4 2024-03-07 2024-04-17 4 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
__init__.py
in src/fmeval
 1 - 2024-04-23 2024-04-23 1 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
util.py
in src/fmeval
 57 10 2023-11-08 2024-04-25 6 2 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
composers.py
in src/fmeval/model_runners/composers
 35 7 2023-11-08 2024-05-16 3 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
save_strategy.py
in src/fmeval/eval_algorithms
 77 13 2024-05-28 2024-05-28 1 1 kvasist@amazon.com kvasist@amazon.com
common.py
in src/fmeval/eval_algorithms
 86 2 2024-05-28 2024-05-28 1 1 kvasist@amazon.com kvasist@amazon.com
eval_algorithm.py
in src/fmeval/eval_algorithms
 26 3 2023-11-08 2024-06-14 6 4 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
toxicity.py
in src/fmeval/eval_algorithms
 125 7 2023-11-08 2024-06-14 9 5 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
summarization_accuracy.py
in src/fmeval/eval_algorithms
 157 5 2023-11-08 2024-06-14 16 6 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
prompt_stereotyping.py
in src/fmeval/eval_algorithms
 160 6 2023-11-08 2024-06-14 10 6 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
170 5 2023-11-08 2024-06-14 12 6 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
classification_accuracy.py
in src/fmeval/eval_algorithms
 245 10 2023-11-08 2024-06-14 10 5 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
extractor.py
in src/fmeval/model_runners/extractors
 11 3 2023-11-08 2024-06-20 2 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
model_runner.py
in src/fmeval/model_runners
 26 2 2023-11-08 2024-06-20 2 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
jumpstart_composer.py
in src/fmeval/model_runners/composers
 32 2 2023-11-08 2024-06-20 3 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
__init__.py
in src/fmeval/model_runners/composers
 32 1 2023-11-08 2024-06-20 2 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
json_extractor.py
in src/fmeval/model_runners/extractors
 62 4 2023-11-08 2024-06-20 3 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
bedrock_model_runner.py
in src/fmeval/model_runners
 73 3 2023-11-08 2024-06-20 3 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
sm_model_runner.py
in src/fmeval/model_runners
 80 3 2023-11-08 2024-06-20 4 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
util.py
in src/fmeval/model_runners
 92 7 2023-11-08 2024-06-20 8 3 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
helper_model.py
in src/fmeval/eval_algorithms/helper_models
 96 14 2023-11-08 2024-06-20 9 5 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
__init__.py
in src/fmeval/eval_algorithms
 252 7 2023-11-08 2024-06-27 13 8 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
util.py
in src/fmeval/eval_algorithms
 199 20 2023-11-08 2024-07-10 17 8 68569612+xiaoyi-cheng@users... kirupang@amazon.com
__init__.py
in src/fmeval/model_runners/extractors
 44 1 2023-11-08 2024-07-11 3 2 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
Most Recently Created Files (Top 50)
File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
common.py
in src/fmeval/eval_algorithms
 86 2 2024-05-28 2024-05-28 1 1 kvasist@amazon.com kvasist@amazon.com
save_strategy.py
in src/fmeval/eval_algorithms
 77 13 2024-05-28 2024-05-28 1 1 kvasist@amazon.com kvasist@amazon.com
__init__.py
in src/fmeval
 1 - 2024-04-23 2024-04-23 1 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
batched_transform.py
in src/fmeval/transforms
 12 3 2024-03-28 2024-03-28 1 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
semantic_robustness_utils.py
in src/fmeval/eval_algorithms
 86 3 2024-03-25 2024-03-27 3 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
semantic_robustness_metrics.py
in src/fmeval/transforms
 65 6 2024-03-22 2024-03-27 2 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
semantic_perturbations.py
in src/fmeval/transforms
 155 9 2024-03-17 2024-03-18 2 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
summarization_accuracy_metrics.py
in src/fmeval/transforms
 161 10 2024-03-11 2024-08-26 7 2 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
__init__.py
in src/fmeval/transforms
 1 - 2024-03-11 2024-03-11 1 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
common.py
in src/fmeval/transforms
 95 10 2024-03-07 2024-08-12 11 3 daniel.e.zhu+github@gmail.com kirupang@amazon.com
transform_pipeline.py
in src/fmeval/transforms
 61 3 2024-03-07 2024-03-28 5 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
util.py
in src/fmeval/transforms
 51 4 2024-03-07 2024-04-17 4 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
transform.py
in src/fmeval/transforms
 34 4 2024-03-07 2024-03-18 3 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
eval.py
in src/fmeval
 25 1 2023-11-09 2023-11-09 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
eval_output_cells.py
in src/fmeval/reporting
 344 13 2023-11-08 2025-01-13 8 5 68569612+xiaoyi-cheng@users... satishgollaprolu@gmail.com
constants.py
in src/fmeval/reporting
 258 - 2023-11-08 2024-07-18 10 5 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
__init__.py
in src/fmeval/eval_algorithms
 252 7 2023-11-08 2024-06-27 13 8 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
classification_accuracy.py
in src/fmeval/eval_algorithms
 245 10 2023-11-08 2024-06-14 10 5 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
general_semantic_robustness.py
in src/fmeval/eval_algorithms
 232 7 2023-11-08 2024-08-08 14 7 68569612+xiaoyi-cheng@users... kirupang@amazon.com
qa_accuracy_semantic_robustness.py
in src/fmeval/eval_algorithms
 223 5 2023-11-08 2024-08-15 14 8 68569612+xiaoyi-cheng@users... kirupang@amazon.com
qa_accuracy.py
in src/fmeval/eval_algorithms
 220 14 2023-11-08 2024-08-19 17 8 68569612+xiaoyi-cheng@users... kirupang@amazon.com
util.py
in src/fmeval/eval_algorithms
 199 20 2023-11-08 2024-07-10 17 8 68569612+xiaoyi-cheng@users... kirupang@amazon.com
199 5 2023-11-08 2024-08-08 14 8 68569612+xiaoyi-cheng@users... kirupang@amazon.com
cells.py
in src/fmeval/reporting
 177 15 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
170 5 2023-11-08 2024-06-14 12 6 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
jumpstart_extractor.py
in src/fmeval/model_runners/extractors
 167 6 2023-11-08 2025-04-02 9 5 68569612+xiaoyi-cheng@users... shresthabikash637@gmail.com
prompt_stereotyping.py
in src/fmeval/eval_algorithms
 160 6 2023-11-08 2024-06-14 10 6 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
json_parser.py
in src/fmeval/data_loaders
 160 6 2023-11-08 2024-07-12 5 3 68569612+xiaoyi-cheng@users... 86372475+oyangz@users.norep...
summarization_accuracy.py
in src/fmeval/eval_algorithms
 157 5 2023-11-08 2024-06-14 16 6 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
factual_knowledge.py
in src/fmeval/eval_algorithms
 151 9 2023-11-08 2024-07-18 12 6 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
toxicity.py
in src/fmeval/eval_algorithms
 125 7 2023-11-08 2024-06-14 9 5 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
util.py
in src/fmeval/data_loaders
 119 8 2023-11-08 2024-04-05 5 4 68569612+xiaoyi-cheng@users... 86372475+oyangz@users.norep...
semantic_perturbation_utils.py
in src/fmeval/eval_algorithms
 115 8 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
sm_jumpstart_model_runner.py
in src/fmeval/model_runners
 98 3 2023-11-08 2024-07-11 7 5 kvasist@amazon.com daniel.e.zhu+github@gmail.com
helper_model.py
in src/fmeval/eval_algorithms/helper_models
 96 14 2023-11-08 2024-06-20 9 5 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
util.py
in src/fmeval/model_runners
 92 7 2023-11-08 2024-06-20 8 3 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
sm_model_runner.py
in src/fmeval/model_runners
 80 3 2023-11-08 2024-06-20 4 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
data_sources.py
in src/fmeval/data_loaders
 76 13 2023-11-08 2024-07-18 4 3 68569612+xiaoyi-cheng@users... 86372475+oyangz@users.norep...
bedrock_model_runner.py
in src/fmeval/model_runners
 73 3 2023-11-08 2024-06-20 3 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
constants.py
in src/fmeval
 68 - 2023-11-08 2024-07-18 20 6 68569612+xiaoyi-cheng@users... 86372475+oyangz@users.norep...
json_extractor.py
in src/fmeval/model_runners/extractors
 62 4 2023-11-08 2024-06-20 3 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
util.py
in src/fmeval
 57 10 2023-11-08 2024-04-25 6 2 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
util.py
in src/fmeval/reporting
 51 4 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
json_data_loader.py
in src/fmeval/data_loaders
 50 3 2023-11-08 2024-01-19 3 2 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
__init__.py
in src/fmeval/model_runners/extractors
 44 1 2023-11-08 2024-07-11 3 2 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
composers.py
in src/fmeval/model_runners/composers
 35 7 2023-11-08 2024-05-16 3 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
33 - 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
jmespath_util.py
in src/fmeval/data_loaders
 32 2 2023-11-08 2024-01-19 3 2 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
__init__.py
in src/fmeval/model_runners/composers
 32 1 2023-11-08 2024-06-20 2 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
jumpstart_composer.py
in src/fmeval/model_runners/composers
 32 2 2023-11-08 2024-06-20 3 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
Most Recently Changed Files (Top 50)
File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
65 - 2023-10-10 2025-04-03 35 8 satishgollaprolu@gmail.com satishgollaprolu@gmail.com
jumpstart_extractor.py
in src/fmeval/model_runners/extractors
 167 6 2023-11-08 2025-04-02 9 5 68569612+xiaoyi-cheng@users... shresthabikash637@gmail.com
eval_output_cells.py
in src/fmeval/reporting
 344 13 2023-11-08 2025-01-13 8 5 68569612+xiaoyi-cheng@users... satishgollaprolu@gmail.com
summarization_accuracy_metrics.py
in src/fmeval/transforms
 161 10 2024-03-11 2024-08-26 7 2 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
qa_accuracy.py
in src/fmeval/eval_algorithms
 220 14 2023-11-08 2024-08-19 17 8 68569612+xiaoyi-cheng@users... kirupang@amazon.com
qa_accuracy_semantic_robustness.py
in src/fmeval/eval_algorithms
 223 5 2023-11-08 2024-08-15 14 8 68569612+xiaoyi-cheng@users... kirupang@amazon.com
common.py
in src/fmeval/transforms
 95 10 2024-03-07 2024-08-12 11 3 daniel.e.zhu+github@gmail.com kirupang@amazon.com
general_semantic_robustness.py
in src/fmeval/eval_algorithms
 232 7 2023-11-08 2024-08-08 14 7 68569612+xiaoyi-cheng@users... kirupang@amazon.com
199 5 2023-11-08 2024-08-08 14 8 68569612+xiaoyi-cheng@users... kirupang@amazon.com
constants.py
in src/fmeval/reporting
 258 - 2023-11-08 2024-07-18 10 5 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
factual_knowledge.py
in src/fmeval/eval_algorithms
 151 9 2023-11-08 2024-07-18 12 6 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
data_sources.py
in src/fmeval/data_loaders
 76 13 2023-11-08 2024-07-18 4 3 68569612+xiaoyi-cheng@users... 86372475+oyangz@users.norep...
constants.py
in src/fmeval
 68 - 2023-11-08 2024-07-18 20 6 68569612+xiaoyi-cheng@users... 86372475+oyangz@users.norep...
json_parser.py
in src/fmeval/data_loaders
 160 6 2023-11-08 2024-07-12 5 3 68569612+xiaoyi-cheng@users... 86372475+oyangz@users.norep...
data_config.py
in src/fmeval/data_loaders
 24 1 2023-11-08 2024-07-12 5 3 68569612+xiaoyi-cheng@users... 86372475+oyangz@users.norep...
sm_jumpstart_model_runner.py
in src/fmeval/model_runners
 98 3 2023-11-08 2024-07-11 7 5 kvasist@amazon.com daniel.e.zhu+github@gmail.com
__init__.py
in src/fmeval/model_runners/extractors
 44 1 2023-11-08 2024-07-11 3 2 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
util.py
in src/fmeval/eval_algorithms
 199 20 2023-11-08 2024-07-10 17 8 68569612+xiaoyi-cheng@users... kirupang@amazon.com
__init__.py
in src/fmeval/eval_algorithms
 252 7 2023-11-08 2024-06-27 13 8 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
helper_model.py
in src/fmeval/eval_algorithms/helper_models
 96 14 2023-11-08 2024-06-20 9 5 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
util.py
in src/fmeval/model_runners
 92 7 2023-11-08 2024-06-20 8 3 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
sm_model_runner.py
in src/fmeval/model_runners
 80 3 2023-11-08 2024-06-20 4 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
bedrock_model_runner.py
in src/fmeval/model_runners
 73 3 2023-11-08 2024-06-20 3 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
json_extractor.py
in src/fmeval/model_runners/extractors
 62 4 2023-11-08 2024-06-20 3 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
__init__.py
in src/fmeval/model_runners/composers
 32 1 2023-11-08 2024-06-20 2 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
jumpstart_composer.py
in src/fmeval/model_runners/composers
 32 2 2023-11-08 2024-06-20 3 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
model_runner.py
in src/fmeval/model_runners
 26 2 2023-11-08 2024-06-20 2 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
extractor.py
in src/fmeval/model_runners/extractors
 11 3 2023-11-08 2024-06-20 2 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
classification_accuracy.py
in src/fmeval/eval_algorithms
 245 10 2023-11-08 2024-06-14 10 5 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
170 5 2023-11-08 2024-06-14 12 6 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
prompt_stereotyping.py
in src/fmeval/eval_algorithms
 160 6 2023-11-08 2024-06-14 10 6 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
summarization_accuracy.py
in src/fmeval/eval_algorithms
 157 5 2023-11-08 2024-06-14 16 6 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
toxicity.py
in src/fmeval/eval_algorithms
 125 7 2023-11-08 2024-06-14 9 5 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
eval_algorithm.py
in src/fmeval/eval_algorithms
 26 3 2023-11-08 2024-06-14 6 4 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
common.py
in src/fmeval/eval_algorithms
 86 2 2024-05-28 2024-05-28 1 1 kvasist@amazon.com kvasist@amazon.com
save_strategy.py
in src/fmeval/eval_algorithms
 77 13 2024-05-28 2024-05-28 1 1 kvasist@amazon.com kvasist@amazon.com
composers.py
in src/fmeval/model_runners/composers
 35 7 2023-11-08 2024-05-16 3 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
util.py
in src/fmeval
 57 10 2023-11-08 2024-04-25 6 2 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
__init__.py
in src/fmeval
 1 - 2024-04-23 2024-04-23 1 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
util.py
in src/fmeval/transforms
 51 4 2024-03-07 2024-04-17 4 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
util.py
in src/fmeval/data_loaders
 119 8 2023-11-08 2024-04-05 5 4 68569612+xiaoyi-cheng@users... 86372475+oyangz@users.norep...
transform_pipeline.py
in src/fmeval/transforms
 61 3 2024-03-07 2024-03-28 5 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
batched_transform.py
in src/fmeval/transforms
 12 3 2024-03-28 2024-03-28 1 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
semantic_robustness_utils.py
in src/fmeval/eval_algorithms
 86 3 2024-03-25 2024-03-27 3 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
semantic_robustness_metrics.py
in src/fmeval/transforms
 65 6 2024-03-22 2024-03-27 2 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
qa_toxicity.py
in src/fmeval/eval_algorithms
 15 1 2023-11-08 2024-03-26 2 2 68569612+xiaoyi-cheng@users... schwobel@amazon.de
summarization_toxicity.py
in src/fmeval/eval_algorithms
 15 1 2023-11-08 2024-03-26 2 2 68569612+xiaoyi-cheng@users... schwobel@amazon.de
semantic_perturbations.py
in src/fmeval/transforms
 155 9 2024-03-17 2024-03-18 2 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
transform.py
in src/fmeval/transforms
 34 4 2024-03-07 2024-03-18 3 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
__init__.py
in src/fmeval/transforms
 1 - 2024-03-11 2024-03-11 1 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com