aws / fmeval
File Change Frequency

File change frequency (churn) shows the distribution of file updates (days with at least one commit).

Overview
File Change Frequency Overall
  • There are 66 files with 5,854 lines of code.
    • 0 files changed more than 100 times (0 lines of code)
    • 0 files changed 51-100 times (0 lines of code)
    • 1 file changed 21-50 times (65 lines of code)
    • 23 files changed 6-20 times (3,795 lines of code)
    • 42 files changed 1-5 times (1,994 lines of code)
0% | 0% | 1% | 64% | 34%
Legend:
101+
51-100
21-50
6-20
1-5

explore: grouped by folders | grouped by update frequency | data
Contributors Count Frequency Overall
  • There are 66 files with 5,854 lines of code.
    • 0 files changed by more than 25 contributors (0 lines of code)
    • 0 files changed by 11-25 contributors (0 lines of code)
    • 12 files changed by 6-10 contributors (2,096 lines of code)
    • 26 files changed by 2-5 contributors (2,581 lines of code)
    • 28 files changed by 1 contributor (1,177 lines of code)
0% | 0% | 35% | 44% | 20%
Legend:
26+
11-25
6-10
2-5
1

explore: grouped by folders | grouped by contributors count | data
File Change Frequency per File Extension
py, jsonl, ipynb, md, yaml, json, txt, cfg, gitignore, toml
File Change Frequency per Extension
The number of recorded file updates
101+
51-100
21-50
6-20
1-5
toml0% | 0% | 100% | 0% | 0%
py0% | 0% | 0% | 66% | 34%
cfg0% | 0% | 0% | 0% | 100%
File Change Frequency per Logical Decomposition
primary
primary (file change frequency)
The number of recorded file updates
101+
51-100
21-50
6-20
1-5
ROOT0% | 0% | 62% | 0% | 37%
src0% | 0% | 0% | 66% | 34%
Most Frequently Changed Files (Top 50)

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
65 - 2023-10-10 2025-04-03 35 8 satishgollaprolu@gmail.com satishgollaprolu@gmail.com
constants.py
in src/fmeval
 68 - 2023-11-08 2024-07-18 20 6 68569612+xiaoyi-cheng@users... 86372475+oyangz@users.norep...
util.py
in src/fmeval/eval_algorithms
 199 20 2023-11-08 2024-07-10 17 8 68569612+xiaoyi-cheng@users... kirupang@amazon.com
qa_accuracy.py
in src/fmeval/eval_algorithms
 220 14 2023-11-08 2024-08-19 17 8 68569612+xiaoyi-cheng@users... kirupang@amazon.com
summarization_accuracy.py
in src/fmeval/eval_algorithms
 157 5 2023-11-08 2024-06-14 16 6 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
199 5 2023-11-08 2024-08-08 14 8 68569612+xiaoyi-cheng@users... kirupang@amazon.com
qa_accuracy_semantic_robustness.py
in src/fmeval/eval_algorithms
 223 5 2023-11-08 2024-08-15 14 8 68569612+xiaoyi-cheng@users... kirupang@amazon.com
general_semantic_robustness.py
in src/fmeval/eval_algorithms
 232 7 2023-11-08 2024-08-08 14 7 68569612+xiaoyi-cheng@users... kirupang@amazon.com
__init__.py
in src/fmeval/eval_algorithms
 252 7 2023-11-08 2024-06-27 13 8 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
factual_knowledge.py
in src/fmeval/eval_algorithms
 151 9 2023-11-08 2024-07-18 12 6 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
170 5 2023-11-08 2024-06-14 12 6 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
common.py
in src/fmeval/transforms
 95 10 2024-03-07 2024-08-12 11 3 daniel.e.zhu+github@gmail.com kirupang@amazon.com
prompt_stereotyping.py
in src/fmeval/eval_algorithms
 160 6 2023-11-08 2024-06-14 10 6 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
classification_accuracy.py
in src/fmeval/eval_algorithms
 245 10 2023-11-08 2024-06-14 10 5 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
constants.py
in src/fmeval/reporting
 258 - 2023-11-08 2024-07-18 10 5 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
helper_model.py
in src/fmeval/eval_algorithms/helper_models
 96 14 2023-11-08 2024-06-20 9 5 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
toxicity.py
in src/fmeval/eval_algorithms
 125 7 2023-11-08 2024-06-14 9 5 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
jumpstart_extractor.py
in src/fmeval/model_runners/extractors
 167 6 2023-11-08 2025-04-02 9 5 68569612+xiaoyi-cheng@users... shresthabikash637@gmail.com
util.py
in src/fmeval/model_runners
 92 7 2023-11-08 2024-06-20 8 3 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
eval_output_cells.py
in src/fmeval/reporting
 344 13 2023-11-08 2025-01-13 8 5 68569612+xiaoyi-cheng@users... satishgollaprolu@gmail.com
sm_jumpstart_model_runner.py
in src/fmeval/model_runners
 98 3 2023-11-08 2024-07-11 7 5 kvasist@amazon.com daniel.e.zhu+github@gmail.com
summarization_accuracy_metrics.py
in src/fmeval/transforms
 161 10 2024-03-11 2024-08-26 7 2 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
eval_algorithm.py
in src/fmeval/eval_algorithms
 26 3 2023-11-08 2024-06-14 6 4 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
util.py
in src/fmeval
 57 10 2023-11-08 2024-04-25 6 2 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
data_config.py
in src/fmeval/data_loaders
 24 1 2023-11-08 2024-07-12 5 3 68569612+xiaoyi-cheng@users... 86372475+oyangz@users.norep...
transform_pipeline.py
in src/fmeval/transforms
 61 3 2024-03-07 2024-03-28 5 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
util.py
in src/fmeval/data_loaders
 119 8 2023-11-08 2024-04-05 5 4 68569612+xiaoyi-cheng@users... 86372475+oyangz@users.norep...
json_parser.py
in src/fmeval/data_loaders
 160 6 2023-11-08 2024-07-12 5 3 68569612+xiaoyi-cheng@users... 86372475+oyangz@users.norep...
util.py
in src/fmeval/transforms
 51 4 2024-03-07 2024-04-17 4 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
data_sources.py
in src/fmeval/data_loaders
 76 13 2023-11-08 2024-07-18 4 3 68569612+xiaoyi-cheng@users... 86372475+oyangz@users.norep...
sm_model_runner.py
in src/fmeval/model_runners
 80 3 2023-11-08 2024-06-20 4 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
jumpstart_composer.py
in src/fmeval/model_runners/composers
 32 2 2023-11-08 2024-06-20 3 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
jmespath_util.py
in src/fmeval/data_loaders
 32 2 2023-11-08 2024-01-19 3 2 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
transform.py
in src/fmeval/transforms
 34 4 2024-03-07 2024-03-18 3 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
composers.py
in src/fmeval/model_runners/composers
 35 7 2023-11-08 2024-05-16 3 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
__init__.py
in src/fmeval/model_runners/extractors
 44 1 2023-11-08 2024-07-11 3 2 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
json_data_loader.py
in src/fmeval/data_loaders
 50 3 2023-11-08 2024-01-19 3 2 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
json_extractor.py
in src/fmeval/model_runners/extractors
 62 4 2023-11-08 2024-06-20 3 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
bedrock_model_runner.py
in src/fmeval/model_runners
 73 3 2023-11-08 2024-06-20 3 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
semantic_robustness_utils.py
in src/fmeval/eval_algorithms
 86 3 2024-03-25 2024-03-27 3 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
extractor.py
in src/fmeval/model_runners/extractors
 11 3 2023-11-08 2024-06-20 2 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
summarization_toxicity.py
in src/fmeval/eval_algorithms
 15 1 2023-11-08 2024-03-26 2 2 68569612+xiaoyi-cheng@users... schwobel@amazon.de
qa_toxicity.py
in src/fmeval/eval_algorithms
 15 1 2023-11-08 2024-03-26 2 2 68569612+xiaoyi-cheng@users... schwobel@amazon.de
model_runner.py
in src/fmeval/model_runners
 26 2 2023-11-08 2024-06-20 2 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
__init__.py
in src/fmeval/model_runners/composers
 32 1 2023-11-08 2024-06-20 2 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
semantic_robustness_metrics.py
in src/fmeval/transforms
 65 6 2024-03-22 2024-03-27 2 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
semantic_perturbations.py
in src/fmeval/transforms
 155 9 2024-03-17 2024-03-18 2 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
__init__.py
in src/fmeval/model_runners
 1 - 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
__init__.py
in src/fmeval/transforms
 1 - 2024-03-11 2024-03-11 1 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
__init__.py
in src/fmeval/data_loaders
 1 - 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
Files With Most Contributors (Top 50)
Based on the number of unique email addresses found in commits.

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
65 - 2023-10-10 2025-04-03 35 8 satishgollaprolu@gmail.com satishgollaprolu@gmail.com
util.py
in src/fmeval/eval_algorithms
 199 20 2023-11-08 2024-07-10 17 8 68569612+xiaoyi-cheng@users... kirupang@amazon.com
qa_accuracy.py
in src/fmeval/eval_algorithms
 220 14 2023-11-08 2024-08-19 17 8 68569612+xiaoyi-cheng@users... kirupang@amazon.com
199 5 2023-11-08 2024-08-08 14 8 68569612+xiaoyi-cheng@users... kirupang@amazon.com
qa_accuracy_semantic_robustness.py
in src/fmeval/eval_algorithms
 223 5 2023-11-08 2024-08-15 14 8 68569612+xiaoyi-cheng@users... kirupang@amazon.com
__init__.py
in src/fmeval/eval_algorithms
 252 7 2023-11-08 2024-06-27 13 8 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
general_semantic_robustness.py
in src/fmeval/eval_algorithms
 232 7 2023-11-08 2024-08-08 14 7 68569612+xiaoyi-cheng@users... kirupang@amazon.com
constants.py
in src/fmeval
 68 - 2023-11-08 2024-07-18 20 6 68569612+xiaoyi-cheng@users... 86372475+oyangz@users.norep...
summarization_accuracy.py
in src/fmeval/eval_algorithms
 157 5 2023-11-08 2024-06-14 16 6 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
factual_knowledge.py
in src/fmeval/eval_algorithms
 151 9 2023-11-08 2024-07-18 12 6 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
170 5 2023-11-08 2024-06-14 12 6 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
prompt_stereotyping.py
in src/fmeval/eval_algorithms
 160 6 2023-11-08 2024-06-14 10 6 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
classification_accuracy.py
in src/fmeval/eval_algorithms
 245 10 2023-11-08 2024-06-14 10 5 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
constants.py
in src/fmeval/reporting
 258 - 2023-11-08 2024-07-18 10 5 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
toxicity.py
in src/fmeval/eval_algorithms
 125 7 2023-11-08 2024-06-14 9 5 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
helper_model.py
in src/fmeval/eval_algorithms/helper_models
 96 14 2023-11-08 2024-06-20 9 5 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
jumpstart_extractor.py
in src/fmeval/model_runners/extractors
 167 6 2023-11-08 2025-04-02 9 5 68569612+xiaoyi-cheng@users... shresthabikash637@gmail.com
eval_output_cells.py
in src/fmeval/reporting
 344 13 2023-11-08 2025-01-13 8 5 68569612+xiaoyi-cheng@users... satishgollaprolu@gmail.com
sm_jumpstart_model_runner.py
in src/fmeval/model_runners
 98 3 2023-11-08 2024-07-11 7 5 kvasist@amazon.com daniel.e.zhu+github@gmail.com
eval_algorithm.py
in src/fmeval/eval_algorithms
 26 3 2023-11-08 2024-06-14 6 4 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
util.py
in src/fmeval/data_loaders
 119 8 2023-11-08 2024-04-05 5 4 68569612+xiaoyi-cheng@users... 86372475+oyangz@users.norep...
common.py
in src/fmeval/transforms
 95 10 2024-03-07 2024-08-12 11 3 daniel.e.zhu+github@gmail.com kirupang@amazon.com
util.py
in src/fmeval/model_runners
 92 7 2023-11-08 2024-06-20 8 3 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
data_config.py
in src/fmeval/data_loaders
 24 1 2023-11-08 2024-07-12 5 3 68569612+xiaoyi-cheng@users... 86372475+oyangz@users.norep...
json_parser.py
in src/fmeval/data_loaders
 160 6 2023-11-08 2024-07-12 5 3 68569612+xiaoyi-cheng@users... 86372475+oyangz@users.norep...
data_sources.py
in src/fmeval/data_loaders
 76 13 2023-11-08 2024-07-18 4 3 68569612+xiaoyi-cheng@users... 86372475+oyangz@users.norep...
summarization_accuracy_metrics.py
in src/fmeval/transforms
 161 10 2024-03-11 2024-08-26 7 2 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
util.py
in src/fmeval
 57 10 2023-11-08 2024-04-25 6 2 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
sm_model_runner.py
in src/fmeval/model_runners
 80 3 2023-11-08 2024-06-20 4 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
jmespath_util.py
in src/fmeval/data_loaders
 32 2 2023-11-08 2024-01-19 3 2 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
json_data_loader.py
in src/fmeval/data_loaders
 50 3 2023-11-08 2024-01-19 3 2 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
bedrock_model_runner.py
in src/fmeval/model_runners
 73 3 2023-11-08 2024-06-20 3 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
composers.py
in src/fmeval/model_runners/composers
 35 7 2023-11-08 2024-05-16 3 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
jumpstart_composer.py
in src/fmeval/model_runners/composers
 32 2 2023-11-08 2024-06-20 3 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
json_extractor.py
in src/fmeval/model_runners/extractors
 62 4 2023-11-08 2024-06-20 3 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
__init__.py
in src/fmeval/model_runners/extractors
 44 1 2023-11-08 2024-07-11 3 2 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
qa_toxicity.py
in src/fmeval/eval_algorithms
 15 1 2023-11-08 2024-03-26 2 2 68569612+xiaoyi-cheng@users... schwobel@amazon.de
summarization_toxicity.py
in src/fmeval/eval_algorithms
 15 1 2023-11-08 2024-03-26 2 2 68569612+xiaoyi-cheng@users... schwobel@amazon.de
transform_pipeline.py
in src/fmeval/transforms
 61 3 2024-03-07 2024-03-28 5 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
util.py
in src/fmeval/transforms
 51 4 2024-03-07 2024-04-17 4 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
semantic_robustness_utils.py
in src/fmeval/eval_algorithms
 86 3 2024-03-25 2024-03-27 3 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
transform.py
in src/fmeval/transforms
 34 4 2024-03-07 2024-03-18 3 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
semantic_perturbations.py
in src/fmeval/transforms
 155 9 2024-03-17 2024-03-18 2 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
semantic_robustness_metrics.py
in src/fmeval/transforms
 65 6 2024-03-22 2024-03-27 2 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
__init__.py
in src/fmeval/model_runners/composers
 32 1 2023-11-08 2024-06-20 2 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
model_runner.py
in src/fmeval/model_runners
 26 2 2023-11-08 2024-06-20 2 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
extractor.py
in src/fmeval/model_runners/extractors
 11 3 2023-11-08 2024-06-20 2 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
1 - 2023-10-10 2023-10-10 1 1 satishgollaprolu@gmail.com satishgollaprolu@gmail.com
perf_util.py
in src/fmeval
 12 1 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
__init__.py
in src/fmeval
 1 - 2024-04-23 2024-04-23 1 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
Files With Least Contributors (Top 50)
Based on the number of unique email addresses found in commits.

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
cells.py
in src/fmeval/reporting
 177 15 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
semantic_perturbations.py
in src/fmeval/transforms
 155 9 2024-03-17 2024-03-18 2 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
semantic_perturbation_utils.py
in src/fmeval/eval_algorithms
 115 8 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
semantic_robustness_utils.py
in src/fmeval/eval_algorithms
 86 3 2024-03-25 2024-03-27 3 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
common.py
in src/fmeval/eval_algorithms
 86 2 2024-05-28 2024-05-28 1 1 kvasist@amazon.com kvasist@amazon.com
save_strategy.py
in src/fmeval/eval_algorithms
 77 13 2024-05-28 2024-05-28 1 1 kvasist@amazon.com kvasist@amazon.com
semantic_robustness_metrics.py
in src/fmeval/transforms
 65 6 2024-03-22 2024-03-27 2 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
transform_pipeline.py
in src/fmeval/transforms
 61 3 2024-03-07 2024-03-28 5 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
util.py
in src/fmeval/reporting
 51 4 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
util.py
in src/fmeval/transforms
 51 4 2024-03-07 2024-04-17 4 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
cfg
setup.cfg
in root
 39 - 2023-10-10 2023-10-10 1 1 kvasist@amazon.com kvasist@amazon.com
transform.py
in src/fmeval/transforms
 34 4 2024-03-07 2024-03-18 3 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
33 - 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
__init__.py
in src/fmeval/model_runners/composers
 32 1 2023-11-08 2024-06-20 2 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
model_runner.py
in src/fmeval/model_runners
 26 2 2023-11-08 2024-06-20 2 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
eval.py
in src/fmeval
 25 1 2023-11-09 2023-11-09 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
template.py
in src/fmeval/model_runners/composers
 19 2 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
perf_util.py
in src/fmeval
 12 1 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
batched_transform.py
in src/fmeval/transforms
 12 3 2024-03-28 2024-03-28 1 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
extractor.py
in src/fmeval/model_runners/extractors
 11 3 2023-11-08 2024-06-20 2 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
exceptions.py
in src/fmeval
 3 - 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
1 - 2023-10-10 2023-10-10 1 1 satishgollaprolu@gmail.com satishgollaprolu@gmail.com
__init__.py
in src/fmeval
 1 - 2024-04-23 2024-04-23 1 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
__init__.py
in src/fmeval/eval_algorithms/helper_models
 1 - 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
__init__.py
in src/fmeval/reporting
 1 - 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
__init__.py
in src/fmeval/data_loaders
 1 - 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
__init__.py
in src/fmeval/transforms
 1 - 2024-03-11 2024-03-11 1 1 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
__init__.py
in src/fmeval/model_runners
 1 - 2023-11-08 2023-11-08 1 1 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
summarization_accuracy_metrics.py
in src/fmeval/transforms
 161 10 2024-03-11 2024-08-26 7 2 daniel.e.zhu+github@gmail.com daniel.e.zhu+github@gmail.com
sm_model_runner.py
in src/fmeval/model_runners
 80 3 2023-11-08 2024-06-20 4 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
bedrock_model_runner.py
in src/fmeval/model_runners
 73 3 2023-11-08 2024-06-20 3 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
json_extractor.py
in src/fmeval/model_runners/extractors
 62 4 2023-11-08 2024-06-20 3 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
util.py
in src/fmeval
 57 10 2023-11-08 2024-04-25 6 2 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
json_data_loader.py
in src/fmeval/data_loaders
 50 3 2023-11-08 2024-01-19 3 2 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
__init__.py
in src/fmeval/model_runners/extractors
 44 1 2023-11-08 2024-07-11 3 2 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
composers.py
in src/fmeval/model_runners/composers
 35 7 2023-11-08 2024-05-16 3 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
jmespath_util.py
in src/fmeval/data_loaders
 32 2 2023-11-08 2024-01-19 3 2 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
jumpstart_composer.py
in src/fmeval/model_runners/composers
 32 2 2023-11-08 2024-06-20 3 2 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
qa_toxicity.py
in src/fmeval/eval_algorithms
 15 1 2023-11-08 2024-03-26 2 2 68569612+xiaoyi-cheng@users... schwobel@amazon.de
summarization_toxicity.py
in src/fmeval/eval_algorithms
 15 1 2023-11-08 2024-03-26 2 2 68569612+xiaoyi-cheng@users... schwobel@amazon.de
json_parser.py
in src/fmeval/data_loaders
 160 6 2023-11-08 2024-07-12 5 3 68569612+xiaoyi-cheng@users... 86372475+oyangz@users.norep...
common.py
in src/fmeval/transforms
 95 10 2024-03-07 2024-08-12 11 3 daniel.e.zhu+github@gmail.com kirupang@amazon.com
util.py
in src/fmeval/model_runners
 92 7 2023-11-08 2024-06-20 8 3 68569612+xiaoyi-cheng@users... 68569612+xiaoyi-cheng@users...
data_sources.py
in src/fmeval/data_loaders
 76 13 2023-11-08 2024-07-18 4 3 68569612+xiaoyi-cheng@users... 86372475+oyangz@users.norep...
data_config.py
in src/fmeval/data_loaders
 24 1 2023-11-08 2024-07-12 5 3 68569612+xiaoyi-cheng@users... 86372475+oyangz@users.norep...
util.py
in src/fmeval/data_loaders
 119 8 2023-11-08 2024-04-05 5 4 68569612+xiaoyi-cheng@users... 86372475+oyangz@users.norep...
eval_algorithm.py
in src/fmeval/eval_algorithms
 26 3 2023-11-08 2024-06-14 6 4 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
eval_output_cells.py
in src/fmeval/reporting
 344 13 2023-11-08 2025-01-13 8 5 68569612+xiaoyi-cheng@users... satishgollaprolu@gmail.com
constants.py
in src/fmeval/reporting
 258 - 2023-11-08 2024-07-18 10 5 68569612+xiaoyi-cheng@users... daniel.e.zhu+github@gmail.com
classification_accuracy.py
in src/fmeval/eval_algorithms
 245 10 2023-11-08 2024-06-14 10 5 68569612+xiaoyi-cheng@users... athewsey@users.noreply.gith...
Correlations

File Size vs. Number of Changes: 66 points

pyproject.toml x: 65 lines of code y: 35 # changes src/fmeval/model_runners/extractors/jumpstart_extractor.py x: 167 lines of code y: 9 # changes src/fmeval/reporting/eval_output_cells.py x: 344 lines of code y: 8 # changes src/fmeval/transforms/summarization_accuracy_metrics.py x: 161 lines of code y: 7 # changes src/fmeval/eval_algorithms/qa_accuracy.py x: 220 lines of code y: 17 # changes src/fmeval/eval_algorithms/qa_accuracy_semantic_robustness.py x: 223 lines of code y: 14 # changes src/fmeval/transforms/common.py x: 95 lines of code y: 11 # changes src/fmeval/eval_algorithms/general_semantic_robustness.py x: 232 lines of code y: 14 # changes src/fmeval/eval_algorithms/summarization_accuracy_semantic_robustness.py x: 199 lines of code y: 14 # changes src/fmeval/eval_algorithms/factual_knowledge.py x: 151 lines of code y: 12 # changes src/fmeval/reporting/constants.py x: 258 lines of code y: 10 # changes src/fmeval/constants.py x: 68 lines of code y: 20 # changes src/fmeval/data_loaders/data_sources.py x: 76 lines of code y: 4 # changes src/fmeval/data_loaders/data_config.py x: 24 lines of code y: 5 # changes src/fmeval/data_loaders/json_parser.py x: 160 lines of code y: 5 # changes src/fmeval/model_runners/extractors/__init__.py x: 44 lines of code y: 3 # changes src/fmeval/model_runners/sm_jumpstart_model_runner.py x: 98 lines of code y: 7 # changes src/fmeval/eval_algorithms/util.py x: 199 lines of code y: 17 # changes src/fmeval/eval_algorithms/__init__.py x: 252 lines of code y: 13 # changes src/fmeval/model_runners/bedrock_model_runner.py x: 73 lines of code y: 3 # changes src/fmeval/model_runners/composers/__init__.py x: 32 lines of code y: 2 # changes src/fmeval/model_runners/composers/jumpstart_composer.py x: 32 lines of code y: 3 # changes src/fmeval/model_runners/extractors/extractor.py x: 11 lines of code y: 2 # changes src/fmeval/model_runners/extractors/json_extractor.py x: 62 lines of code y: 3 # changes src/fmeval/model_runners/model_runner.py x: 26 lines of code y: 2 # changes src/fmeval/model_runners/sm_model_runner.py x: 80 lines of code y: 4 # changes src/fmeval/model_runners/util.py x: 92 lines of code y: 8 # changes src/fmeval/eval_algorithms/helper_models/helper_model.py x: 96 lines of code y: 9 # changes src/fmeval/eval_algorithms/classification_accuracy.py x: 245 lines of code y: 10 # changes src/fmeval/eval_algorithms/classification_accuracy_semantic_robustness.py x: 170 lines of code y: 12 # changes src/fmeval/eval_algorithms/eval_algorithm.py x: 26 lines of code y: 6 # changes src/fmeval/eval_algorithms/prompt_stereotyping.py x: 160 lines of code y: 10 # changes src/fmeval/eval_algorithms/summarization_accuracy.py x: 157 lines of code y: 16 # changes src/fmeval/eval_algorithms/toxicity.py x: 125 lines of code y: 9 # changes src/fmeval/eval_algorithms/common.py x: 86 lines of code y: 1 # changes src/fmeval/eval_algorithms/save_strategy.py x: 77 lines of code y: 1 # changes src/fmeval/model_runners/composers/composers.py x: 35 lines of code y: 3 # changes src/fmeval/util.py x: 57 lines of code y: 6 # changes src/fmeval/__init__.py x: 1 lines of code y: 1 # changes src/fmeval/transforms/util.py x: 51 lines of code y: 4 # changes src/fmeval/data_loaders/util.py x: 119 lines of code y: 5 # changes src/fmeval/transforms/batched_transform.py x: 12 lines of code y: 1 # changes src/fmeval/transforms/transform_pipeline.py x: 61 lines of code y: 5 # changes src/fmeval/eval_algorithms/semantic_robustness_utils.py x: 86 lines of code y: 3 # changes src/fmeval/transforms/semantic_robustness_metrics.py x: 65 lines of code y: 2 # changes src/fmeval/eval_algorithms/qa_toxicity.py x: 15 lines of code y: 2 # changes src/fmeval/transforms/semantic_perturbations.py x: 155 lines of code y: 2 # changes src/fmeval/transforms/transform.py x: 34 lines of code y: 3 # changes src/fmeval/data_loaders/json_data_loader.py x: 50 lines of code y: 3 # changes src/fmeval/eval.py x: 25 lines of code y: 1 # changes src/fmeval/eval_algo_mapping.py x: 33 lines of code y: 1 # changes src/fmeval/eval_algorithms/semantic_perturbation_utils.py x: 115 lines of code y: 1 # changes src/fmeval/exceptions.py x: 3 lines of code y: 1 # changes src/fmeval/model_runners/composers/template.py x: 19 lines of code y: 1 # changes src/fmeval/reporting/cells.py x: 177 lines of code y: 1 # changes src/fmeval/reporting/util.py x: 51 lines of code y: 1 # changes setup.cfg x: 39 lines of code y: 1 # changes
35.0
# changes
  min: 1.0
  average: 5.85
  25th percentile: 1.0
  median: 3.0
  75th percentile: 9.0
  max: 35.0
0 344.0
lines of code
min: 1.0 | average: 88.7 | 25th percentile: 25.75 | median: 65.0 | 75th percentile: 155.5 | max: 344.0

Number of Contributors vs. Number of Changes: 66 points

pyproject.toml x: 8 # contributors y: 35 # changes src/fmeval/model_runners/extractors/jumpstart_extractor.py x: 5 # contributors y: 9 # changes src/fmeval/reporting/eval_output_cells.py x: 5 # contributors y: 8 # changes src/fmeval/transforms/summarization_accuracy_metrics.py x: 2 # contributors y: 7 # changes src/fmeval/eval_algorithms/qa_accuracy.py x: 8 # contributors y: 17 # changes src/fmeval/eval_algorithms/qa_accuracy_semantic_robustness.py x: 8 # contributors y: 14 # changes src/fmeval/transforms/common.py x: 3 # contributors y: 11 # changes src/fmeval/eval_algorithms/general_semantic_robustness.py x: 7 # contributors y: 14 # changes src/fmeval/eval_algorithms/factual_knowledge.py x: 6 # contributors y: 12 # changes src/fmeval/reporting/constants.py x: 5 # contributors y: 10 # changes src/fmeval/constants.py x: 6 # contributors y: 20 # changes src/fmeval/data_loaders/data_sources.py x: 3 # contributors y: 4 # changes src/fmeval/data_loaders/data_config.py x: 3 # contributors y: 5 # changes src/fmeval/model_runners/extractors/__init__.py x: 2 # contributors y: 3 # changes src/fmeval/model_runners/sm_jumpstart_model_runner.py x: 5 # contributors y: 7 # changes src/fmeval/eval_algorithms/__init__.py x: 8 # contributors y: 13 # changes src/fmeval/model_runners/composers/__init__.py x: 1 # contributors y: 2 # changes src/fmeval/model_runners/sm_model_runner.py x: 2 # contributors y: 4 # changes src/fmeval/model_runners/util.py x: 3 # contributors y: 8 # changes src/fmeval/eval_algorithms/eval_algorithm.py x: 4 # contributors y: 6 # changes src/fmeval/eval_algorithms/prompt_stereotyping.py x: 6 # contributors y: 10 # changes src/fmeval/eval_algorithms/summarization_accuracy.py x: 6 # contributors y: 16 # changes src/fmeval/eval_algorithms/common.py x: 1 # contributors y: 1 # changes src/fmeval/util.py x: 2 # contributors y: 6 # changes src/fmeval/transforms/util.py x: 1 # contributors y: 4 # changes src/fmeval/data_loaders/util.py x: 4 # contributors y: 5 # changes src/fmeval/transforms/transform_pipeline.py x: 1 # contributors y: 5 # changes src/fmeval/eval_algorithms/semantic_robustness_utils.py x: 1 # contributors y: 3 # changes src/fmeval/eval_algorithms/qa_toxicity.py x: 2 # contributors y: 2 # changes
35.0
# changes
  min: 1.0
  average: 5.85
  25th percentile: 1.0
  median: 3.0
  75th percentile: 9.0
  max: 35.0
0 8.0
# contributors
min: 1.0 | average: 2.95 | 25th percentile: 1.0 | median: 2.0 | 75th percentile: 5.0 | max: 8.0

Number of Contributors vs. File Size: 66 points

pyproject.toml x: 8 # contributors y: 65 lines of code src/fmeval/model_runners/extractors/jumpstart_extractor.py x: 5 # contributors y: 167 lines of code src/fmeval/reporting/eval_output_cells.py x: 5 # contributors y: 344 lines of code src/fmeval/transforms/summarization_accuracy_metrics.py x: 2 # contributors y: 161 lines of code src/fmeval/eval_algorithms/qa_accuracy.py x: 8 # contributors y: 220 lines of code src/fmeval/eval_algorithms/qa_accuracy_semantic_robustness.py x: 8 # contributors y: 223 lines of code src/fmeval/transforms/common.py x: 3 # contributors y: 95 lines of code src/fmeval/eval_algorithms/general_semantic_robustness.py x: 7 # contributors y: 232 lines of code src/fmeval/eval_algorithms/summarization_accuracy_semantic_robustness.py x: 8 # contributors y: 199 lines of code src/fmeval/eval_algorithms/factual_knowledge.py x: 6 # contributors y: 151 lines of code src/fmeval/reporting/constants.py x: 5 # contributors y: 258 lines of code src/fmeval/constants.py x: 6 # contributors y: 68 lines of code src/fmeval/data_loaders/data_sources.py x: 3 # contributors y: 76 lines of code src/fmeval/data_loaders/data_config.py x: 3 # contributors y: 24 lines of code src/fmeval/data_loaders/json_parser.py x: 3 # contributors y: 160 lines of code src/fmeval/model_runners/extractors/__init__.py x: 2 # contributors y: 44 lines of code src/fmeval/model_runners/sm_jumpstart_model_runner.py x: 5 # contributors y: 98 lines of code src/fmeval/eval_algorithms/__init__.py x: 8 # contributors y: 252 lines of code src/fmeval/model_runners/bedrock_model_runner.py x: 2 # contributors y: 73 lines of code src/fmeval/model_runners/composers/__init__.py x: 1 # contributors y: 32 lines of code src/fmeval/model_runners/composers/jumpstart_composer.py x: 2 # contributors y: 32 lines of code src/fmeval/model_runners/extractors/extractor.py x: 1 # contributors y: 11 lines of code src/fmeval/model_runners/extractors/json_extractor.py x: 2 # contributors y: 62 lines of code src/fmeval/model_runners/model_runner.py x: 1 # contributors y: 26 lines of code src/fmeval/model_runners/sm_model_runner.py x: 2 # contributors y: 80 lines of code src/fmeval/model_runners/util.py x: 3 # contributors y: 92 lines of code src/fmeval/eval_algorithms/helper_models/helper_model.py x: 5 # contributors y: 96 lines of code src/fmeval/eval_algorithms/classification_accuracy.py x: 5 # contributors y: 245 lines of code src/fmeval/eval_algorithms/classification_accuracy_semantic_robustness.py x: 6 # contributors y: 170 lines of code src/fmeval/eval_algorithms/eval_algorithm.py x: 4 # contributors y: 26 lines of code src/fmeval/eval_algorithms/prompt_stereotyping.py x: 6 # contributors y: 160 lines of code src/fmeval/eval_algorithms/summarization_accuracy.py x: 6 # contributors y: 157 lines of code src/fmeval/eval_algorithms/toxicity.py x: 5 # contributors y: 125 lines of code src/fmeval/eval_algorithms/common.py x: 1 # contributors y: 86 lines of code src/fmeval/eval_algorithms/save_strategy.py x: 1 # contributors y: 77 lines of code src/fmeval/model_runners/composers/composers.py x: 2 # contributors y: 35 lines of code src/fmeval/util.py x: 2 # contributors y: 57 lines of code src/fmeval/__init__.py x: 1 # contributors y: 1 lines of code src/fmeval/transforms/util.py x: 1 # contributors y: 51 lines of code src/fmeval/data_loaders/util.py x: 4 # contributors y: 119 lines of code src/fmeval/transforms/transform_pipeline.py x: 1 # contributors y: 61 lines of code src/fmeval/transforms/semantic_robustness_metrics.py x: 1 # contributors y: 65 lines of code src/fmeval/eval_algorithms/qa_toxicity.py x: 2 # contributors y: 15 lines of code src/fmeval/transforms/semantic_perturbations.py x: 1 # contributors y: 155 lines of code src/fmeval/transforms/transform.py x: 1 # contributors y: 34 lines of code src/fmeval/data_loaders/json_data_loader.py x: 2 # contributors y: 50 lines of code src/fmeval/eval.py x: 1 # contributors y: 25 lines of code src/fmeval/eval_algo_mapping.py x: 1 # contributors y: 33 lines of code src/fmeval/eval_algorithms/semantic_perturbation_utils.py x: 1 # contributors y: 115 lines of code src/fmeval/exceptions.py x: 1 # contributors y: 3 lines of code src/fmeval/model_runners/composers/template.py x: 1 # contributors y: 19 lines of code src/fmeval/reporting/cells.py x: 1 # contributors y: 177 lines of code setup.cfg x: 1 # contributors y: 39 lines of code
344.0
lines of code
  min: 1.0
  average: 88.7
  25th percentile: 25.75
  median: 65.0
  75th percentile: 155.5
  max: 344.0
0 8.0
# contributors
min: 1.0 | average: 2.95 | 25th percentile: 1.0 | median: 2.0 | 75th percentile: 5.0 | max: 8.0