aws / fmeval
File Size

The distribution of size of files (measured in lines of code).

Intro
Learn more...
File Size Overall
0% | 0% | 30% | 37% | 31%
Legend:
1001+
501-1000
201-500
101-200
1-100


explore: grouped by folders | grouped by size | sunburst | 3D view
File Size per Extension
1001+
501-1000
201-500
101-200
1-100
py0% | 0% | 30% | 38% | 30%
toml0% | 0% | 0% | 0% | 100%
cfg0% | 0% | 0% | 0% | 100%
File Size per Logical Decomposition
primary
1001+
501-1000
201-500
101-200
1-100
src0% | 0% | 30% | 38% | 30%
ROOT0% | 0% | 0% | 0% | 100%
Longest Files (Top 50)
File# lines# units
eval_output_cells.py
in src/fmeval/reporting
 344 13
constants.py
in src/fmeval/reporting
 258 -
__init__.py
in src/fmeval/eval_algorithms
 252 7
classification_accuracy.py
in src/fmeval/eval_algorithms
 245 10
general_semantic_robustness.py
in src/fmeval/eval_algorithms
 232 7
qa_accuracy_semantic_robustness.py
in src/fmeval/eval_algorithms
 223 5
qa_accuracy.py
in src/fmeval/eval_algorithms
 220 14
util.py
in src/fmeval/eval_algorithms
 199 20
199 5
cells.py
in src/fmeval/reporting
 177 15
170 5
jumpstart_extractor.py
in src/fmeval/model_runners/extractors
 167 6
summarization_accuracy_metrics.py
in src/fmeval/transforms
 161 10
prompt_stereotyping.py
in src/fmeval/eval_algorithms
 160 6
json_parser.py
in src/fmeval/data_loaders
 160 6
summarization_accuracy.py
in src/fmeval/eval_algorithms
 157 5
semantic_perturbations.py
in src/fmeval/transforms
 155 9
factual_knowledge.py
in src/fmeval/eval_algorithms
 151 9
toxicity.py
in src/fmeval/eval_algorithms
 125 7
util.py
in src/fmeval/data_loaders
 119 8
semantic_perturbation_utils.py
in src/fmeval/eval_algorithms
 115 8
sm_jumpstart_model_runner.py
in src/fmeval/model_runners
 98 3
helper_model.py
in src/fmeval/eval_algorithms/helper_models
 96 14
common.py
in src/fmeval/transforms
 95 10
util.py
in src/fmeval/model_runners
 92 7
semantic_robustness_utils.py
in src/fmeval/eval_algorithms
 86 3
common.py
in src/fmeval/eval_algorithms
 86 2
sm_model_runner.py
in src/fmeval/model_runners
 80 3
save_strategy.py
in src/fmeval/eval_algorithms
 77 13
data_sources.py
in src/fmeval/data_loaders
 76 13
bedrock_model_runner.py
in src/fmeval/model_runners
 73 3
constants.py
in src/fmeval
 68 -
semantic_robustness_metrics.py
in src/fmeval/transforms
 65 6
65 -
json_extractor.py
in src/fmeval/model_runners/extractors
 62 4
transform_pipeline.py
in src/fmeval/transforms
 61 3
util.py
in src/fmeval
 57 10
util.py
in src/fmeval/reporting
 51 4
util.py
in src/fmeval/transforms
 51 4
json_data_loader.py
in src/fmeval/data_loaders
 50 3
__init__.py
in src/fmeval/model_runners/extractors
 44 1
cfg
setup.cfg
in root
 39 -
composers.py
in src/fmeval/model_runners/composers
 35 7
transform.py
in src/fmeval/transforms
 34 4
33 -
jmespath_util.py
in src/fmeval/data_loaders
 32 2
__init__.py
in src/fmeval/model_runners/composers
 32 1
jumpstart_composer.py
in src/fmeval/model_runners/composers
 32 2
eval_algorithm.py
in src/fmeval/eval_algorithms
 26 3
model_runner.py
in src/fmeval/model_runners
 26 2
Files With Most Units (Top 50)
File# lines# units
util.py
in src/fmeval/eval_algorithms
 199 20
cells.py
in src/fmeval/reporting
 177 15
qa_accuracy.py
in src/fmeval/eval_algorithms
 220 14
helper_model.py
in src/fmeval/eval_algorithms/helper_models
 96 14
save_strategy.py
in src/fmeval/eval_algorithms
 77 13
eval_output_cells.py
in src/fmeval/reporting
 344 13
data_sources.py
in src/fmeval/data_loaders
 76 13
util.py
in src/fmeval
 57 10
classification_accuracy.py
in src/fmeval/eval_algorithms
 245 10
summarization_accuracy_metrics.py
in src/fmeval/transforms
 161 10
common.py
in src/fmeval/transforms
 95 10
factual_knowledge.py
in src/fmeval/eval_algorithms
 151 9
semantic_perturbations.py
in src/fmeval/transforms
 155 9
semantic_perturbation_utils.py
in src/fmeval/eval_algorithms
 115 8
util.py
in src/fmeval/data_loaders
 119 8
general_semantic_robustness.py
in src/fmeval/eval_algorithms
 232 7
__init__.py
in src/fmeval/eval_algorithms
 252 7
toxicity.py
in src/fmeval/eval_algorithms
 125 7
util.py
in src/fmeval/model_runners
 92 7
composers.py
in src/fmeval/model_runners/composers
 35 7
prompt_stereotyping.py
in src/fmeval/eval_algorithms
 160 6
json_parser.py
in src/fmeval/data_loaders
 160 6
semantic_robustness_metrics.py
in src/fmeval/transforms
 65 6
jumpstart_extractor.py
in src/fmeval/model_runners/extractors
 167 6
199 5
170 5
summarization_accuracy.py
in src/fmeval/eval_algorithms
 157 5
qa_accuracy_semantic_robustness.py
in src/fmeval/eval_algorithms
 223 5
util.py
in src/fmeval/reporting
 51 4
util.py
in src/fmeval/transforms
 51 4
transform.py
in src/fmeval/transforms
 34 4
json_extractor.py
in src/fmeval/model_runners/extractors
 62 4
semantic_robustness_utils.py
in src/fmeval/eval_algorithms
 86 3
eval_algorithm.py
in src/fmeval/eval_algorithms
 26 3
json_data_loader.py
in src/fmeval/data_loaders
 50 3
batched_transform.py
in src/fmeval/transforms
 12 3
transform_pipeline.py
in src/fmeval/transforms
 61 3
bedrock_model_runner.py
in src/fmeval/model_runners
 73 3
sm_jumpstart_model_runner.py
in src/fmeval/model_runners
 98 3
sm_model_runner.py
in src/fmeval/model_runners
 80 3
extractor.py
in src/fmeval/model_runners/extractors
 11 3
common.py
in src/fmeval/eval_algorithms
 86 2
jmespath_util.py
in src/fmeval/data_loaders
 32 2
template.py
in src/fmeval/model_runners/composers
 19 2
jumpstart_composer.py
in src/fmeval/model_runners/composers
 32 2
model_runner.py
in src/fmeval/model_runners
 26 2
perf_util.py
in src/fmeval
 12 1
qa_toxicity.py
in src/fmeval/eval_algorithms
 15 1
summarization_toxicity.py
in src/fmeval/eval_algorithms
 15 1
data_config.py
in src/fmeval/data_loaders
 24 1
Files With Long Lines (Top 8)

There are 8 files with lines longer than 120 characters. In total, there are 56 long lines.

File# lines# units# long lines
constants.py
in src/fmeval/reporting
 258 - 48
199 5 2
general_semantic_robustness.py
in src/fmeval/eval_algorithms
 232 7 1
170 5 1
prompt_stereotyping.py
in src/fmeval/eval_algorithms
 160 6 1
eval_output_cells.py
in src/fmeval/reporting
 344 13 1
semantic_perturbations.py
in src/fmeval/transforms
 155 9 1
jumpstart_extractor.py
in src/fmeval/model_runners/extractors
 167 6 1
Correlations

File Size vs. Commits (all time): 66 points

pyproject.toml x: 43 commits (all time) y: 65 lines of code src/fmeval/model_runners/extractors/jumpstart_extractor.py x: 9 commits (all time) y: 167 lines of code src/fmeval/reporting/eval_output_cells.py x: 8 commits (all time) y: 344 lines of code src/fmeval/transforms/summarization_accuracy_metrics.py x: 9 commits (all time) y: 161 lines of code src/fmeval/eval_algorithms/qa_accuracy.py x: 20 commits (all time) y: 220 lines of code src/fmeval/eval_algorithms/qa_accuracy_semantic_robustness.py x: 18 commits (all time) y: 223 lines of code src/fmeval/transforms/common.py x: 13 commits (all time) y: 95 lines of code src/fmeval/eval_algorithms/general_semantic_robustness.py x: 19 commits (all time) y: 232 lines of code src/fmeval/eval_algorithms/summarization_accuracy_semantic_robustness.py x: 18 commits (all time) y: 199 lines of code src/fmeval/eval_algorithms/factual_knowledge.py x: 13 commits (all time) y: 151 lines of code src/fmeval/reporting/constants.py x: 10 commits (all time) y: 258 lines of code src/fmeval/constants.py x: 20 commits (all time) y: 68 lines of code src/fmeval/data_loaders/data_sources.py x: 4 commits (all time) y: 76 lines of code src/fmeval/data_loaders/data_config.py x: 5 commits (all time) y: 24 lines of code src/fmeval/data_loaders/json_parser.py x: 5 commits (all time) y: 160 lines of code src/fmeval/model_runners/extractors/__init__.py x: 3 commits (all time) y: 44 lines of code src/fmeval/model_runners/sm_jumpstart_model_runner.py x: 8 commits (all time) y: 98 lines of code src/fmeval/eval_algorithms/__init__.py x: 14 commits (all time) y: 252 lines of code src/fmeval/model_runners/bedrock_model_runner.py x: 3 commits (all time) y: 73 lines of code src/fmeval/model_runners/composers/__init__.py x: 2 commits (all time) y: 32 lines of code src/fmeval/model_runners/composers/jumpstart_composer.py x: 3 commits (all time) y: 32 lines of code src/fmeval/model_runners/extractors/extractor.py x: 2 commits (all time) y: 11 lines of code src/fmeval/model_runners/extractors/json_extractor.py x: 3 commits (all time) y: 62 lines of code src/fmeval/model_runners/model_runner.py x: 2 commits (all time) y: 26 lines of code src/fmeval/model_runners/sm_model_runner.py x: 4 commits (all time) y: 80 lines of code src/fmeval/model_runners/util.py x: 8 commits (all time) y: 92 lines of code src/fmeval/eval_algorithms/helper_models/helper_model.py x: 10 commits (all time) y: 96 lines of code src/fmeval/eval_algorithms/classification_accuracy.py x: 11 commits (all time) y: 245 lines of code src/fmeval/eval_algorithms/classification_accuracy_semantic_robustness.py x: 15 commits (all time) y: 170 lines of code src/fmeval/eval_algorithms/eval_algorithm.py x: 6 commits (all time) y: 26 lines of code src/fmeval/eval_algorithms/prompt_stereotyping.py x: 11 commits (all time) y: 160 lines of code src/fmeval/eval_algorithms/summarization_accuracy.py x: 19 commits (all time) y: 157 lines of code src/fmeval/eval_algorithms/toxicity.py x: 10 commits (all time) y: 125 lines of code src/fmeval/eval_algorithms/common.py x: 1 commits (all time) y: 86 lines of code src/fmeval/eval_algorithms/save_strategy.py x: 1 commits (all time) y: 77 lines of code src/fmeval/model_runners/composers/composers.py x: 3 commits (all time) y: 35 lines of code src/fmeval/util.py x: 6 commits (all time) y: 57 lines of code src/fmeval/__init__.py x: 1 commits (all time) y: 1 lines of code src/fmeval/transforms/util.py x: 4 commits (all time) y: 51 lines of code src/fmeval/data_loaders/util.py x: 5 commits (all time) y: 119 lines of code src/fmeval/transforms/batched_transform.py x: 1 commits (all time) y: 12 lines of code src/fmeval/transforms/transform_pipeline.py x: 5 commits (all time) y: 61 lines of code src/fmeval/eval_algorithms/semantic_robustness_utils.py x: 3 commits (all time) y: 86 lines of code src/fmeval/transforms/semantic_robustness_metrics.py x: 2 commits (all time) y: 65 lines of code src/fmeval/eval_algorithms/qa_toxicity.py x: 2 commits (all time) y: 15 lines of code src/fmeval/transforms/semantic_perturbations.py x: 3 commits (all time) y: 155 lines of code src/fmeval/transforms/transform.py x: 4 commits (all time) y: 34 lines of code src/fmeval/data_loaders/json_data_loader.py x: 3 commits (all time) y: 50 lines of code src/fmeval/eval.py x: 1 commits (all time) y: 25 lines of code src/fmeval/eval_algo_mapping.py x: 1 commits (all time) y: 33 lines of code src/fmeval/eval_algorithms/semantic_perturbation_utils.py x: 1 commits (all time) y: 115 lines of code src/fmeval/exceptions.py x: 1 commits (all time) y: 3 lines of code src/fmeval/model_runners/composers/template.py x: 1 commits (all time) y: 19 lines of code src/fmeval/reporting/cells.py x: 1 commits (all time) y: 177 lines of code src/fmeval/reporting/util.py x: 1 commits (all time) y: 51 lines of code setup.cfg x: 1 commits (all time) y: 39 lines of code
344.0
lines of code
  min: 1.0
  average: 88.7
  25th percentile: 25.75
  median: 65.0
  75th percentile: 155.5
  max: 344.0
0 43.0
commits (all time)
min: 1.0 | average: 6.52 | 25th percentile: 1.0 | median: 3.0 | 75th percentile: 10.0 | max: 43.0

File Size vs. Contributors (all time): 66 points

pyproject.toml x: 8 contributors (all time) y: 65 lines of code src/fmeval/model_runners/extractors/jumpstart_extractor.py x: 5 contributors (all time) y: 167 lines of code src/fmeval/reporting/eval_output_cells.py x: 5 contributors (all time) y: 344 lines of code src/fmeval/transforms/summarization_accuracy_metrics.py x: 2 contributors (all time) y: 161 lines of code src/fmeval/eval_algorithms/qa_accuracy.py x: 8 contributors (all time) y: 220 lines of code src/fmeval/eval_algorithms/qa_accuracy_semantic_robustness.py x: 8 contributors (all time) y: 223 lines of code src/fmeval/transforms/common.py x: 3 contributors (all time) y: 95 lines of code src/fmeval/eval_algorithms/general_semantic_robustness.py x: 7 contributors (all time) y: 232 lines of code src/fmeval/eval_algorithms/summarization_accuracy_semantic_robustness.py x: 8 contributors (all time) y: 199 lines of code src/fmeval/eval_algorithms/factual_knowledge.py x: 6 contributors (all time) y: 151 lines of code src/fmeval/reporting/constants.py x: 5 contributors (all time) y: 258 lines of code src/fmeval/constants.py x: 6 contributors (all time) y: 68 lines of code src/fmeval/data_loaders/data_sources.py x: 3 contributors (all time) y: 76 lines of code src/fmeval/data_loaders/data_config.py x: 3 contributors (all time) y: 24 lines of code src/fmeval/data_loaders/json_parser.py x: 3 contributors (all time) y: 160 lines of code src/fmeval/model_runners/extractors/__init__.py x: 2 contributors (all time) y: 44 lines of code src/fmeval/model_runners/sm_jumpstart_model_runner.py x: 5 contributors (all time) y: 98 lines of code src/fmeval/eval_algorithms/__init__.py x: 8 contributors (all time) y: 252 lines of code src/fmeval/model_runners/bedrock_model_runner.py x: 2 contributors (all time) y: 73 lines of code src/fmeval/model_runners/composers/__init__.py x: 1 contributors (all time) y: 32 lines of code src/fmeval/model_runners/composers/jumpstart_composer.py x: 2 contributors (all time) y: 32 lines of code src/fmeval/model_runners/extractors/extractor.py x: 1 contributors (all time) y: 11 lines of code src/fmeval/model_runners/extractors/json_extractor.py x: 2 contributors (all time) y: 62 lines of code src/fmeval/model_runners/model_runner.py x: 1 contributors (all time) y: 26 lines of code src/fmeval/model_runners/sm_model_runner.py x: 2 contributors (all time) y: 80 lines of code src/fmeval/model_runners/util.py x: 3 contributors (all time) y: 92 lines of code src/fmeval/eval_algorithms/helper_models/helper_model.py x: 5 contributors (all time) y: 96 lines of code src/fmeval/eval_algorithms/classification_accuracy.py x: 5 contributors (all time) y: 245 lines of code src/fmeval/eval_algorithms/classification_accuracy_semantic_robustness.py x: 6 contributors (all time) y: 170 lines of code src/fmeval/eval_algorithms/eval_algorithm.py x: 4 contributors (all time) y: 26 lines of code src/fmeval/eval_algorithms/prompt_stereotyping.py x: 6 contributors (all time) y: 160 lines of code src/fmeval/eval_algorithms/summarization_accuracy.py x: 6 contributors (all time) y: 157 lines of code src/fmeval/eval_algorithms/toxicity.py x: 5 contributors (all time) y: 125 lines of code src/fmeval/eval_algorithms/common.py x: 1 contributors (all time) y: 86 lines of code src/fmeval/eval_algorithms/save_strategy.py x: 1 contributors (all time) y: 77 lines of code src/fmeval/model_runners/composers/composers.py x: 2 contributors (all time) y: 35 lines of code src/fmeval/util.py x: 2 contributors (all time) y: 57 lines of code src/fmeval/__init__.py x: 1 contributors (all time) y: 1 lines of code src/fmeval/transforms/util.py x: 1 contributors (all time) y: 51 lines of code src/fmeval/data_loaders/util.py x: 4 contributors (all time) y: 119 lines of code src/fmeval/transforms/transform_pipeline.py x: 1 contributors (all time) y: 61 lines of code src/fmeval/transforms/semantic_robustness_metrics.py x: 1 contributors (all time) y: 65 lines of code src/fmeval/eval_algorithms/qa_toxicity.py x: 2 contributors (all time) y: 15 lines of code src/fmeval/transforms/semantic_perturbations.py x: 1 contributors (all time) y: 155 lines of code src/fmeval/transforms/transform.py x: 1 contributors (all time) y: 34 lines of code src/fmeval/data_loaders/json_data_loader.py x: 2 contributors (all time) y: 50 lines of code src/fmeval/eval.py x: 1 contributors (all time) y: 25 lines of code src/fmeval/eval_algo_mapping.py x: 1 contributors (all time) y: 33 lines of code src/fmeval/eval_algorithms/semantic_perturbation_utils.py x: 1 contributors (all time) y: 115 lines of code src/fmeval/exceptions.py x: 1 contributors (all time) y: 3 lines of code src/fmeval/model_runners/composers/template.py x: 1 contributors (all time) y: 19 lines of code src/fmeval/reporting/cells.py x: 1 contributors (all time) y: 177 lines of code setup.cfg x: 1 contributors (all time) y: 39 lines of code
344.0
lines of code
  min: 1.0
  average: 88.7
  25th percentile: 25.75
  median: 65.0
  75th percentile: 155.5
  max: 344.0
0 8.0
contributors (all time)
min: 1.0 | average: 2.95 | 25th percentile: 1.0 | median: 2.0 | 75th percentile: 5.0 | max: 8.0

File Size vs. Commits (30 days): 1 points

pyproject.toml x: 1 commits (30d) y: 65 lines of code
65.0
lines of code
  min: 65.0
  average: 65.0
  25th percentile: 65.0
  median: 65.0
  75th percentile: 65.0
  max: 65.0
0 1.0
commits (30d)
min: 1.0 | average: 1.0 | 25th percentile: 1.0 | median: 1.0 | 75th percentile: 1.0 | max: 1.0

File Size vs. Contributors (30 days): 1 points

pyproject.toml x: 1 contributors (30d) y: 65 lines of code
65.0
lines of code
  min: 65.0
  average: 65.0
  25th percentile: 65.0
  median: 65.0
  75th percentile: 65.0
  max: 65.0
0 1.0
contributors (30d)
min: 1.0 | average: 1.0 | 25th percentile: 1.0 | median: 1.0 | 75th percentile: 1.0 | max: 1.0

File Size vs. Commits (90 days): 2 points

pyproject.toml x: 1 commits (90d) y: 65 lines of code src/fmeval/model_runners/extractors/jumpstart_extractor.py x: 1 commits (90d) y: 167 lines of code
167.0
lines of code
  min: 65.0
  average: 116.0
  25th percentile: 65.0
  median: 116.0
  75th percentile: 167.0
  max: 167.0
0 1.0
commits (90d)
min: 1.0 | average: 1.0 | 25th percentile: 1.0 | median: 1.0 | 75th percentile: 1.0 | max: 1.0

File Size vs. Contributors (90 days): 2 points

pyproject.toml x: 1 contributors (90d) y: 65 lines of code src/fmeval/model_runners/extractors/jumpstart_extractor.py x: 1 contributors (90d) y: 167 lines of code
167.0
lines of code
  min: 65.0
  average: 116.0
  25th percentile: 65.0
  median: 116.0
  75th percentile: 167.0
  max: 167.0
0 1.0
contributors (90d)
min: 1.0 | average: 1.0 | 25th percentile: 1.0 | median: 1.0 | 75th percentile: 1.0 | max: 1.0