huggingface / alpaca_eval Conditional Complexity

Intro

Conditional complexity (also called cyclomatic complexity) is a term used to measure the complexity of software. The term refers to the number of possible paths through a program function. A higher value ofter means higher maintenance and testing costs (infosecinstitute.com).
Conditional complexity is calculated by counting all conditions in the program that can affect the execution path (e.g. if statement, loops, switches, and/or operators, try and catch blocks...).
Conditional complexity is measured at the unit level (methods, functions...).
Units are classified in four categories based on the measured McCabe index: 1-5 (simple units), 6-10 (medium complex units), 11-25 (complex units), 26+ (very complex units).

Learn more...

Conditional Complexity Overall

There are 210 units with 1,748 lines of code in units (28.3% of code).

0 very complex units (0 lines of code)
0 complex units (0 lines of code)
5 medium complex units (190 lines of code)
23 simple units (424 lines of code)
182 very simple units (1,134 lines of code)

Legend:

51+

26-50

11-25

6-10

1-5

Alternative Visuals

3D view of all units

Conditional Complexity per Extension

51+

26-50

11-25

6-10

1-5

Conditional Complexity per Logical Component

primary logical decomposition

51+

26-50

11-25

6-10

1-5

Most Complex Units

Top 50 most complex units

Unit	# lines	McCabe index	# params
def get_fn_completions() in src/alpaca_eval/decoders/__init__.py	80	21	2
def __call__() in src/alpaca_eval/annotators/base.py	34	19	3
def single_logprob_parser() in src/alpaca_eval/completion_parsers.py	22	17	2
def load_or_convert_to_dataframe() in src/alpaca_eval/utils.py	29	13	6
def _annotate() in src/alpaca_eval/annotators/base.py	25	12	3
def get_completions() in src/alpaca_eval/main.py	31	10	3
def json_parser() in src/alpaca_eval/completion_parsers.py	10	9	2
def plot_paired_ttests_pvalues() in src/alpaca_eval/plotting.py	26	8	1
def inference_helper() in src/alpaca_eval/decoders/huggingface_api.py	22	8	5
def add_referenced_model_() in src/alpaca_eval/processors.py	21	8	2
def plot_paired_ttests_per_dataset() in src/alpaca_eval/plotting.py	33	7	3
def random_derangement() in src/alpaca_eval/utils.py	12	7	3
def get_output_path() in src/alpaca_eval/utils.py	19	7	4
def _preprocess() in src/alpaca_eval/annotators/pairwise_evaluator.py	23	7	2
def _random_mode() in src/alpaca_eval/metrics.py	13	7	5
def regex_parser() in src/alpaca_eval/completion_parsers.py	16	7	3
def save_fig() in src/alpaca_eval/plotting.py	13	6	4
def contains_list() in src/alpaca_eval/utils.py	15	6	1
def get_precomputed_leaderboard() in src/alpaca_eval/utils.py	25	6	3
def print_leaderboard() in src/alpaca_eval/utils.py	17	6	4
def dataframe_chunk_generator() in src/alpaca_eval/utils.py	12	6	3
def _add_missing_primary_keys_() in src/alpaca_eval/annotators/base.py	8	6	2
def _preprocess() in src/alpaca_eval/annotators/base.py	18	6	2
def main() in src/alpaca_eval/main.py	7	6	0
def _get_chat_completion() in src/alpaca_eval/decoders/jinachat.py	22	6	2
def get_list_biases() in src/alpaca_eval/analyze.py	24	6	3
def lmsys_parser() in src/alpaca_eval/completion_parsers.py	22	6	1
def ranking_parser() in src/alpaca_eval/completion_parsers.py	15	6	2
def _find_first_match() in src/alpaca_eval/utils.py	9	5	3
def load_configs() in src/alpaca_eval/utils.py	14	5	3
def load_() in src/alpaca_eval/annotators/base.py	7	5	2
def _initialize_cache() in src/alpaca_eval/annotators/base.py	14	5	2
def _fn_replace_if_switch() in src/alpaca_eval/annotators/pairwise_evaluator.py	6	5	1
def _prompt_to_chatml() in src/alpaca_eval/decoders/openai.py	17	5	3
def _get_price_per_token() in src/alpaca_eval/decoders/openai.py	18	5	2
def _bayes_estimator() in src/alpaca_eval/metrics.py	4	5	2
def _pairwise_ttest() in src/alpaca_eval/plotting.py	10	4	1
def convert_to_dataframe() in src/alpaca_eval/utils.py	9	4	1
def _apply_cached_annotations() in src/alpaca_eval/annotators/base.py	10	4	2
def save() in src/alpaca_eval/annotators/base.py	8	4	2
def _parse_completions() in src/alpaca_eval/annotators/base.py	19	4	2
def _openai_completion_helper() in src/alpaca_eval/decoders/openai.py	13	4	10
def _select_n_annotations() in src/alpaca_eval/analyze.py	12	4	4
def _get_annotations() in src/alpaca_eval/analyze.py	9	4	3
def ALPACAFARM_GOLD_CROSSANNOTATIONS() in src/alpaca_eval/constants.py	11	4	0
def ALPACAFARM_GOLD_ANNOTATIONS() in src/alpaca_eval/constants.py	11	4	0
def ALPACAFARM_ALL_OUTPUTS() in src/alpaca_eval/constants.py	11	4	0
def plot_paired_ttest_nsamples() in src/alpaca_eval/plotting.py	34	3	1
def _get_ttest_df() in src/alpaca_eval/plotting.py	12	3	4
def read_or_return() in src/alpaca_eval/utils.py	10	3	3