openai / gpt-2 - Conditional Complexity

Intro

Conditional complexity (also called cyclomatic complexity) is a term used to measure the complexity of software. The term refers to the number of possible paths through a program function. A higher value ofter means higher maintenance and testing costs (infosecinstitute.com).
Conditional complexity is calculated by counting all conditions in the program that can affect the execution path (e.g. if statement, loops, switches, and/or operators, try and catch blocks...).
Conditional complexity is measured at the unit level (methods, functions...).
Units are classified in four categories based on the measured McCabe index: 1-5 (simple units), 6-10 (medium complex units), 11-25 (complex units), 26+ (very complex units).

Conditional Complexity Overall

Legend:

51+

26-50

11-25

6-10

1-5

Alternative Visuals

Conditional Complexity per Extension

51+

26-50

11-25

6-10

1-5

Conditional Complexity per Logical Component

primary logical decomposition

51+

26-50

11-25

6-10

1-5

Most Complex Units

Top 28 most complex units

Unit	# lines	McCabe index	# params
def bpe() in src/encoder.py	37	10	2
def bytes_to_unicode() in src/encoder.py	11	4	0
def __init__() in src/encoder.py	9	4	4
def encode() in src/encoder.py	6	4	2
def model() in src/model.py	23	4	5
def decode() in src/encoder.py	4	3	2
def sample_sequence() in src/sample.py	46	3	9
def shape_list() in src/model.py	4	3	1
def attn() in src/model.py	34	3	6
def get_pairs() in src/encoder.py	7	2	1
def get_encoder() in src/encoder.py	10	2	2
def top_k_logits() in src/sample.py	16	2	2
def interact_model() in src/interactive_conditional_samples.py	10	1	0
def sample_model() in src/generate_unconditional_samples.py	10	1	0
def top_p_logits() in src/sample.py	14	1	2
def default_hparams() in src/model.py	8	1	0
def softmax() in src/model.py	4	1	2
def gelu() in src/model.py	2	1	1
def norm() in src/model.py	10	1	5
def split_states() in src/model.py	3	1	2
def merge_states() in src/model.py	3	1	1
def conv1d() in src/model.py	7	1	5
def attention_mask() in src/model.py	5	1	4
def mlp() in src/model.py	6	1	5
def block() in src/model.py	8	1	5
def past_shape() in src/model.py	2	1	4
def expand_tile() in src/model.py	4	1	2
def positions_for() in src/model.py	4	1	2