openai / evals
Conditional Complexity

The distribution of complexity of units (measured with McCabe index).

Intro
  • Conditional complexity (also called cyclomatic complexity) is a term used to measure the complexity of software. The term refers to the number of possible paths through a program function. A higher value ofter means higher maintenance and testing costs (infosecinstitute.com).
  • Conditional complexity is calculated by counting all conditions in the program that can affect the execution path (e.g. if statement, loops, switches, and/or operators, try and catch blocks...).
  • Conditional complexity is measured at the unit level (methods, functions...).
  • Units are classified in four categories based on the measured McCabe index: 1-5 (simple units), 6-10 (medium complex units), 11-25 (complex units), 26+ (very complex units).
Learn more...
Conditional Complexity Overall
  • There are 1,743 units with 16,700 lines of code in units (40.5% of code).
    • 0 very complex units (0 lines of code)
    • 2 complex units (149 lines of code)
    • 52 medium complex units (2,174 lines of code)
    • 132 simple units (3,050 lines of code)
    • 1,557 very simple units (11,327 lines of code)
0% | <1% | 13% | 18% | 67%
Legend:
51+
26-50
11-25
6-10
1-5
Alternative Visuals
Conditional Complexity per Extension
51+
26-50
11-25
6-10
1-5
py0% | <1% | 13% | 18% | 67%
js0% | 0% | 0% | 40% | 59%
Conditional Complexity per Logical Component
primary logical decomposition
51+
26-50
11-25
6-10
1-5
evals0% | <1% | 13% | 18% | 67%
scripts0% | 0% | 0% | 0% | 100%
.github0% | 0% | 0% | 0% | 100%
Most Complex Units
Top 50 most complex units
Unit# linesMcCabe index# params
77 31 1
72 26 1
48 25 2
98 25 2
63 24 1
73 23 3
51 23 3
61 20 2
18 20 3
56 19 2
32 19 2
20 18 1
38 18 1
67 18 3
41 18 1
87 17 3
33 17 2
60 17 3
39 17 1
25 17 2
49 16 2
71 16 4
65 16 2
62 16 3
52 14 2
65 14 2
19 13 2
58 13 2
23 13 3
12 13 1
46 13 2
13 13 2
27 13 2
57 12 2
24 12 2
31 12 0
45 12 3
28 12 2
25 12 2
24 12 4
35 11 4
17 11 3
50 11 2
28 11 2
37 11 2
40 11 1
27 11 2
30 11 2
28 11 2
86 11 3