openai / mle-bench
Conditional Complexity

The distribution of complexity of units (measured with McCabe index).

Intro
  • Conditional complexity (also called cyclomatic complexity) is a term used to measure the complexity of software. The term refers to the number of possible paths through a program function. A higher value ofter means higher maintenance and testing costs (infosecinstitute.com).
  • Conditional complexity is calculated by counting all conditions in the program that can affect the execution path (e.g. if statement, loops, switches, and/or operators, try and catch blocks...).
  • Conditional complexity is measured at the unit level (methods, functions...).
  • Units are classified in four categories based on the measured McCabe index: 1-5 (simple units), 6-10 (medium complex units), 11-25 (complex units), 26+ (very complex units).
Learn more...
Conditional Complexity Overall
  • There are 420 units with 9,128 lines of code in units (61.8% of code).
    • 0 very complex units (0 lines of code)
    • 2 complex units (358 lines of code)
    • 30 medium complex units (2,345 lines of code)
    • 69 simple units (2,695 lines of code)
    • 319 very simple units (3,730 lines of code)
0% | 3% | 25% | 29% | 40%
Legend:
51+
26-50
11-25
6-10
1-5
Alternative Visuals
Conditional Complexity per Extension
51+
26-50
11-25
6-10
1-5
py0% | 3% | 25% | 29% | 40%
Conditional Complexity per Logical Component
primary logical decomposition
51+
26-50
11-25
6-10
1-5
mlebench0% | 4% | 26% | 29% | 39%
extras0% | 0% | 61% | 7% | 30%
experiments0% | 0% | 10% | 24% | 65%
agents0% | 0% | 0% | 37% | 62%
environment0% | 0% | 0% | 43% | 56%
Most Complex Units
Top 50 most complex units
Unit# linesMcCabe index# params
316 33 3
42 29 2
148 24 3
124 22 3
74 22 2
190 17 0
31 17 2
112 17 3
21 17 1
83 16 3
72 15 3
88 15 3
78 14 3
51 14 3
52 14 3
41 13 3
21 13 2
70 13 3
73 13 3
103 13 3
52 12 3
167 12 3
167 12 3
109 12 3
65 12 1
56 11 3
62 11 3
71 11 3
46 11 3
49 11 3
35 11 2
34 11 2
147 10 3
40 10 2
69 10 3
62 10 3
40 10 2
38 10 2
20 10 1
16 9 2
72 9 3
76 9 3
55 9 3
46 9 3
51 9 2
19 9 2
40 9 2
42 9 3
26 9 2
19 8 1