openai / transformer-debugger
File Size

The distribution of size of files (measured in lines of code).

Intro
  • File size measurements show the distribution of size of files.
  • Files are classified in four categories based on their size (lines of code): 1-100 (very small files), 101-200 (small files), 201-500 (medium size files), 501-1000 (long files), 1001+(very long files).
  • It is a good practice to keep files small. Long files may become "bloaters", code that have increased to such gargantuan proportions that they are hard to work with.
Learn more...
File Size Overall
  • There are 208 files with 26,327 lines of code.
    • 2 very long files (3,451 lines of code)
    • 10 long files (6,922 lines of code)
    • 27 medium size files (8,606 lines of code)
    • 27 small files (3,688 lines of code)
    • 142 very small files (3,660 lines of code)
13% | 26% | 32% | 14% | 13%
Legend:
1001+
501-1000
201-500
101-200
1-100


explore: grouped by folders | grouped by size | sunburst | 3D view
File Size per Extension
1001+
501-1000
201-500
101-200
1-100
py17% | 29% | 36% | 9% | 6%
tsx0% | 23% | 19% | 27% | 29%
ts0% | 0% | 21% | 28% | 50%
js0% | 0% | 0% | 0% | 100%
css0% | 0% | 0% | 0% | 100%
yaml0% | 0% | 0% | 0% | 100%
html0% | 0% | 0% | 0% | 100%
cfg0% | 0% | 0% | 0% | 100%
File Size per Logical Decomposition
primary
1001+
501-1000
201-500
101-200
1-100
neuron_explainer17% | 29% | 36% | 9% | 6%
neuron_viewer0% | 15% | 19% | 27% | 37%
ROOT0% | 0% | 0% | 0% | 100%
Longest Files (Top 50)
File# lines# units
few_shot_examples.py
in neuron_explainer/explanations
2345 3
interactive_model.py
in neuron_explainer/activation_server
1106 33
derived_scalar_computation.py
in neuron_explainer/activation_server
993 34
NodeTable.tsx
in neuron_viewer/src/TransformerDebugger/cards/node_table
976 15
derived_scalar_types.py
in neuron_explainer/activations/derived_scalars
827 14
attention.py
in neuron_explainer/activations/derived_scalars
696 41
reconstituter_class.py
in neuron_explainer/activations/derived_scalars
634 44
least_common_tokens.py
in neuron_explainer/activations/derived_scalars
598 -
simulator.py
in neuron_explainer/explanations
586 18
postprocessing.py
in neuron_explainer/activations/derived_scalars
556 33
derived_scalar_store.py
in neuron_explainer/activations/derived_scalars
534 42
transformer.py
in neuron_explainer/models
522 52
edge_attribution.py
in neuron_explainer/activations/derived_scalars
429 24
indexing.py
in neuron_explainer/activations/derived_scalars
422 34
explainer.py
in neuron_explainer/explanations
419 17
autoencoder.py
in neuron_explainer/activations/derived_scalars
416 34
direct_effects.py
in neuron_explainer/activations/derived_scalars
416 23
explainer_routes.py
in neuron_explainer/activation_server
410 8
activations_and_metadata.py
in neuron_explainer/activations/derived_scalars
405 33
model_component_registry.py
in neuron_explainer/models
376 19
read_routes.py
in neuron_explainer/activation_server
375 20
scalar_deriver.py
in neuron_explainer/activations/derived_scalars
357 41
reconstituted.py
in neuron_explainer/activations/derived_scalars
345 27
make_scalar_derivers.py
in neuron_explainer/activations/derived_scalars
340 2
requests_and_responses.py
in neuron_explainer/activation_server
337 4
raw_activations.py
in neuron_explainer/activations/derived_scalars
306 18
model_context.py
in neuron_explainer/models
306 37
TransformerDebugger.tsx
in neuron_viewer/src/TransformerDebugger
299 -
LogitsDisplay.tsx
in neuron_viewer/src/TransformerDebugger/cards
287 4
tdb_conversions.py
in neuron_explainer/activation_server
279 10
request.ts
in neuron_viewer/src/client/core
273 -
multi_pass_scalar_deriver.py
in neuron_explainer/activations/derived_scalars
254 30
hook_graph.py
in neuron_explainer/activations
245 16
residual.py
in neuron_explainer/activations/derived_scalars
237 13
hooks.py
in neuron_explainer/models
230 39
autoencoder_context.py
in neuron_explainer/models
218 21
inferenceDataFetcher.ts
in neuron_viewer/src/TransformerDebugger/requests
217 3
attention_head_scoring.py
in neuron_explainer/explanations
205 3
logitLens.tsx
in neuron_viewer/src/panes
203 3
multi_group.py
in neuron_explainer/activations/derived_scalars
195 15
urlParams.ts
in neuron_viewer/src/TransformerDebugger/utils
194 16
locations.py
in neuron_explainer/activations/derived_scalars
188 16
nodePage.tsx
in neuron_viewer/src
185 6
InferenceParamsDisplay.tsx
in neuron_viewer/src/TransformerDebugger/cards/inference_params
170 -
tokens.py
in neuron_explainer/activations/derived_scalars
161 6
TraceUpstreamNodeSpec.tsx
in neuron_viewer/src/TransformerDebugger/cards/inference_params
157 -
activations.py
in neuron_explainer/activations
154 11
BySequenceTokenDisplay.tsx
in neuron_viewer/src/TransformerDebugger/cards
153 3
scoring.py
in neuron_explainer/explanations
141 6
tokenHeatmap2d.tsx
in neuron_viewer/src
138 -
Files With Most Units (Top 50)
File# lines# units
transformer.py
in neuron_explainer/models
522 52
reconstituter_class.py
in neuron_explainer/activations/derived_scalars
634 44
derived_scalar_store.py
in neuron_explainer/activations/derived_scalars
534 42
attention.py
in neuron_explainer/activations/derived_scalars
696 41
scalar_deriver.py
in neuron_explainer/activations/derived_scalars
357 41
hooks.py
in neuron_explainer/models
230 39
model_context.py
in neuron_explainer/models
306 37
indexing.py
in neuron_explainer/activations/derived_scalars
422 34
autoencoder.py
in neuron_explainer/activations/derived_scalars
416 34
derived_scalar_computation.py
in neuron_explainer/activation_server
993 34
postprocessing.py
in neuron_explainer/activations/derived_scalars
556 33
activations_and_metadata.py
in neuron_explainer/activations/derived_scalars
405 33
interactive_model.py
in neuron_explainer/activation_server
1106 33
multi_pass_scalar_deriver.py
in neuron_explainer/activations/derived_scalars
254 30
reconstituted.py
in neuron_explainer/activations/derived_scalars
345 27
edge_attribution.py
in neuron_explainer/activations/derived_scalars
429 24
direct_effects.py
in neuron_explainer/activations/derived_scalars
416 23
autoencoder_context.py
in neuron_explainer/models
218 21
read_routes.py
in neuron_explainer/activation_server
375 20
model_component_registry.py
in neuron_explainer/models
376 19
raw_activations.py
in neuron_explainer/activations/derived_scalars
306 18
simulator.py
in neuron_explainer/explanations
586 18
explainer.py
in neuron_explainer/explanations
419 17
urlParams.ts
in neuron_viewer/src/TransformerDebugger/utils
194 16
hook_graph.py
in neuron_explainer/activations
245 16
locations.py
in neuron_explainer/activations/derived_scalars
188 16
NodeTable.tsx
in neuron_viewer/src/TransformerDebugger/cards/node_table
976 15
multi_group.py
in neuron_explainer/activations/derived_scalars
195 15
autoencoder.py
in neuron_explainer/models
105 15
derived_scalar_types.py
in neuron_explainer/activations/derived_scalars
827 14
residual.py
in neuron_explainer/activations/derived_scalars
237 13
calibrated_simulator.py
in neuron_explainer/explanations
116 13
activation_records.py
in neuron_explainer/activations
119 12
activations.py
in neuron_explainer/activations
154 11
tdb_conversions.py
in neuron_explainer/activation_server
279 10
nodes.tsx
in neuron_viewer/src/TransformerDebugger/utils
97 9
logprobs.py
in neuron_explainer/activations/derived_scalars
94 8
config.py
in neuron_explainer/activations/derived_scalars
129 8
fast_dataclasses.py
in neuron_explainer/fast_dataclasses
88 8
explainer_routes.py
in neuron_explainer/activation_server
410 8
CancelablePromise.ts
in neuron_viewer/src/client/core
108 7
dst_helpers.py
in neuron_explainer/activation_server
75 7
nodePage.tsx
in neuron_viewer/src
185 6
InferenceService.ts
in neuron_viewer/src/client/services
84 6
attention_utils.py
in neuron_explainer/activations
80 6
tokens.py
in neuron_explainer/activations/derived_scalars
161 6
mlp.py
in neuron_explainer/activations/derived_scalars
91 6
main.py
in neuron_explainer/activation_server
134 6
scoring.py
in neuron_explainer/explanations
141 6
explanations.py
in neuron_explainer/explanations
136 6
Files With Long Lines (Top 34)

There are 34 files with lines longer than 120 characters. In total, there are 100 long lines.

File# lines# units# long lines
make_scalar_derivers.py
in neuron_explainer/activations/derived_scalars
340 2 33
neuron_datasets.py
in neuron_explainer/activation_server
101 3 8
DerivedScalarType.ts
in neuron_viewer/src/client/models
108 - 6
model_registry.py
in neuron_explainer/models
101 5 5
PromptAndTokensOfInterest.tsx
in neuron_viewer/src/TransformerDebugger/cards/prompt
127 2 4
explanations.ts
in neuron_viewer/src/TransformerDebugger/utils
14 - 4
derived_scalar_types.py
in neuron_explainer/activations/derived_scalars
827 14 4
residual.py
in neuron_explainer/activations/derived_scalars
237 13 3
scoreExplanation.tsx
in neuron_viewer/src/panes
43 - 2
DisplayOptions.tsx
in neuron_viewer/src/TransformerDebugger/cards
45 - 2
NodeTable.tsx
in neuron_viewer/src/TransformerDebugger/cards/node_table
976 15 2
InferenceParamsDisplay.tsx
in neuron_viewer/src/TransformerDebugger/cards/inference_params
170 - 2
hook_graph.py
in neuron_explainer/activations
245 16 2
explanation_datasets.py
in neuron_explainer/activation_server
23 1 2
simulator.py
in neuron_explainer/explanations
586 18 2
commonUiComponents.tsx
in neuron_viewer/src
20 - 1
App.tsx
in neuron_viewer/src
38 - 1
tokenRendering.tsx
in neuron_viewer/src
26 5 1
welcome.tsx
in neuron_viewer/src
79 1 1
modelInteractions.tsx
in neuron_viewer/src
62 - 1
inferenceDataFetcher.ts
in neuron_viewer/src/TransformerDebugger/requests
217 3 1
attention.py
in neuron_explainer/activations/derived_scalars
696 41 1
multi_group.py
in neuron_explainer/activations/derived_scalars
195 15 1
indexing.py
in neuron_explainer/activations/derived_scalars
422 34 1
autoencoder.py
in neuron_explainer/activations/derived_scalars
416 34 1
direct_effects.py
in neuron_explainer/activations/derived_scalars
416 23 1
load_neurons.py
in neuron_explainer/activation_server
50 2 1
explainer_routes.py
in neuron_explainer/activation_server
410 8 1
derived_scalar_computation.py
in neuron_explainer/activation_server
993 34 1
requests_and_responses.py
in neuron_explainer/activation_server
337 4 1
inference_routes.py
in neuron_explainer/activation_server
70 3 1
attention_head_scoring.py
in neuron_explainer/explanations
205 3 1
transformer.py
in neuron_explainer/models
522 52 1
inference_engine_type_registry.py
in neuron_explainer/models
69 3 1
Correlations

File Size vs. Commits (all time): 24 points

.pre-commit-config.yaml x: 3 commits (all time) y: 17 lines of code neuron_explainer/models/autoencoder.py x: 1 commits (all time) y: 105 lines of code neuron_explainer/activation_server/explainer_routes.py x: 7 commits (all time) y: 410 lines of code neuron_explainer/explanations/attention_head_scoring.py x: 6 commits (all time) y: 205 lines of code neuron_explainer/explanations/simulator.py x: 6 commits (all time) y: 586 lines of code neuron_explainer/activation_server/explanation_datasets.py x: 2 commits (all time) y: 23 lines of code neuron_explainer/activation_server/load_neurons.py x: 2 commits (all time) y: 50 lines of code neuron_explainer/activation_server/main.py x: 4 commits (all time) y: 134 lines of code neuron_explainer/activation_server/neuron_datasets.py x: 2 commits (all time) y: 101 lines of code neuron_explainer/activations/activations.py x: 4 commits (all time) y: 154 lines of code neuron_explainer/activations/derived_scalars/derived_scalar_store.py x: 2 commits (all time) y: 534 lines of code neuron_explainer/explanations/explanations.py x: 4 commits (all time) y: 136 lines of code neuron_explainer/file_utils.py x: 4 commits (all time) y: 63 lines of code neuron_explainer/models/autoencoder_context.py x: 5 commits (all time) y: 218 lines of code neuron_explainer/models/model_context.py x: 2 commits (all time) y: 306 lines of code neuron_explainer/models/transformer.py x: 5 commits (all time) y: 522 lines of code neuron_explainer/scripts/create_hf_test_data.py x: 3 commits (all time) y: 93 lines of code neuron_explainer/scripts/download_from_hf.py x: 2 commits (all time) y: 84 lines of code neuron_viewer/src/welcome.tsx x: 4 commits (all time) y: 79 lines of code neuron_explainer/activation_server/inference_routes.py x: 2 commits (all time) y: 70 lines of code neuron_explainer/activation_server/interactive_model.py x: 2 commits (all time) y: 1106 lines of code neuron_explainer/activation_server/requests_and_responses.py x: 2 commits (all time) y: 337 lines of code neuron_viewer/src/client/models/ModelInfoResponse.ts x: 2 commits (all time) y: 8 lines of code
1106.0
lines of code
  min: 8.0
  average: 226.75
  25th percentile: 72.25
  median: 119.5
  75th percentile: 329.25
  max: 1106.0
0 7.0
commits (all time)
min: 1.0 | average: 3.25 | 25th percentile: 2.0 | median: 2.5 | 75th percentile: 4.0 | max: 7.0

File Size vs. Contributors (all time): 24 points

.pre-commit-config.yaml x: 2 contributors (all time) y: 17 lines of code neuron_explainer/models/autoencoder.py x: 1 contributors (all time) y: 105 lines of code neuron_explainer/activation_server/explainer_routes.py x: 3 contributors (all time) y: 410 lines of code neuron_explainer/explanations/attention_head_scoring.py x: 3 contributors (all time) y: 205 lines of code neuron_explainer/explanations/simulator.py x: 3 contributors (all time) y: 586 lines of code neuron_explainer/activation_server/explanation_datasets.py x: 1 contributors (all time) y: 23 lines of code neuron_explainer/activation_server/load_neurons.py x: 1 contributors (all time) y: 50 lines of code neuron_explainer/activation_server/main.py x: 1 contributors (all time) y: 134 lines of code neuron_explainer/activation_server/neuron_datasets.py x: 1 contributors (all time) y: 101 lines of code neuron_explainer/activations/activations.py x: 1 contributors (all time) y: 154 lines of code neuron_explainer/activations/derived_scalars/derived_scalar_store.py x: 1 contributors (all time) y: 534 lines of code neuron_explainer/explanations/explanations.py x: 1 contributors (all time) y: 136 lines of code neuron_explainer/file_utils.py x: 1 contributors (all time) y: 63 lines of code neuron_explainer/models/autoencoder_context.py x: 1 contributors (all time) y: 218 lines of code neuron_explainer/models/model_context.py x: 1 contributors (all time) y: 306 lines of code neuron_explainer/models/transformer.py x: 1 contributors (all time) y: 522 lines of code neuron_explainer/scripts/create_hf_test_data.py x: 1 contributors (all time) y: 93 lines of code neuron_explainer/scripts/download_from_hf.py x: 1 contributors (all time) y: 84 lines of code neuron_viewer/src/welcome.tsx x: 1 contributors (all time) y: 79 lines of code neuron_explainer/activation_server/inference_routes.py x: 1 contributors (all time) y: 70 lines of code neuron_explainer/activation_server/interactive_model.py x: 1 contributors (all time) y: 1106 lines of code neuron_explainer/activation_server/requests_and_responses.py x: 1 contributors (all time) y: 337 lines of code neuron_viewer/src/client/models/ModelInfoResponse.ts x: 1 contributors (all time) y: 8 lines of code
1106.0
lines of code
  min: 8.0
  average: 226.75
  25th percentile: 72.25
  median: 119.5
  75th percentile: 329.25
  max: 1106.0
0 3.0
contributors (all time)
min: 1.0 | average: 1.29 | 25th percentile: 1.0 | median: 1.0 | 75th percentile: 1.0 | max: 3.0

File Size vs. Commits (30 days): 0 points

No data for "commits (30d)" vs. "lines of code".

File Size vs. Contributors (30 days): 0 points

No data for "contributors (30d)" vs. "lines of code".


File Size vs. Commits (90 days): 1 points

.pre-commit-config.yaml x: 3 commits (90d) y: 17 lines of code
17.0
lines of code
  min: 17.0
  average: 17.0
  25th percentile: 17.0
  median: 17.0
  75th percentile: 17.0
  max: 17.0
0 3.0
commits (90d)
min: 3.0 | average: 3.0 | 25th percentile: 3.0 | median: 3.0 | 75th percentile: 3.0 | max: 3.0

File Size vs. Contributors (90 days): 1 points

.pre-commit-config.yaml x: 2 contributors (90d) y: 17 lines of code
17.0
lines of code
  min: 17.0
  average: 17.0
  25th percentile: 17.0
  median: 17.0
  75th percentile: 17.0
  max: 17.0
0 2.0
contributors (90d)
min: 2.0 | average: 2.0 | 25th percentile: 2.0 | median: 2.0 | 75th percentile: 2.0 | max: 2.0