huggingface / accelerate
File Size

The distribution of size of files (measured in lines of code).

Intro
Learn more...
File Size Overall
35% | 17% | 17% | 18% | 11%
Legend:
1001+
501-1000
201-500
101-200
1-100


explore: grouped by folders | grouped by size | sunburst | 3D view
File Size per Extension
1001+
501-1000
201-500
101-200
1-100
py35% | 17% | 18% | 18% | 11%
toml0% | 0% | 0% | 0% | 100%
File Size per Logical Decomposition
primary
1001+
501-1000
201-500
101-200
1-100
src42% | 20% | 21% | 9% | 6%
benchmarks0% | 0% | 0% | 51% | 48%
manim_animations0% | 0% | 0% | 80% | 19%
utils0% | 0% | 0% | 78% | 21%
ROOT0% | 0% | 0% | 0% | 100%
Longest Files (Top 50)
File# lines# units
accelerator.py
in src/accelerate
2103 91
dataclasses.py
in src/accelerate/utils
1815 56
modeling.py
in src/accelerate/utils
1371 38
launch.py
in src/accelerate/commands
1076 14
megatron_lm.py
in src/accelerate/utils
1032 52
data_loader.py
in src/accelerate
876 61
cluster.py
in src/accelerate/commands/config
809 1
state.py
in src/accelerate
771 69
launch.py
in src/accelerate/utils
593 12
tracking.py
in src/accelerate
572 67
fsdp_utils.py
in src/accelerate/utils
489 19
hooks.py
in src/accelerate
437 31
operations.py
in src/accelerate/utils
434 38
big_modeling.py
in src/accelerate
384 10
imports.py
in src/accelerate/utils
338 60
bnb.py
in src/accelerate/utils
309 8
__init__.py
in src/accelerate/utils
279 -
other.py
in src/accelerate/utils
260 21
sagemaker.py
in src/accelerate/commands/config
233 3
estimate.py
in src/accelerate/commands
212 9
checkpointing.py
in src/accelerate
208 4
environment.py
in src/accelerate/utils
201 17
config_args.py
in src/accelerate/commands/config
195 9
deepspeed.py
in src/accelerate/utils
178 23
launchers.py
in src/accelerate
176 3
stage_5.py
in manim_animations/dataloaders
173 1
utils.py
in benchmarks/fsdp2
169 9
stage_6.py
in manim_animations/dataloaders
164 1
distrib_deepspeed.py
in benchmarks/fp8/torchao
163 3
stage_5.py
in manim_animations/big_model_inference
161 1
stage_7.py
in manim_animations/dataloaders
154 1
147 -
distrib_deepspeed.py
in benchmarks/fp8/transformer_engine
141 2
stage_2.py
in manim_animations/dataloaders
141 1
optimizer.py
in src/accelerate
135 20
default.py
in src/accelerate/commands/config
124 3
fsdp.py
in benchmarks/fp8/torchao
121 4
offload.py
in src/accelerate/utils
120 13
distrib_deepspeed.py
in benchmarks/fp8/ms_amp
118 2
to_fsdp2.py
in src/accelerate/commands
118 5
tpu.py
in src/accelerate/commands
118 3
random.py
in src/accelerate/utils
114 3
stage_3.py
in manim_animations/big_model_inference
114 1
stage_4.py
in manim_animations/big_model_inference
113 1
inference.py
in src/accelerate
112 6
fsdp.py
in benchmarks/fp8/transformer_engine
110 2
selection_menu.py
in src/accelerate/commands/menu
108 10
ddp.py
in benchmarks/fp8/torchao
107 4
big_model_inference.py
in benchmarks/big_model_inference
105 2
memory.py
in src/accelerate/utils
103 7
Files With Most Units (Top 50)
File# lines# units
accelerator.py
in src/accelerate
2103 91
state.py
in src/accelerate
771 69
tracking.py
in src/accelerate
572 67
data_loader.py
in src/accelerate
876 61
imports.py
in src/accelerate/utils
338 60
dataclasses.py
in src/accelerate/utils
1815 56
megatron_lm.py
in src/accelerate/utils
1032 52
operations.py
in src/accelerate/utils
434 38
modeling.py
in src/accelerate/utils
1371 38
hooks.py
in src/accelerate
437 31
deepspeed.py
in src/accelerate/utils
178 23
other.py
in src/accelerate/utils
260 21
optimizer.py
in src/accelerate
135 20
fsdp_utils.py
in src/accelerate/utils
489 19
environment.py
in src/accelerate/utils
201 17
launch.py
in src/accelerate/commands
1076 14
offload.py
in src/accelerate/utils
120 13
launch.py
in src/accelerate/utils
593 12
big_modeling.py
in src/accelerate
384 10
config_utils.py
in src/accelerate/commands/config
79 10
selection_menu.py
in src/accelerate/commands/menu
108 10
utils.py
in benchmarks/fsdp2
169 9
config_args.py
in src/accelerate/commands/config
195 9
estimate.py
in src/accelerate/commands
212 9
bnb.py
in src/accelerate/utils
309 8
utils.py
in src/accelerate/commands
72 8
measures_util.py
in benchmarks/big_model_inference
57 7
scheduler.py
in src/accelerate
41 7
memory.py
in src/accelerate/utils
103 7
measure_utils.py
in benchmarks/fsdp2
82 6
inference.py
in src/accelerate
112 6
helpers.py
in src/accelerate/commands/menu
23 6
ao.py
in src/accelerate/utils
43 5
to_fsdp2.py
in src/accelerate/commands
118 5
input.py
in src/accelerate/commands/menu
40 5
local_sgd.py
in src/accelerate
42 5
fp8_utils.py
in benchmarks/fp8/torchao
66 4
non_distributed.py
in benchmarks/fp8/torchao
100 4
fsdp.py
in benchmarks/fp8/torchao
121 4
ddp.py
in benchmarks/fp8/torchao
107 4
fp8_utils.py
in benchmarks/fp8/transformer_engine
66 4
fp8_utils.py
in benchmarks/fp8/ms_amp
67 4
checkpointing.py
in src/accelerate
208 4
transformer_engine.py
in src/accelerate/utils
100 4
config.py
in src/accelerate/commands/config
56 4
logging.py
in src/accelerate
40 4
main.py
in benchmarks/fsdp2
81 3
visualize.py
in benchmarks/fsdp2
80 3
distrib_deepspeed.py
in benchmarks/fp8/torchao
163 3
random.py
in src/accelerate/utils
114 3
Files With Long Lines (Top 50)

There are 51 files with lines longer than 120 characters. In total, there are 305 long lines.

File# lines# units# long lines
dataclasses.py
in src/accelerate/utils
1815 56 49
accelerator.py
in src/accelerate
2103 91 48
launch.py
in src/accelerate/commands
1076 14 29
launch.py
in src/accelerate/utils
593 12 16
cluster.py
in src/accelerate/commands/config
809 1 14
state.py
in src/accelerate
771 69 10
non_distributed.py
in benchmarks/fp8/torchao
100 4 6
fsdp.py
in benchmarks/fp8/torchao
121 4 6
distrib_deepspeed.py
in benchmarks/fp8/torchao
163 3 6
ddp.py
in benchmarks/fp8/torchao
107 4 6
non_distributed.py
in benchmarks/fp8/transformer_engine
87 2 6
fsdp.py
in benchmarks/fp8/transformer_engine
110 2 6
distrib_deepspeed.py
in benchmarks/fp8/transformer_engine
141 2 6
ddp.py
in benchmarks/fp8/transformer_engine
95 2 6
non_distributed.py
in benchmarks/fp8/ms_amp
77 2 6
distrib_deepspeed.py
in benchmarks/fp8/ms_amp
118 2 6
ddp.py
in benchmarks/fp8/ms_amp
81 2 6
modeling.py
in src/accelerate/utils
1371 38 6
launchers.py
in src/accelerate
176 3 6
estimate.py
in src/accelerate/commands
212 9 5
stage_4.py
in manim_animations/dataloaders
33 1 4
fsdp_utils.py
in src/accelerate/utils
489 19 3
sagemaker.py
in src/accelerate/commands/config
233 3 3
default.py
in src/accelerate/commands/config
124 3 3
config.py
in src/accelerate/commands/config
56 4 3
stage_5.py
in manim_animations/dataloaders
173 1 3
stage_7.py
in manim_animations/dataloaders
154 1 3
147 - 2
deepspeed.py
in src/accelerate/utils
178 23 2
bnb.py
in src/accelerate/utils
309 8 2
operations.py
in src/accelerate/utils
434 38 2
update.py
in src/accelerate/commands/config
33 3 2
config_args.py
in src/accelerate/commands/config
195 9 2
data_loader.py
in src/accelerate
876 61 2
stage_6.py
in manim_animations/dataloaders
164 1 2
stage_3.py
in manim_animations/dataloaders
19 1 2
stage_2.py
in manim_animations/dataloaders
141 1 2
visualize.py
in benchmarks/fsdp2
80 3 1
other.py
in src/accelerate/utils
260 21 1
torch_xla.py
in src/accelerate/utils
18 1 1
memory.py
in src/accelerate/utils
103 7 1
big_modeling.py
in src/accelerate
384 10 1
to_fsdp2.py
in src/accelerate/commands
118 5 1
tpu.py
in src/accelerate/commands
118 3 1
tracking.py
in src/accelerate
572 67 1
logging.py
in src/accelerate
40 4 1
stage_5.py
in manim_animations/big_model_inference
161 1 1
stage_3.py
in manim_animations/big_model_inference
114 1 1
stage_2.py
in manim_animations/big_model_inference
86 1 1
stage_4.py
in manim_animations/big_model_inference
113 1 1