huggingface / picotron_tutorial
File Size

The distribution of size of files (measured in lines of code).

Intro
Learn more...
File Size Overall
0% | 0% | 21% | 49% | 28%
Legend:
1001+
501-1000
201-500
101-200
1-100


explore: grouped by folders | grouped by size | sunburst | 3D view
File Size per Extension
1001+
501-1000
201-500
101-200
1-100
py0% | 0% | 21% | 49% | 28%
File Size per Logical Decomposition
primary
1001+
501-1000
201-500
101-200
1-100
step8_pipeline_parallel_1f1b0% | 0% | 22% | 60% | 17%
step7_pipeline_parallel_afab0% | 0% | 23% | 47% | 28%
step6_data_parallel_bucket0% | 0% | 26% | 51% | 21%
step5_data_parallel_naive0% | 0% | 31% | 39% | 28%
step4_tensor_parallel0% | 0% | 33% | 40% | 25%
step3_dataloader0% | 0% | 0% | 60% | 39%
step2_process_group_manager0% | 0% | 0% | 43% | 56%
step1_modeling0% | 0% | 0% | 56% | 43%
ROOT0% | 0% | 0% | 0% | 100%
Longest Files (Top 49)
File# lines# units
tensor_parallel.py
in step7_pipeline_parallel_afab
214 18
tensor_parallel.py
in step5_data_parallel_naive
214 18
tensor_parallel.py
in step8_pipeline_parallel_1f1b
214 18
tensor_parallel.py
in step4_tensor_parallel
214 18
tensor_parallel.py
in step6_data_parallel_bucket
214 18
train.py
in step8_pipeline_parallel_1f1b
159 2
train.py
in step7_pipeline_parallel_afab
157 2
pipeline_parallel.py
in step8_pipeline_parallel_1f1b
155 8
data_parallel.py
in step7_pipeline_parallel_afab
145 23
data_parallel.py
in step8_pipeline_parallel_1f1b
145 23
data_parallel.py
in step6_data_parallel_bucket
145 23
train.py
in step5_data_parallel_naive
141 1
train.py
in step6_data_parallel_bucket
141 1
train.py
in step4_tensor_parallel
132 1
train.py
in step3_dataloader
129 1
model.py
in step7_pipeline_parallel_afab
123 12
model.py
in step5_data_parallel_naive
123 12
model.py
in step8_pipeline_parallel_1f1b
123 12
model.py
in step4_tensor_parallel
123 12
model.py
in step6_data_parallel_bucket
123 12
model.py
in step2_process_group_manager
120 12
model.py
in step1_modeling
120 12
model.py
in step3_dataloader
120 12
dataloader.py
in step7_pipeline_parallel_afab
99 6
dataloader.py
in step5_data_parallel_naive
99 6
dataloader.py
in step8_pipeline_parallel_1f1b
99 6
dataloader.py
in step6_data_parallel_bucket
99 6
dataloader.py
in step3_dataloader
91 6
dataloader.py
in step4_tensor_parallel
91 6
train.py
in step2_process_group_manager
85 -
pipeline_parallel.py
in step7_pipeline_parallel_afab
84 6
train.py
in step1_modeling
59 -
process_group_manager.py
in step7_pipeline_parallel_afab
37 3
process_group_manager.py
in step5_data_parallel_naive
37 3
process_group_manager.py
in step2_process_group_manager
37 3
process_group_manager.py
in step8_pipeline_parallel_1f1b
37 3
process_group_manager.py
in step3_dataloader
37 3
process_group_manager.py
in step4_tensor_parallel
37 3
process_group_manager.py
in step6_data_parallel_bucket
37 3
utils.py
in step7_pipeline_parallel_afab
34 3
utils.py
in step5_data_parallel_naive
34 3
utils.py
in step2_process_group_manager
34 3
utils.py
in step8_pipeline_parallel_1f1b
34 3
utils.py
in step1_modeling
34 3
utils.py
in step3_dataloader
34 3
utils.py
in step4_tensor_parallel
34 3
utils.py
in step6_data_parallel_bucket
34 3
data_parallel.py
in step5_data_parallel_naive
23 4
setup.py
in root
10 1
Files With Most Units (Top 47)
File# lines# units
data_parallel.py
in step7_pipeline_parallel_afab
145 23
data_parallel.py
in step8_pipeline_parallel_1f1b
145 23
data_parallel.py
in step6_data_parallel_bucket
145 23
tensor_parallel.py
in step7_pipeline_parallel_afab
214 18
tensor_parallel.py
in step5_data_parallel_naive
214 18
tensor_parallel.py
in step8_pipeline_parallel_1f1b
214 18
tensor_parallel.py
in step4_tensor_parallel
214 18
tensor_parallel.py
in step6_data_parallel_bucket
214 18
model.py
in step7_pipeline_parallel_afab
123 12
model.py
in step5_data_parallel_naive
123 12
model.py
in step2_process_group_manager
120 12
model.py
in step8_pipeline_parallel_1f1b
123 12
model.py
in step1_modeling
120 12
model.py
in step3_dataloader
120 12
model.py
in step4_tensor_parallel
123 12
model.py
in step6_data_parallel_bucket
123 12
pipeline_parallel.py
in step8_pipeline_parallel_1f1b
155 8
dataloader.py
in step7_pipeline_parallel_afab
99 6
pipeline_parallel.py
in step7_pipeline_parallel_afab
84 6
dataloader.py
in step5_data_parallel_naive
99 6
dataloader.py
in step8_pipeline_parallel_1f1b
99 6
dataloader.py
in step3_dataloader
91 6
dataloader.py
in step4_tensor_parallel
91 6
dataloader.py
in step6_data_parallel_bucket
99 6
data_parallel.py
in step5_data_parallel_naive
23 4
process_group_manager.py
in step7_pipeline_parallel_afab
37 3
utils.py
in step7_pipeline_parallel_afab
34 3
process_group_manager.py
in step5_data_parallel_naive
37 3
utils.py
in step5_data_parallel_naive
34 3
process_group_manager.py
in step2_process_group_manager
37 3
utils.py
in step2_process_group_manager
34 3
process_group_manager.py
in step8_pipeline_parallel_1f1b
37 3
utils.py
in step8_pipeline_parallel_1f1b
34 3
utils.py
in step1_modeling
34 3
process_group_manager.py
in step3_dataloader
37 3
utils.py
in step3_dataloader
34 3
process_group_manager.py
in step4_tensor_parallel
37 3
utils.py
in step4_tensor_parallel
34 3
process_group_manager.py
in step6_data_parallel_bucket
37 3
utils.py
in step6_data_parallel_bucket
34 3
train.py
in step7_pipeline_parallel_afab
157 2
train.py
in step8_pipeline_parallel_1f1b
159 2
train.py
in step5_data_parallel_naive
141 1
setup.py
in root
10 1
train.py
in step3_dataloader
129 1
train.py
in step4_tensor_parallel
132 1
train.py
in step6_data_parallel_bucket
141 1
Files With Long Lines (Top 39)

There are 39 files with lines longer than 120 characters. In total, there are 151 long lines.

File# lines# units# long lines
pipeline_parallel.py
in step8_pipeline_parallel_1f1b
155 8 10
process_group_manager.py
in step7_pipeline_parallel_afab
37 3 7
process_group_manager.py
in step5_data_parallel_naive
37 3 7
process_group_manager.py
in step2_process_group_manager
37 3 7
process_group_manager.py
in step8_pipeline_parallel_1f1b
37 3 7
process_group_manager.py
in step3_dataloader
37 3 7
process_group_manager.py
in step4_tensor_parallel
37 3 7
process_group_manager.py
in step6_data_parallel_bucket
37 3 7
data_parallel.py
in step7_pipeline_parallel_afab
145 23 5
data_parallel.py
in step8_pipeline_parallel_1f1b
145 23 5
data_parallel.py
in step6_data_parallel_bucket
145 23 5
tensor_parallel.py
in step7_pipeline_parallel_afab
214 18 4
pipeline_parallel.py
in step7_pipeline_parallel_afab
84 6 4
model.py
in step7_pipeline_parallel_afab
123 12 4
tensor_parallel.py
in step5_data_parallel_naive
214 18 4
model.py
in step5_data_parallel_naive
123 12 4
tensor_parallel.py
in step8_pipeline_parallel_1f1b
214 18 4
model.py
in step8_pipeline_parallel_1f1b
123 12 4
tensor_parallel.py
in step4_tensor_parallel
214 18 4
model.py
in step4_tensor_parallel
123 12 4
tensor_parallel.py
in step6_data_parallel_bucket
214 18 4
model.py
in step6_data_parallel_bucket
123 12 4
train.py
in step7_pipeline_parallel_afab
157 2 3
train.py
in step5_data_parallel_naive
141 1 3
train.py
in step8_pipeline_parallel_1f1b
159 2 3
train.py
in step3_dataloader
129 1 3
train.py
in step4_tensor_parallel
132 1 3
train.py
in step6_data_parallel_bucket
141 1 3
train.py
in step2_process_group_manager
85 - 2
model.py
in step2_process_group_manager
120 12 2
model.py
in step1_modeling
120 12 2
model.py
in step3_dataloader
120 12 2
dataloader.py
in step7_pipeline_parallel_afab
99 6 1
dataloader.py
in step5_data_parallel_naive
99 6 1
dataloader.py
in step8_pipeline_parallel_1f1b
99 6 1
train.py
in step1_modeling
59 - 1
dataloader.py
in step3_dataloader
91 6 1
dataloader.py
in step4_tensor_parallel
91 6 1
dataloader.py
in step6_data_parallel_bucket
99 6 1