alibaba / TorchEasyRec

Intro

File size measurements show the distribution of size of files.
Files are classified in four categories based on their size (lines of code): 1-100 (very small files), 101-200 (small files), 201-500 (medium size files), 501-1000 (long files), 1001+(very long files).
It is a good practice to keep files small. Long files may become "bloaters", code that have increased to such gargantuan proportions that they are hard to work with.

Learn more...

File Size Overall

There are 159 files with 26,225 lines of code.

3 very long files (3,928 lines of code)
11 long files (7,304 lines of code)
22 medium size files (6,126 lines of codeclsfd_ftr_w_mp_ins)
36 small files (5,256 lines of code)
87 very small files (3,611 lines of code)

Legend:

1001+

501-1000

201-500

101-200

1-100

explore: grouped by folders | grouped by size | sunburst | 3D view

File Size per Extension

1001+

501-1000

201-500

101-200

1-100

File Size per Logical Decomposition

primary

1001+

501-1000

201-500

101-200

1-100

Longest Files (Top 50)

File	# lines	# units
triton_hstu_attention.py in tzrec/ops/triton	1640	16
triton_hstu_linear.py in tzrec/ops/triton	1186	21
embedding.py in tzrec/modules	1102	39
main.py in tzrec	948	16
triton_layer_norm.py in tzrec/ops/triton	733	23
proto feature.proto in tzrec/protos	711	-
sampler.py in tzrec/datasets	705	40
convert_easyrec_config_to_tzrec_config.py in tzrec/tools	689	22
feature.py in tzrec/features	659	45
triton_jagged_tensors.py in tzrec/ops/triton	631	14
data_parser.py in tzrec/datasets	609	14
triton_position.py in tzrec/ops/triton	586	13
sequence_feature.py in tzrec/features	529	29
odps_dataset.py in tzrec/datasets	504	21
dataset.py in tzrec/datasets	431	19
retrieval.py in tzrec/tools/tdm	387	6
hitrate.py in tzrec/tools	381	2
sequence.py in tzrec/modules	359	21
hstu.py in tzrec/modules	338	10
rank_model.py in tzrec/models	311	14
triton_hstu_preprocess_and_attention.py in tzrec/ops/triton	307	3
utils.py in tzrec/datasets	291	10
triton_addmm.py in tzrec/ops/triton	281	7
hstu_attention_bench.py in tzrec/ops/benchmarks	277	5
match_model.py in tzrec/models	270	21
benchmark.py in tzrec/benchmark	261	14
tree_search_util.py in tzrec/tools/tdm/gen_tree	247	9
mind.py in tzrec/models	237	7
feature_selection.py in tzrec/tools	235	6
tree_cluster.py in tzrec/tools/tdm/gen_tree	230	6
rocket_launching.py in tzrec/models	224	9
dist_util.py in tzrec/utils	216	5
add_feature_info_to_config.py in tzrec/tools	214	6
pt_jagged_tensors.py in tzrec/ops/pytorch	214	7
lookup_feature.py in tzrec/features	210	12
config_util.py in tzrec/utils	205	8
pt_hstu_attention.py in tzrec/ops/pytorch	200	4
parquet_dataset.py in tzrec/datasets	197	8
plan_util.py in tzrec/utils	196	8
dense_embedding_collection.py in tzrec/modules	195	14
hstu_compute.py in tzrec/ops	195	3
jagged_tensors.py in tzrec/ops	187	5
match_feature.py in tzrec/features	185	12
export_utils.py in tzrec/acc	182	3
custom_feature.py in tzrec/features	178	13
dat.py in tzrec/models	174	6
utils.py in tzrec/acc	168	12
model.py in tzrec/models	152	18
checkpoint_util.py in tzrec/utils	150	7
tokenize_feature.py in tzrec/features	147	9

Files With Most Units (Top 50)

File	# lines	# units
feature.py in tzrec/features	659	45
sampler.py in tzrec/datasets	705	40
embedding.py in tzrec/modules	1102	39
sequence_feature.py in tzrec/features	529	29
triton_layer_norm.py in tzrec/ops/triton	733	23
convert_easyrec_config_to_tzrec_config.py in tzrec/tools	689	22
sequence.py in tzrec/modules	359	21
match_model.py in tzrec/models	270	21
odps_dataset.py in tzrec/datasets	504	21
triton_hstu_linear.py in tzrec/ops/triton	1186	21
dataset.py in tzrec/datasets	431	19
model.py in tzrec/models	152	18
main.py in tzrec	948	16
triton_hstu_attention.py in tzrec/ops/triton	1640	16
dense_embedding_collection.py in tzrec/modules	195	14
rank_model.py in tzrec/models	311	14
data_parser.py in tzrec/datasets	609	14
benchmark.py in tzrec/benchmark	261	14
triton_jagged_tensors.py in tzrec/ops/triton	631	14
custom_feature.py in tzrec/features	178	13
triton_position.py in tzrec/ops/triton	586	13
lookup_feature.py in tzrec/features	210	12
match_feature.py in tzrec/features	185	12
utils.py in tzrec/acc	168	12
utils.py in tzrec/modules	59	11
id_feature.py in tzrec/features	146	11
hstu.py in tzrec/modules	338	10
utils.py in tzrec/datasets	291	10
raw_feature.py in tzrec/features	97	10
rocket_launching.py in tzrec/models	224	9
tree_search_util.py in tzrec/tools/tdm/gen_tree	247	9
tree_builder.py in tzrec/tools/tdm/gen_tree	137	9
tokenize_feature.py in tzrec/features	147	9
lr_scheduler.py in tzrec/optim	85	8
config_util.py in tzrec/utils	205	8
plan_util.py in tzrec/utils	196	8
hstu.py in tzrec/models	142	8
parquet_dataset.py in tzrec/datasets	197	8
trt_utils.py in tzrec/acc	143	8
checkpoint_util.py in tzrec/utils	150	7
mind.py in tzrec/models	237	7
multi_task_rank.py in tzrec/models	136	7
csv_dataset.py in tzrec/datasets	135	7
expr_feature.py in tzrec/features	77	7
overlap_feature.py in tzrec/features	85	7
pt_jagged_tensors.py in tzrec/ops/pytorch	214	7
triton_addmm.py in tzrec/ops/triton	281	7
interaction.py in tzrec/modules	54	6
variational_dropout.py in tzrec/modules	83	6
capsule.py in tzrec/modules	117	6

Files With Long Lines (Top 3)

There are 3 files with lines longer than 120 characters. In total, there are 4 long lines.

File	# lines	# units	# long lines
proto feature.proto in tzrec/protos	711	-	2
hstu_attention_bench.py in tzrec/ops/benchmarks	277	5	1
jagged_tensors.py in tzrec/ops	187	5	1