alibaba / rtp-llm
File Age & Freshness

File age measurements show the distribution of file ages (days since the first commit) and the file freshness (days since the latest commit).

Summary
File Change History Overall
File Age Distribution Overall
Days since first update
  • There are 1,119 files with 158,056 lines of code in files.
    • 210 files that are 366+ days old (27,609 lines of code)
    • 268 files that are 181-365 days old (23,380 lines of code)
    • 58 files that are 91-180 days old (5,017 lines of code)
    • 71 files that are 31-90 days old (5,063 lines of code)
    • 512 files that are 1-30 days old (96,987 lines of code)
17% | 14% | 3% | 3% | 61%
Legend:
366+
181-365
91-180
31-90
1-30

explore: grouped by folders | grouped by age
File Freshness Distribution Overall
Days since last update
  • There are 1,119 files with 158,056 lines of code in files.
    • 59 files have been last changed 366+ days ago (5,651 lines of code)
    • 123 files have been last changed 181-365 days ago (11,641 lines of code)
    • 84 files have been last changed 91-180 days ago (6,542 lines of code)
    • 84 files have been last changed 31-90 days ago (6,357 lines of code)
    • 769 files have been last changed 1-30 days ago (127,865 lines of code)
3% | 7% | 4% | 4% | 80%
Legend:
366+
181-365
91-180
31-90
1-30

explore: grouped by folders | grouped by freshness
File Change History per File Extension
cpp, h, cc, py, proto, java, cs, php, cfg, sh, cuh, m, cu, txt, md, js, json, pt, bzl, ini, tpl, patch, rb, xml, hpp, c, cmake, bat, in, m4, csproj, inc, dockerfile, plist, gitignore, go, pb, pyi, yaml, inl, storyboard, dart, dockerignore, ps1, xib, vim, swift, mm, el, clang-format, gitmodules, gemspec, gitattributes, targets, nuspec, podspec, awk
File Age Distribution per Extension
Days since first update
366+
181-365
91-180
31-90
1-30
py51% | 29% | 1% | 4% | 12%
cc10% | 12% | 5% | 1% | 69%
h4% | 10% | 3% | 3% | 77%
bzl61% | 15% | 1% | 0% | 22%
proto74% | 25% | 0% | 0% | 0%
cpp0% | 53% | 9% | 16% | 20%
pyi0% | 0% | 0% | 100% | 0%
cu0% | 0% | 0% | 0% | 100%
cuh0% | 0% | 0% | 0% | 100%
hpp0% | 0% | 0% | 0% | 100%
inl0% | 0% | 0% | 0% | 100%
File Freshness Distribution per Extension
Days since last update
366+
181-365
91-180
31-90
1-30
py13% | 24% | 13% | 11% | 38%
bzl24% | 32% | 6% | 9% | 26%
h0% | 2% | 2% | 3% | 92%
cpp0% | 12% | 6% | <1% | 80%
cc0% | <1% | <1% | <1% | 98%
proto0% | 5% | 0% | 19% | 74%
pyi0% | 0% | 0% | 13% | 86%
cu0% | 0% | 0% | 0% | 100%
cuh0% | 0% | 0% | 0% | 100%
hpp0% | 0% | 0% | 0% | 100%
inl0% | 0% | 0% | 0% | 100%
File Change History per Logical Decomposition
primary
primary (file age distribution)
Days since first update
366+
181-365
91-180
31-90
1-30
maga_transformer16% | 14% | 3% | 3% | 62%
bazel82% | 14% | 2% | 0% | 0%
benchmark100% | 0% | 0% | 0% | 0%
ROOT100% | 0% | 0% | 0% | 0%
open_source100% | 0% | 0% | 0% | 0%
example0% | 100% | 0% | 0% | 0%
rtpllm_master_py0% | 0% | 0% | 100% | 0%
primary (file freshness distribution)
Days since last update
366+
181-365
91-180
31-90
1-30
maga_transformer2% | 6% | 4% | 3% | 82%
bazel46% | 37% | 2% | 14% | 0%
benchmark100% | 0% | 0% | 0% | 0%
ROOT0% | 100% | 0% | 0% | 0%
example0% | 0% | 100% | 0% | 0%
rtpllm_master_py0% | 0% | 0% | 100% | 0%
open_source0% | 0% | 0% | 0% | 100%
Oldest Files (Top 50)
File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
model_weight.py
in maga_transformer/utils
 1001 80 2023-12-21 2025-05-08 92 2 rtp-llm@alibaba rtp-llm@alibaba
base_model.py
in maga_transformer/models
 467 45 2023-12-21 2025-05-07 90 2 rtp-llm@alibaba rtp-llm@alibaba
gang_server.py
in maga_transformer/distribute
 267 20 2023-12-21 2025-04-16 21 2 rtp-llm@alibaba rtp-llm@alibaba
model_factory.py
in maga_transformer
 213 15 2023-12-21 2025-05-08 35 3 rtp-llm@alibaba rtp-llm@alibaba
start_server.py
in maga_transformer
 121 5 2023-12-21 2025-04-08 30 2 rtp-llm@alibaba rtp-llm@alibaba
exceptions.py
in maga_transformer/config
 63 2 2023-12-21 2025-04-07 15 2 rtp-llm@alibaba rtp-llm@alibaba
async_model.py
in maga_transformer/async_decoder_engine
 62 10 2023-12-21 2025-04-20 34 3 rtp-llm@alibaba rtp-llm@alibaba
kmonitor_metric_reporter.py
in maga_transformer/metrics
 48 4 2023-12-21 2025-04-08 11 2 rtp-llm@alibaba rtp-llm@alibaba
engine_creator.py
in maga_transformer/async_decoder_engine
 26 2 2023-12-21 2025-05-07 23 2 rtp-llm@alibaba rtp-llm@alibaba
version_info.py
in maga_transformer/utils
 13 - 2023-12-21 2023-12-21 1 1 rtp-llm@alibaba rtp-llm@alibaba
bundle.bzl
in bazel
 519 - 2023-12-28 2023-12-28 1 1 xinfeishi@gmail.com xinfeishi@gmail.com
ThriftSourceProtocol.py
in maga_transformer/aios/kmonitor/python_client/flume
 314 41 2023-12-28 2023-12-28 1 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
tokenization_chatglm.py
in maga_transformer/tokenizer
 292 37 2023-12-28 2023-12-28 1 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
llama_weight.py
in maga_transformer/models
 281 13 2023-12-28 2025-05-07 16 2 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
pipeline.py
in maga_transformer/pipeline
 256 11 2023-12-28 2025-04-23 57 3 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
worker_info.py
in maga_transformer/distribute
 253 32 2023-12-28 2025-04-23 34 3 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
defs.bzl
in bazel
 251 - 2023-12-28 2025-04-14 11 5 xinfeishi@gmail.com rtp-llm@alibaba
openai_endpoint.py
in maga_transformer/openai
 249 7 2023-12-28 2025-03-11 65 3 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
meta_pickler.py
in maga_transformer/utils
 234 9 2023-12-28 2023-12-28 1 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
tokenization_chatglm3.py
in maga_transformer/tokenizer
 229 31 2023-12-28 2024-11-07 5 2 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
_ft_pickler.py
in maga_transformer
 225 9 2023-12-28 2023-12-28 1 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
qwen.py
in maga_transformer/models
 209 16 2023-12-28 2025-05-07 37 2 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
def.bzl
in root
 193 - 2023-12-28 2024-08-01 14 5 xinfeishi@gmail.com rtp-llm@alibaba
fake_model_base.py
in maga_transformer/tools
 189 3 2023-12-28 2025-05-07 2 2 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
llama.py
in maga_transformer/models
 186 14 2023-12-28 2024-12-17 31 2 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
api_datatype.py
in maga_transformer/openai
 183 1 2023-12-28 2025-03-04 33 3 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
generate_config.py
in maga_transformer/config
 182 10 2023-12-28 2025-04-27 42 2 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
tokenization_qwen.py
in maga_transformer/tokenizer
 171 14 2023-12-28 2024-03-18 3 2 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
util.py
in maga_transformer/utils
 163 20 2023-12-28 2025-03-30 21 2 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
llava.py
in maga_transformer/models
 158 10 2023-12-28 2025-03-17 49 2 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
gang_info.py
in maga_transformer/distribute
 137 6 2023-12-28 2025-04-20 13 2 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
tokenization_chatglm2.py
in maga_transformer/tokenizer
 134 21 2023-12-28 2024-11-07 2 2 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
qwen_vl.py
in maga_transformer/models
 132 14 2023-12-28 2024-11-13 47 2 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
pyc_wheel.py
in bazel
 129 5 2023-12-28 2023-12-28 1 1 xinfeishi@gmail.com xinfeishi@gmail.com
121 - 2023-12-28 2024-01-12 2 2 xinfeishi@gmail.com liukan.lk@alibaba-inc.com
starcoder.py
in maga_transformer/models
 121 8 2023-12-28 2025-05-07 17 2 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
bloom.py
in maga_transformer/models
 120 5 2023-12-28 2025-05-07 10 2 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
tokenizer_utils.py
in maga_transformer/utils
 119 7 2023-12-28 2024-06-05 3 2 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
hf_model_helper.py
in maga_transformer/tools/api
 117 12 2023-12-28 2025-01-13 9 2 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
gpt_neox.py
in maga_transformer/models
 115 6 2023-12-28 2024-10-17 12 2 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
gpt_neox_weight.py
in maga_transformer/models
 106 3 2023-12-28 2025-05-07 5 2 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
report_worker.py
in maga_transformer/aios/kmonitor/python_client/kmonitor
 94 9 2023-12-28 2024-11-04 4 3 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
chat_glm_v2.py
in maga_transformer/models
 92 8 2023-12-28 2024-10-17 14 2 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
ttypes.py
in maga_transformer/aios/kmonitor/python_client/flume
 92 7 2023-12-28 2023-12-28 1 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
word_util.py
in maga_transformer/utils
 84 9 2023-12-28 2024-12-19 7 2 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
model_factory_register.py
in maga_transformer
 82 6 2023-12-28 2024-09-19 11 2 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
falcon.py
in maga_transformer/models
 77 4 2023-12-28 2025-05-07 11 2 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
fake_qwen.py
in maga_transformer/tools
 73 2 2023-12-28 2024-08-07 4 3 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
log_analyze.py
in maga_transformer/tools
 69 7 2023-12-28 2023-12-28 1 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
phi.py
in maga_transformer/models
 63 3 2023-12-28 2025-05-07 11 2 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
Files Not Recently Changed (Top 50)
File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
version_info.py
in maga_transformer/utils
 13 - 2023-12-21 2023-12-21 1 1 rtp-llm@alibaba rtp-llm@alibaba
__init__.py
in maga_transformer/aios/kmonitor/python_client/flume
 1 - 2023-12-28 2023-12-28 1 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
__init__.py
in maga_transformer/tools
 1 - 2023-12-28 2023-12-28 1 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
__init__.py
in maga_transformer/tools/api
 1 - 2023-12-28 2023-12-28 1 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
utils.py
in maga_transformer/tools/api
 4 1 2023-12-28 2023-12-28 1 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
ret_hidden_states.py
in maga_transformer/plugins
 5 1 2023-12-28 2023-12-28 1 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
import_util.py
in maga_transformer/utils
 11 1 2023-12-28 2023-12-28 1 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
json_util.py
in maga_transformer/access_logger
 13 2 2023-12-28 2023-12-28 1 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
metric_factory.py
in maga_transformer/aios/kmonitor/python_client/kmonitor/metrics
 14 1 2023-12-28 2023-12-28 1 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
metric_base.py
in maga_transformer/aios/kmonitor/python_client/kmonitor/metrics
 17 4 2023-12-28 2023-12-28 1 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
gauge_metric.py
in maga_transformer/aios/kmonitor/python_client/kmonitor/metrics
 19 3 2023-12-28 2023-12-28 1 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
fake_util.py
in maga_transformer/tools
 20 3 2023-12-28 2023-12-28 1 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
qps_metric.py
in maga_transformer/aios/kmonitor/python_client/kmonitor
 25 3 2023-12-28 2023-12-28 1 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
rms.py
in maga_transformer/models/gpt_util
 27 2 2023-12-28 2023-12-28 1 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
acc_metric.py
in maga_transformer/aios/kmonitor/python_client/kmonitor/metrics
 40 6 2023-12-28 2023-12-28 1 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
gang_test_util.py
in maga_transformer/distribute
 40 2 2023-12-28 2023-12-28 1 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
48 - 2023-12-28 2023-12-28 1 1 xinfeishi@gmail.com xinfeishi@gmail.com
pyflume.py
in maga_transformer/aios/kmonitor/python_client/flume
 56 10 2023-12-28 2023-12-28 1 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
sgpt_bloom.py
in maga_transformer/models
 56 2 2023-12-28 2023-12-28 1 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
fake_glm_v2.py
in maga_transformer/tools
 63 2 2023-12-28 2023-12-28 1 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
log_analyze.py
in maga_transformer/tools
 69 7 2023-12-28 2023-12-28 1 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
ttypes.py
in maga_transformer/aios/kmonitor/python_client/flume
 92 7 2023-12-28 2023-12-28 1 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
pyc_wheel.py
in bazel
 129 5 2023-12-28 2023-12-28 1 1 xinfeishi@gmail.com xinfeishi@gmail.com
_ft_pickler.py
in maga_transformer
 225 9 2023-12-28 2023-12-28 1 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
meta_pickler.py
in maga_transformer/utils
 234 9 2023-12-28 2023-12-28 1 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
tokenization_chatglm.py
in maga_transformer/tokenizer
 292 37 2023-12-28 2023-12-28 1 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
ThriftSourceProtocol.py
in maga_transformer/aios/kmonitor/python_client/flume
 314 41 2023-12-28 2023-12-28 1 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
bundle.bzl
in bazel
 519 - 2023-12-28 2023-12-28 1 1 xinfeishi@gmail.com xinfeishi@gmail.com
__init__.py
in maga_transformer/pipeline
 1 - 2024-01-08 2024-01-08 1 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
prefix_encoder.py
in maga_transformer/models/gpt_util
 28 2 2023-12-28 2024-01-08 2 1 xinfei.sxf@alibaba-inc.com xinfei.sxf@alibaba-inc.com
fake_bloom.py
in maga_transformer/tools
 58 2 2023-12-28 2024-01-12 2 2 xinfei.sxf@alibaba-inc.com liukan.lk@alibaba-inc.com
fake_gpt_neox.py
in maga_transformer/tools
 62 2 2023-12-28 2024-01-12 2 2 xinfei.sxf@alibaba-inc.com liukan.lk@alibaba-inc.com
121 - 2023-12-28 2024-01-12 2 2 xinfeishi@gmail.com liukan.lk@alibaba-inc.com
renderer_factory_register.py
in maga_transformer/openai
 7 1 2024-01-30 2024-01-30 1 1 rtp-llm@alibaba rtp-llm@alibaba
223 2 2024-01-31 2024-01-31 1 1 rtp-llm@alibaba rtp-llm@alibaba
sgpt_bloom_vector.py
in maga_transformer/models
 61 3 2023-12-28 2024-02-23 2 2 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
model_assistant_server.py
in maga_transformer/tools
 52 5 2023-12-28 2024-02-28 2 2 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
thread_safe_deque.py
in maga_transformer/utils
 33 10 2024-03-04 2024-03-04 1 1 rtp-llm@alibaba rtp-llm@alibaba
complete_response_async_generator.py
in maga_transformer/utils
 32 2 2024-03-05 2024-03-05 1 1 rtp-llm@alibaba rtp-llm@alibaba
base_model_config.py
in maga_transformer/config
 6 - 2024-03-12 2024-03-12 1 1 rtp-llm@alibaba rtp-llm@alibaba
fast_chat_renderer.py
in maga_transformer/openai/renderers
 42 3 2024-01-19 2024-03-18 3 1 rtp-llm@alibaba rtp-llm@alibaba
llama_template_renderer.py
in maga_transformer/openai/renderers
 61 4 2024-01-11 2024-03-18 4 1 rtp-llm@alibaba rtp-llm@alibaba
tokenization_qwen.py
in maga_transformer/tokenizer
 171 14 2023-12-28 2024-03-18 3 2 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
llama_template.py
in maga_transformer/openai/renderers
 733 9 2024-01-11 2024-03-18 3 1 rtp-llm@alibaba rtp-llm@alibaba
export_utils.py
in maga_transformer/utils
 19 2 2024-03-21 2024-03-21 1 1 rtp-llm@alibaba rtp-llm@alibaba
chatapi_format.py
in maga_transformer/pipeline
 38 2 2023-12-28 2024-03-22 3 2 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
kmonitor.py
in maga_transformer/aios/kmonitor/python_client/kmonitor
 38 6 2023-12-28 2024-04-02 2 2 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
nccl_util.py
in maga_transformer/utils
 9 1 2024-04-08 2024-04-08 1 1 rtp-llm@alibaba rtp-llm@alibaba
smoothquant.py
in maga_transformer/utils/smooth_quant_convert/llama
 150 5 2024-04-18 2024-04-18 1 1 rtp-llm@alibaba rtp-llm@alibaba
convert.py
in maga_transformer/utils/smooth_quant_convert/llama
 191 7 2024-04-18 2024-04-18 1 1 rtp-llm@alibaba rtp-llm@alibaba
Most Recently Created Files (Top 50)
File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
decoder_masked_multihead_attention_utils.h
in maga_transformer/cpp/kernels
 2737 330 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
unfused_attention_kernels.cu
in maga_transformer/cpp/kernels
 2425 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
decoder_masked_multihead_attention_template.h
in maga_transformer/cpp/kernels/decoder_masked_multihead_attention
 1663 53 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
gpt_kernels.cu
in maga_transformer/cpp/kernels
 1633 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
sampling_topp_kernels.cu
in maga_transformer/cpp/kernels
 1458 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
ArmLayerNormOp.cc
in maga_transformer/cpp/devices/arm_impl
 1337 16 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
moe_kernels.cu
in maga_transformer/cpp/cutlass/cutlass_kernels/moe_gemm
 1245 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
vec_dtypes.cuh
in maga_transformer/cpp/kernels
 1229 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
gemm_microkernel_macro_m8_bf16.h
in maga_transformer/cpp/devices/arm_impl/gemm_opt
 1173 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
layernorm_kernels.cu
in maga_transformer/cpp/kernels/rocm
 1124 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
gen.py
in maga_transformer/cpp/cutlass
 1104 29 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
unfused_attention_fp8_kernels.cu
in maga_transformer/cpp/kernels
 1012 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
inl
moe_kernels.inl
in maga_transformer/cpp/cutlass/cutlass_kernels/moe_gemm
 1005 20 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
layernorm_fp8_kernels.cu
in maga_transformer/cpp/kernels
 998 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
cublasMMWrapper.cc
in maga_transformer/cpp/cuda/cublas
 912 21 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
cublasFP8MMWrapper.cc
in maga_transformer/cpp/cuda/cublas
 882 8 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
moe_gemm_kernels_template.h
in maga_transformer/cpp/cutlass/cutlass_kernels/moe_gemm
 878 20 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
ArmGemmThreadblock.cc
in maga_transformer/cpp/devices/arm_impl/gemm_opt
 875 8 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
OpData.h
in maga_transformer/cpp/devices
 838 4 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
mma_utils.cuh
in maga_transformer/cpp/deep_gemm/include
 809 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
moe_topKSoftmax_kernels.cu
in maga_transformer/cpp/kernels
 798 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
ArmGemmPacking.cc
in maga_transformer/cpp/devices/arm_impl/gemm_opt
 767 12 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
alpha_layernorm_kernels.cu
in maga_transformer/cpp/kernels
 766 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
memory_utils.cu
in maga_transformer/cpp/cuda
 753 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
rotary_position_embedding.h
in maga_transformer/cpp/kernels
 720 42 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
fused_moe_kernel_routine.cuh
in maga_transformer/cpp/cutlass/cutlass_extensions/include/cutlass_extensions/gemm/kernel
 717 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
activation_kernels.cu
in maga_transformer/cpp/kernels
 711 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
cuda_utils.cc
in maga_transformer/cpp/cuda
 683 26 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
layernorm_kernels.cu
in maga_transformer/cpp/kernels
 652 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
no_aux_tc_kernels.cu
in maga_transformer/cpp/kernels
 646 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
CudaDevice.cc
in maga_transformer/cpp/devices/cuda_impl
 619 31 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
ArmAttentionOp.cc
in maga_transformer/cpp/devices/arm_impl
 610 15 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
sampling_penalty_kernels.cu
in maga_transformer/cpp/kernels
 607 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
DeepEPBuffer.cc
in maga_transformer/cpp/devices/cuda_impl
 603 19 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
sampling_topk_kernels.cu
in maga_transformer/cpp/kernels
 575 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
CudaOps.cc
in maga_transformer/cpp/devices/cuda_impl
 571 21 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
_mul.h
in maga_transformer/cpp/kernels
 562 66 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
cutlass_heuristic.cc
in maga_transformer/cpp/cutlass/cutlass_kernels
 553 13 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
cutlass_preprocessors.cc
in maga_transformer/cpp/cutlass/cutlass_kernels
 538 17 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
_fma.h
in maga_transformer/cpp/kernels
 525 72 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
quantization_rocm.cu
in maga_transformer/cpp/kernels/rocm
 514 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
add_residual_kernels.cu
in maga_transformer/cpp/kernels
 507 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
FfnLayerTest.hpp
in maga_transformer/cpp/devices/base_tests
 506 20 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
cuda_fp8_utils.cu
in maga_transformer/cpp/cuda
 494 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
fpA_intB_gemm_template.h
in maga_transformer/cpp/cutlass/cutlass_kernels/fpA_intB_gemm
 494 16 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
quantizePreprocessors.cc
in maga_transformer/cpp/rocm
 491 17 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
moe_kernels.h
in maga_transformer/cpp/cutlass/cutlass_kernels/moe_gemm
 483 13 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
CudaFlashInfer.cc
in maga_transformer/cpp/devices/cuda_impl
 469 7 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
DeepGemmPlugin.cpp
in maga_transformer/cpp/deep_gemm
 449 15 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
rmsnormKernels.cu
in maga_transformer/cpp/kernels
 443 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
Most Recently Changed Files (Top 50)
File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
model_weight.py
in maga_transformer/utils
 1001 80 2023-12-21 2025-05-08 92 2 rtp-llm@alibaba rtp-llm@alibaba
gpt_init_model_parameters.py
in maga_transformer/config
 641 22 2024-01-08 2025-05-08 94 2 xinfei.sxf@alibaba-inc.com rtp-llm@alibaba
pyi
libth_transformer.pyi
in maga_transformer/ops
 407 93 2025-02-14 2025-05-08 9 1 rtp-llm@alibaba rtp-llm@alibaba
model_weight_info.py
in maga_transformer/model_loader
 394 28 2025-05-07 2025-05-08 2 1 rtp-llm@alibaba rtp-llm@alibaba
GptInitParameter.cc
in maga_transformer/cpp/th_op
 378 14 2025-05-07 2025-05-08 2 1 rtp-llm@alibaba rtp-llm@alibaba
GptInitParameter.h
in maga_transformer/cpp/th_op
 220 - 2025-05-07 2025-05-08 2 1 rtp-llm@alibaba rtp-llm@alibaba
RtpLLMOp.cc
in maga_transformer/cpp/th_op/multi_gpu_gpt
 218 13 2025-05-07 2025-05-08 2 1 rtp-llm@alibaba rtp-llm@alibaba
model_factory.py
in maga_transformer
 213 15 2023-12-21 2025-05-08 35 3 rtp-llm@alibaba rtp-llm@alibaba
cuda_fmha_utils.h
in maga_transformer/cpp/cuda
 162 6 2025-05-07 2025-05-08 2 1 rtp-llm@alibaba rtp-llm@alibaba
EngineInitParameter.h
in maga_transformer/cpp/dataclass
 132 3 2024-06-01 2025-05-08 18 1 rtp-llm@alibaba rtp-llm@alibaba
Weights.h
in maga_transformer/cpp/devices
 114 - 2025-05-07 2025-05-08 2 1 rtp-llm@alibaba rtp-llm@alibaba
decoder_masked_multihead_attention_utils.h
in maga_transformer/cpp/kernels
 2737 330 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
unfused_attention_kernels.cu
in maga_transformer/cpp/kernels
 2425 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
decoder_masked_multihead_attention_template.h
in maga_transformer/cpp/kernels/decoder_masked_multihead_attention
 1663 53 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
gpt_kernels.cu
in maga_transformer/cpp/kernels
 1633 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
sampling_topp_kernels.cu
in maga_transformer/cpp/kernels
 1458 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
ArmLayerNormOp.cc
in maga_transformer/cpp/devices/arm_impl
 1337 16 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
moe_kernels.cu
in maga_transformer/cpp/cutlass/cutlass_kernels/moe_gemm
 1245 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
vec_dtypes.cuh
in maga_transformer/cpp/kernels
 1229 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
GptModel.cc
in maga_transformer/cpp/models
 1224 21 2024-03-19 2025-05-07 96 1 rtp-llm@alibaba rtp-llm@alibaba
gemm_microkernel_macro_m8_bf16.h
in maga_transformer/cpp/devices/arm_impl/gemm_opt
 1173 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
layernorm_kernels.cu
in maga_transformer/cpp/kernels/rocm
 1124 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
gen.py
in maga_transformer/cpp/cutlass
 1104 29 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
unfused_attention_fp8_kernels.cu
in maga_transformer/cpp/kernels
 1012 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
inl
moe_kernels.inl
in maga_transformer/cpp/cutlass/cutlass_kernels/moe_gemm
 1005 20 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
layernorm_fp8_kernels.cu
in maga_transformer/cpp/kernels
 998 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
cublasMMWrapper.cc
in maga_transformer/cpp/cuda/cublas
 912 21 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
cublasFP8MMWrapper.cc
in maga_transformer/cpp/cuda/cublas
 882 8 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
moe_gemm_kernels_template.h
in maga_transformer/cpp/cutlass/cutlass_kernels/moe_gemm
 878 20 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
ArmGemmThreadblock.cc
in maga_transformer/cpp/devices/arm_impl/gemm_opt
 875 8 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
OpData.h
in maga_transformer/cpp/devices
 838 4 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
mma_utils.cuh
in maga_transformer/cpp/deep_gemm/include
 809 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
moe_topKSoftmax_kernels.cu
in maga_transformer/cpp/kernels
 798 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
ArmGemmPacking.cc
in maga_transformer/cpp/devices/arm_impl/gemm_opt
 767 12 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
alpha_layernorm_kernels.cu
in maga_transformer/cpp/kernels
 766 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
memory_utils.cu
in maga_transformer/cpp/cuda
 753 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
rotary_position_embedding.h
in maga_transformer/cpp/kernels
 720 42 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
fused_moe_kernel_routine.cuh
in maga_transformer/cpp/cutlass/cutlass_extensions/include/cutlass_extensions/gemm/kernel
 717 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
activation_kernels.cu
in maga_transformer/cpp/kernels
 711 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
GenerateStream.cc
in maga_transformer/cpp/stream
 688 108 2024-09-12 2025-05-07 43 1 rtp-llm@alibaba rtp-llm@alibaba
cuda_utils.cc
in maga_transformer/cpp/cuda
 683 26 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
layernorm_kernels.cu
in maga_transformer/cpp/kernels
 652 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
no_aux_tc_kernels.cu
in maga_transformer/cpp/kernels
 646 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
DecodeRpcServer.cc
in maga_transformer/cpp/model_rpc
 638 16 2024-10-09 2025-05-07 21 1 rtp-llm@alibaba rtp-llm@alibaba
CudaDevice.cc
in maga_transformer/cpp/devices/cuda_impl
 619 31 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
ArmAttentionOp.cc
in maga_transformer/cpp/devices/arm_impl
 610 15 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
sampling_penalty_kernels.cu
in maga_transformer/cpp/kernels
 607 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
DeepEPBuffer.cc
in maga_transformer/cpp/devices/cuda_impl
 603 19 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba
SpeculativeEngine.cc
in maga_transformer/cpp/speculative_engine
 576 24 2024-04-22 2025-05-07 34 1 rtp-llm@alibaba rtp-llm@alibaba
sampling_topk_kernels.cu
in maga_transformer/cpp/kernels
 575 - 2025-05-07 2025-05-07 1 1 rtp-llm@alibaba rtp-llm@alibaba