| .. |
|
attention_backend
|
[TRTLLM-8803][feat] Add rope and uk-bgemm overlap for mla generation (#8495)
|
2025-11-06 17:39:57 +08:00 |
|
auto_deploy
|
[None][feat] AutoDeploy: Support Latent MOE for Nemotron (#8955)
|
2025-11-06 12:40:19 -08:00 |
|
compilation
|
[https://nvbugs/5550409][fix] Disable torch compile in piecewise attention part to Avoid host overhead (#8708)
|
2025-10-29 18:12:58 +08:00 |
|
configs
|
[TRTLLM-8535][feat] Support DeepSeek V3.2 with FP8 + BF16 KV cache/NVFP4 + BF16 KV cache (#8405)
|
2025-10-24 13:40:41 -04:00 |
|
custom_ops
|
[TRTLLM-8803][feat] Add rope and uk-bgemm overlap for mla generation (#8495)
|
2025-11-06 17:39:57 +08:00 |
|
cute_dsl_kernels
|
|
|
|
debug
|
|
|
|
distributed
|
[None][feat] MNNVLAllreduce Kernel Refactor (#8018)
|
2025-11-05 08:49:47 +08:00 |
|
models
|
[TRTLLM-8768][chore] Fuse QK down_proj with indexer K + weight_proj for FP4 ckpt (#8771)
|
2025-11-05 07:57:09 -08:00 |
|
modules
|
[https://nvbugspro.nvidia.com/bug/5637012][fix] Bugfix when config is None for MLA (#8978)
|
2025-11-07 09:37:19 +08:00 |
|
peft
|
|
|
|
pyexecutor
|
[None][fix] Fix KV cache clearing with KV Connector API (#8750)
|
2025-11-06 14:28:27 -08:00 |
|
shared_tensor
|
|
|
|
speculative
|
[https://nvbugs/5534574][fix] disable spec decoding forever once the request spec decoding is disabled (#8446)
|
2025-10-29 19:28:43 +08:00 |
|
__init__.py
|
|
|
|
autotuner.py
|
[https://nvbugs/5623960][fix] Fix the logger once key issue and further compress log in AutoTuner. (#8873)
|
2025-11-05 15:25:43 +08:00 |
|
cublaslt_utils.py
|
[https://nvbugs/5451205][feat] Add cuBLASLt NVFP4 GEMM backend support (#7943)
|
2025-10-23 15:55:10 +08:00 |
|
cute_dsl_utils.py
|
|
|
|
device_mesh.py
|
[TRTLLM-8682][chore] Remove auto_parallel module (#8329)
|
2025-10-22 20:53:08 -04:00 |
|
expert_statistic.py
|
|
|
|
flashinfer_utils.py
|
|
|
|
hostfunc.py
|
|
|
|
llm.py
|
|
|
|
memory_buffer_utils.py
|
[TRTLLM-8690][feat] add more tensors to share buffers (#8691)
|
2025-11-03 21:08:01 -08:00 |
|
metadata.py
|
|
|
|
model_config.py
|
[https://nvbugs/5558117][fix] Allow per-layer quant config from hf_quant_config.json (#8617)
|
2025-10-31 04:41:44 -07:00 |
|
utils.py
|
[https://nvbugs/5550409][fix] Disable torch compile in piecewise attention part to Avoid host overhead (#8708)
|
2025-10-29 18:12:58 +08:00 |
|
virtual_memory.py
|
[TRTLLM-8511][feat] Add update_weights and sleep_wakeup support for rl integration (#8302)
|
2025-11-04 10:19:24 -08:00 |
1c19fd6868