..
_torch
[TRTLLM-3330][feat] Support DeepSeek-R1 W4A8 on Hopper ( #4123 )
2025-05-14 15:48:07 +08:00
auto_parallel
fix: Fix NVLink version decoding. ( #3996 )
2025-05-06 13:56:50 +08:00
bench
[TRTLLM-5233][feat]: Add chunking to PyT heuristic for trtllm-bench. ( #4133 )
2025-05-13 21:47:06 +08:00
commands
feat: add kv cache aware router ( #3831 )
2025-05-12 07:23:57 -04:00
evaluate
[TRTLLM-4480][doc] Documentation for new accuracy test suite and trtllm-eval ( #3946 )
2025-05-08 19:35:23 +08:00
executor
[TRTLLM-5050][feat] Enable per-request stats with PyT backend ( #4156 )
2025-05-12 21:35:15 -04:00
inputs
[TRTLLM-3925, https://nvbugs/5245262 ] [fix] Normalize LLM.generate API ( #3985 )
2025-05-07 11:06:23 +08:00
layers
[TRTLLM-3330][feat] Support DeepSeek-R1 W4A8 on Hopper ( #4123 )
2025-05-14 15:48:07 +08:00
llmapi
feat: add kv cache aware router ( #3831 )
2025-05-12 07:23:57 -04:00
models
feat: Support Mistral Small 3.1 24B VLM in TRT workflow ( #4183 )
2025-05-14 03:47:22 +08:00
plugin
fix: [nvbug/5241627] Fix AllReduce kernel hang issue when both tp and pp are enabled. ( #3988 )
2025-05-05 11:33:25 +08:00
quantization
chore: bump version to 0.19.0 ( #3598 ) ( #3841 )
2025-04-29 16:57:22 +08:00
runtime
feat: Support Mistral Small 3.1 24B VLM in TRT workflow ( #4183 )
2025-05-14 03:47:22 +08:00
scaffolding
[TRTLLM-4911] feat(scaffolding): make sampling_params only setable by controller ( #4151 )
2025-05-12 15:29:09 +08:00
serve
feat: add kv cache aware router ( #3831 )
2025-05-12 07:23:57 -04:00
tools
feat: Support Mistral Small 3.1 24B VLM in TRT workflow ( #4183 )
2025-05-14 03:47:22 +08:00
__init__.py
fix: revert https://github.com/NVIDIA/TensorRT-LLM/pull/3858 ( #3928 )
2025-04-29 11:26:13 +08:00
_common.py
Update ( #2978 )
2025-03-23 16:39:35 +08:00
_dlpack_utils.py
feat: Add MNNVL MoE A2A support ( #3504 )
2025-04-25 17:29:08 +08:00
_ipc_utils.py
fix: Proper error bubbling for PyExecutor ( #3321 )
2025-04-15 14:49:46 +08:00
_mnnvl_utils.py
feat: Add MNNVL MoE A2A support ( #3504 )
2025-04-25 17:29:08 +08:00
_utils.py
[TRTLLM-3105][feat] Add Piecewise CUDA Graph Support ( #3804 )
2025-05-09 11:04:01 +08:00
builder.py
chore: remove usernames from comments ( #3291 )
2025-04-05 13:44:28 +08:00
disaggregated_params.py
Update TensorRT-LLM ( #2936 )
2025-03-18 21:25:19 +08:00
functional.py
Support RingAttention in the BertAttention plugin and the DiT model ( #3661 )
2025-05-09 08:06:54 +08:00
graph_rewriting.py
Update TensorRT-LLM ( #2755 )
2025-02-11 03:01:00 +00:00
logger.py
Update TensorRT-LLM ( #2873 )
2025-03-11 21:13:42 +08:00
lora_manager.py
feat: support multi lora adapters and TP ( #3885 )
2025-05-08 23:45:45 +08:00
mapping.py
Add smart router for moe ( #3641 )
2025-04-23 12:21:59 +08:00
module.py
Update ( #2978 )
2025-03-23 16:39:35 +08:00
network.py
chore: remove usernames from comments ( #3291 )
2025-04-05 13:44:28 +08:00
parameter.py
Update TensorRT-LLM ( #2873 )
2025-03-11 21:13:42 +08:00
profiler.py
test [TRTLLM-4477,TRTLLM-4481]: Accuracy test improvement (Part 3.5): Support GSM8K and GPQA ( #3483 )
2025-04-22 07:38:16 +08:00
prompt_adapter_manager.py
Update TensorRT-LLM ( #2333 )
2024-10-15 15:28:40 +08:00
python_plugin.py
Update TensorRT-LLM ( #2755 )
2025-02-11 03:01:00 +00:00
sampling_params.py
feat: Support the Structural Tag in guided decoding ( #4066 )
2025-05-12 17:24:50 +08:00
top_model_mixin.py
Update TensorRT-LLM ( #2053 )
2024-07-30 21:25:01 +08:00
version.py
chore: bump version to 0.20.0rc3 ( #4261 )
2025-05-14 10:15:25 +08:00
20b42912ce