TensorRT-LLMs/tensorrt_llm
Yukun He 979f37e443
[None][fix] Fix nvfp4 gemm allowed backends arg passing (#9837)
Signed-off-by: Yukun He <23156053+hyukn@users.noreply.github.com>
2025-12-09 20:09:53 -08:00
..
_tensorrt_engine
_torch [None][fix] Fix nvfp4 gemm allowed backends arg passing (#9837) 2025-12-09 20:09:53 -08:00
bench [TRTLLM-9089][chore] Port prepare_dataset into trtllm-bench (#9250) 2025-12-08 10:37:40 -08:00
commands [TRTLLM-9089][chore] Port prepare_dataset into trtllm-bench (#9250) 2025-12-08 10:37:40 -08:00
evaluate [None][feat] Add RocketKV usage doc and e2e accuracy test on LongBenchV2 (#9572) 2025-12-03 11:33:46 +08:00
executor [None][fix] enable hmac in RPC (#9745) 2025-12-07 08:24:46 +08:00
inputs [TRTLLM-9522][chore] implement default attach_multimodal_embeddings (#9664) 2025-12-05 22:12:16 -08:00
layers [#9236][feature] Make sharing of activation_type across SW layers more robust (#9238) 2025-11-20 16:06:58 +08:00
llmapi [https://nvbugs/5508301][feat] Move D->H copies to a worker thread whe… (#8463) 2025-12-09 18:51:31 -05:00
metrics [None][feat] Add trtllm_ prefix for exposed metrics (#8845) 2025-11-06 15:27:18 +08:00
models [TRTLLM-8684][chore] Migrate BuildConfig to Pydantic, add a Python wrapper for KVCacheType enum (#8330) 2025-10-28 09:17:26 -07:00
plugin [None][chore] Revert "[None][fix] change allreduce workspace dtype to torch.int64 t… (#9538) 2025-11-28 16:45:23 +08:00
quantization [OMNIML-2932] [feat] nvfp4 awq support (#8698) 2025-12-03 19:47:13 +02:00
runtime [TRTLLM-8684][chore] Migrate BuildConfig to Pydantic, add a Python wrapper for KVCacheType enum (#8330) 2025-10-28 09:17:26 -07:00
scaffolding [None][feat] Deep Research Implemented with Scaffolding (#8452) 2025-11-06 10:33:28 +08:00
serve [https://nvbugs/5703953][fix] Preserving ip:port for trtllm-serve before initializing llm (#9646) 2025-12-06 20:13:48 -08:00
tools [None][feat] Add weights initialization and context phase parser to layer-wise benchmarks (#9667) 2025-12-04 13:41:15 +08:00
__init__.py [None] [fix] Disable UCC as WAR to MPI allgather issue before NGC PyTorch 25.12 upgrade (#9126) 2025-11-13 02:25:30 -08:00
_common.py
_dlpack_utils.py
_ipc_utils.py
_mnnvl_utils.py
_ray_utils.py [TRTLLM-8511][feat] Add update_weights and sleep_wakeup support for rl integration (#8302) 2025-11-04 10:19:24 -08:00
_utils.py [https://nvbugs/5508301][feat] Move D->H copies to a worker thread whe… (#8463) 2025-12-09 18:51:31 -05:00
builder.py [TRTLLM-8684][chore] Migrate BuildConfig to Pydantic, add a Python wrapper for KVCacheType enum (#8330) 2025-10-28 09:17:26 -07:00
disaggregated_params.py
functional.py [#8921][feat] Added symetric memory AllReduce strategy (#8919) 2025-12-08 13:12:56 -08:00
graph_rewriting.py
logger.py
lora_helper.py
lora_manager.py
mapping.py [TRTLLM-9466][test] Evaluate helix parallelism with DSV3 Lite (#9597) 2025-12-02 20:10:07 +08:00
math_utils.py
module.py
network.py
parameter.py
profiler.py
prompt_adapter_manager.py
python_plugin.py
ray_stub.py
sampling_params.py [TRTLLM-6756][feat] Update BeamSearch for TorchSampler (#9660) 2025-12-09 10:44:01 +01:00
scheduling_params.py
serialization.py
top_model_mixin.py
version.py [None][chore] Bump version to 1.2.0rc5 (#9455) 2025-11-26 08:37:53 +08:00