TensorRT-LLMs/tests/unittest/_torch
mpikulski cddc7549d1
[TRTLLM-9191][feat] support out-of-tree models in trtllm-serve (#9269)
Signed-off-by: ixlmar <206748156+ixlmar@users.noreply.github.com>
2025-11-21 04:23:47 -08:00
..
attention [None][fix] Use fp32 for indexer weight_proj GEMM (#9243) 2025-11-19 21:52:38 -08:00
auto_deploy [#9237][feat] enable iter stats in autodeploy (#9278) 2025-11-19 19:29:29 +01:00
compilation [TRTLLM-3105][feat] Add Piecewise CUDA Graph Support (#3804) 2025-05-09 11:04:01 +08:00
debugger Fix: fix nvbug 5356427 (#5464) 2025-06-25 22:24:26 +08:00
executor [TRTLLM-8650][fix] beam search request validation (#8433) (#9228) 2025-11-21 04:08:45 -08:00
misc [TRTLLM-7963][feat] Use CUDAGraph to improve the tuning accuracy for AutoTuner. (#9089) 2025-11-20 08:54:29 +08:00
modeling [TRTLLM-9191][feat] support out-of-tree models in trtllm-serve (#9269) 2025-11-21 04:23:47 -08:00
models/checkpoints/hf [None][feat] Skip prefetching consolidated safetensors when appropriate (#7013) 2025-08-25 23:56:21 -04:00
modules [None][feat] Update TRTLLM MoE cubins; reduce mxfp4 weight padding requirement; tighten TMA bound (#9025) 2025-11-17 10:04:29 +08:00
multi_gpu [https://nvbugs/5515753][ci] Add NCCL_DEBUG=INFO flag to collect more info with CI failure. (#8440) 2025-11-20 12:43:13 -05:00
multi_gpu_modeling [https://nvbugs/5515753][ci] Add NCCL_DEBUG=INFO flag to collect more info with CI failure. (#8440) 2025-11-20 12:43:13 -05:00
multimodal [None][fix] InputProcessor config naming convention fix (#8705) 2025-11-03 22:29:21 -08:00
ray_orchestrator [None][chore] Add placement test for ray executor (#9122) 2025-11-14 23:10:59 -08:00
sampler [TRTLLM-8650][fix] beam search request validation (#8433) (#9228) 2025-11-21 04:08:45 -08:00
speculative [https://nvbugs/5590408][fix] Exclude num of draft tokens from mMaxSeqLenKv (#9210) 2025-11-18 15:41:56 -05:00
thop [None][infra] Remove invaild waived tests which not in release branch (#8841) 2025-11-20 12:43:13 -05:00
helpers.py [TRTLLM-8521][chore] remove circular dependency between model engine and cuda graph runner (#7572) 2025-11-11 10:13:45 -08:00
pattern_watcher.py [TRTLLM-3105][feat] Add Piecewise CUDA Graph Support (#3804) 2025-05-09 11:04:01 +08:00
test_connector.py [None][feat] KV Cache Connector API (#7228) 2025-08-28 23:09:27 -04:00