kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-02-12 05:53:33 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
7bc2d9e993
TensorRT-LLMs/tests/unittest/_torch
History
Ziyi Xiong 7bc2d9e993
[https://nvbugs/5537878][fix] Reserve an extra slot for padded batch (#7998) 
Signed-off-by: ziyixiong-nv <219238287+ziyixiong-nv@users.noreply.github.com>
2025-10-03 08:42:52 -07:00
..
attention [https://nvbugs/5453806][unwaive] Unwaive fp8 kvcache attention test (#7243) 2025-09-05 12:13:57 -04:00
auto_deploy [#5860][feat] Add ModelOPT INT4 awq fake quant support in AutoDeploy (#7770) 2025-10-01 13:13:45 -07:00
compilation [TRTLLM-3105][feat] Add Piecewise CUDA Graph Support (#3804) 2025-05-09 11:04:01 +08:00
debugger Fix: fix nvbug 5356427 (#5464) 2025-06-25 22:24:26 +08:00
executor [TRTLLM-7733][feat] Executor changes to support helix parallelism (#7972) 2025-10-01 22:13:03 -04:00
misc [TRTLLM-4500][feat] Add serialization/deserialization options for AutoTuner profiling cache (#7738) 2025-09-29 07:40:51 +08:00
modeling [TRTLLM-8031][feat] Add chunked return_generation_logits logic (#7831) 2025-10-01 12:47:07 -04:00
models/checkpoints/hf [None][feat] Skip prefetching consolidated safetensors when appropriate (#7013) 2025-08-25 23:56:21 -04:00
modules [OMNIML-2336][feat] add W4A8 NVFP4 FP8 fused moe (#7968) 2025-10-01 02:39:33 -04:00
multi_gpu [TRTLLM-5966][feat] Helix: add alltoall op (#6815) 2025-09-25 07:18:29 -07:00
multi_gpu_modeling [https://nvbugs/5516710][fix] fix Llama 3.3 TP PP case (#7717) 2025-09-25 21:02:35 +08:00
multimodal [https://nvbugs/5542867][fix] Fix the non-determinism issue in the mm_encoder test (#8033) 2025-09-29 09:45:16 -07:00
sampler [TRTLLM-7155][feat] Unify sampler handle logits implementation. (#6867) 2025-08-22 08:09:30 +02:00
speculative [https://nvbugs/5537878][fix] Reserve an extra slot for padded batch (#7998) 2025-10-03 08:42:52 -07:00
thop [TRTLLM-7775][feat] Integrate tinygemm2 for gpt-oss (#7916) 2025-10-02 10:47:04 -07:00
helpers.py [TRTLLM-7330][feat] Eagle3 cuda graph support for the first draft model inference (#7363) 2025-09-26 11:28:05 +08:00
pattern_watcher.py [TRTLLM-3105][feat] Add Piecewise CUDA Graph Support (#3804) 2025-05-09 11:04:01 +08:00
test_connector.py [None][feat] KV Cache Connector API (#7228) 2025-08-28 23:09:27 -04:00