TensorRT-LLMs/tensorrt_llm/_torch/speculative
Netanel Haber d9a3530048
[nvbug/5393888][nvbug/5393042] Always use py_seq_slot (#6147)
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
2025-07-18 22:45:16 +03:00
..
__init__.py [fix] Remove SpecConfig and fix thread leak issues (#5931) 2025-07-12 21:03:24 +09:00
drafter.py [TRTLLM-6352][feat] Migrate EAGLE3 and draft/target speculation to Drafter (#6007) 2025-07-17 21:15:01 +08:00
eagle3.py [https://nvbugs/5355316] fix: update torch.compile option to fix triton store_cubin error (#5865) 2025-07-14 17:17:30 +08:00
interface.py [fix] Remove SpecConfig and fix thread leak issues (#5931) 2025-07-12 21:03:24 +09:00
model_drafter.py [TRTLLM-6352][feat] Migrate EAGLE3 and draft/target speculation to Drafter (#6007) 2025-07-17 21:15:01 +08:00
mtp.py [nvbug/5393888][nvbug/5393042] Always use py_seq_slot (#6147) 2025-07-18 22:45:16 +03:00
ngram.py [TRTLLM-6352][feat] Migrate EAGLE3 and draft/target speculation to Drafter (#6007) 2025-07-17 21:15:01 +08:00
utils.py [TRTLLM-6352][feat] Migrate EAGLE3 and draft/target speculation to Drafter (#6007) 2025-07-17 21:15:01 +08:00