kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
6021a439ab
TensorRT-LLMs/tensorrt_llm/_torch/auto_deploy
History
Daniel Stokes 83a1f60556
feat: Expose bias and FP8_MXFP4 MOE CUTLASS backend features to pytorch (#5410) 
Signed-off-by: Daniel Stokes <40156487+djns99@users.noreply.github.com>
2025-06-27 12:29:34 +08:00
..
compile [AutoDeploy]feat: Add an AutoDeploy compile backend that only calls torch.compile (#4240) 2025-05-16 08:38:15 +08:00
custom_ops feat: Expose bias and FP8_MXFP4 MOE CUTLASS backend features to pytorch (#5410) 2025-06-27 12:29:34 +08:00
distributed Use backend to replace macro to control enablement of MNNVL all reduce (#4635) 2025-06-12 11:22:49 +08:00
models [AutoDeploy] Merge feat/ad_2025_06_13 feature branch (#5454) 2025-06-25 09:30:13 +08:00
shim Revert "feature: unify new_tokens format sample state to trtllm samper new_tokens format (#4401)" (#5474) 2025-06-25 20:56:04 -07:00
transformations [AutoDeploy] Merge feat/ad_2025_06_13 feature branch (#5454) 2025-06-25 09:30:13 +08:00
utils [AutoDeploy] Merge feat/ad_2025_06_13 feature branch (#5454) 2025-06-25 09:30:13 +08:00
__init__.py Update TensorRT-LLM (#2820) 2025-02-25 21:21:49 +08:00