TensorRT-LLMs/tensorrt_llm/_torch/auto_deploy
Bo Li f414a079ad
chore: Change the type annotations of input_ids and position_ids to int32. (#4632)
Signed-off-by: Bo Li <22713281+bobboli@users.noreply.github.com>
2025-06-07 16:10:47 +08:00
..
compile [AutoDeploy]feat: Add an AutoDeploy compile backend that only calls torch.compile (#4240) 2025-05-16 08:38:15 +08:00
custom_ops [AutoDeploy] _AutoDeployLlmArgs as primary config object (#4891) 2025-06-05 17:20:55 +08:00
distributed [AutoDeploy] Increased Model Coverage Mass Migration Week 1 (#4468) 2025-05-27 16:43:15 +08:00
models chore: Change the type annotations of input_ids and position_ids to int32. (#4632) 2025-06-07 16:10:47 +08:00
shim [AutoDeploy] _AutoDeployLlmArgs as primary config object (#4891) 2025-06-05 17:20:55 +08:00
transformations [AutoDeploy] _AutoDeployLlmArgs as primary config object (#4891) 2025-06-05 17:20:55 +08:00
utils [AutoDeploy] Increased Model Coverage Mass Migration Week 2 (#4817) 2025-06-01 14:40:29 +08:00
__init__.py Update TensorRT-LLM (#2820) 2025-02-25 21:21:49 +08:00