kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
953f4fd69e
TensorRT-LLMs/tensorrt_llm/_torch/auto_deploy
History
Shunkangz 54ec2c1af1
[None][opt] Add batch wait timeout in fetching requests (#6923) 
Signed-off-by: Shunkang <182541032+Shunkangz@users.noreply.github.co>
2025-08-19 03:50:08 -04:00
..
compile [#5048][enhance] AutoDeploy: Optimize prepare_inputs (#6634) 2025-08-10 13:55:04 +03:00
config [#4403][autodeploy] Refactor: Move more transformations to new inf optimizer, Add quantization_source to factory interface (#6760) 2025-08-11 22:02:46 -07:00
custom_ops [#5048][enhance] AutoDeploy: Optimize prepare_inputs (#6634) 2025-08-10 13:55:04 +03:00
distributed [AutoDeploy] merge feat/ad-2025-07-22 (#6520) 2025-08-01 08:51:08 -07:00
export [AutoDeploy] merge feat/ad-2025-07-07 (#6196) 2025-07-23 05:11:04 +08:00
models [None][feat] Add GPT OSS support for AutoDeploy (#6641) 2025-08-12 14:03:22 -04:00
shim [None][opt] Add batch wait timeout in fetching requests (#6923) 2025-08-19 03:50:08 -04:00
transform [#4403][autodeploy] Refactor: Move more transformations to new inf optimizer, Add quantization_source to factory interface (#6760) 2025-08-11 22:02:46 -07:00
transformations [#4403][autodeploy] Refactor: Move more transformations to new inf optimizer, Add quantization_source to factory interface (#6760) 2025-08-11 22:02:46 -07:00
utils [#4403][autodeploy] Refactor: Move more transformations to new inf optimizer, Add quantization_source to factory interface (#6760) 2025-08-11 22:02:46 -07:00
__init__.py [AutoDeploy] merge feat/ad-2025-07-07 (#6196) 2025-07-23 05:11:04 +08:00
llm_args.py [None][test] Add accuracy evaluation for AutoDeploy (#6764) 2025-08-15 13:46:09 -04:00
llm.py [AutoDeploy] merge feat/ad-2025-06-13 (#5556) 2025-06-29 03:52:14 +08:00