Kaiyu Xie 2898d268f9 feat: add health_generate route to openai serving (Cherry-pick https://github.com/NVIDIA/TensorRT-LLM/pull/3856) (#4349) ... Cherry-pick https://github.com/NVIDIA/TensorRT-LLM/pull/3856 Signed-off-by: Kaiyu Xie <26294424+kaiyux@users.noreply.github.com> Co-authored-by: Dhruv Singal <dhruvsingalabc@gmail.com>		2025-05-22 11:46:06 +08:00
..
_torch	Adding two-shot allreduce kernel and mnnvl multicasting buffer (#4216)	2025-05-22 03:42:36 +08:00
api_stability	[TRTLLM-5000][feat] Pytorch implementation of ngram drafter (#3936)	2025-05-21 10:40:00 +08:00
bindings	feat: large-scale EP(part 2: MoE Load Balancer - core utilities) (#4384)	2025-05-20 17:53:48 +08:00
disaggregated	feat: conditional disaggregation in disagg server (#3974)	2025-05-21 09:57:46 +08:00
llmapi	feat: add health_generate route to openai serving (Cherry-pick https://github.com/NVIDIA/TensorRT-LLM/pull/3856) (#4349)	2025-05-22 11:46:06 +08:00
others	test: reorganize tests folder hierarchy (#2996)	2025-03-27 12:07:53 +08:00
scaffolding	[TRTLLM-4638] feat(scaffolding): update Reward Controller to PRM specific controller with step split (#4337)	2025-05-19 17:53:41 +08:00
tools	Update TensorRT-LLM (#2936)	2025-03-18 21:25:19 +08:00
trt	[TRTLLM-3330][feat] Support DeepSeek-R1 W4A8 on Hopper (#4123)	2025-05-14 15:48:07 +08:00
utils	add changes for fp8, nemotron-nas, API (#4180)	2025-05-18 23:27:25 +08:00
conftest.py	Add thread leak check and fix thread/memory leak issues. (#3270)	2025-04-08 19:03:18 +08:00
dump_checkpoint_stats.py	Update TensorRT-LLM (#2936)	2025-03-18 21:25:19 +08:00
profile_utils.py	Update TensorRT-LLM (#2936)	2025-03-18 21:25:19 +08:00
pytest.ini	move the reset models into examples/models/core directory (#3555)	2025-04-19 20:48:59 -07:00
test_model_runner_cpp.py	Update TensorRT-LLM (#2936)	2025-03-18 21:25:19 +08:00
test_pip_install.py	relax the limitation of setuptools (#2992)	2025-03-24 13:36:10 +08:00