pcastonguay ae5671644a feat: Disaggregated router class (#3584) ... * Add draft scheduler class Signed-off-by: Shunkang <182541032+Shunkangz@users.noreply.github.co> * Refactor the design Signed-off-by: Shunkang <182541032+Shunkangz@users.noreply.github.co> * feat: Introduce router class for disaggregated server Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com> * Add unit tests for router class Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com> * Adding tests for disagg_utils Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com> * Fixing missing import Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com> * Fixing disagg integration tests Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com> * Addressing MR review comments Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com> --------- Signed-off-by: Shunkang <182541032+Shunkangz@users.noreply.github.co> Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com> Co-authored-by: Shunkang <182541032+Shunkangz@users.noreply.github.co>		2025-04-19 00:34:12 +08:00
..
__init__.py	Update TensorRT-LLM (#613)	2023-12-08 17:49:24 +08:00
bench.py	Update TensorRT-LLM (#2849)	2025-03-04 18:44:00 +08:00
build.py	Update (#2978)	2025-03-23 16:39:35 +08:00
eval.py	test: Accuracy test improvement (Part 3.1): Extend accuracy test suite with LLM API and initial implementation of trtllm-eval (#3167)	2025-04-01 22:20:29 +08:00
prune.py	Update TensorRT-LLM (#2008)	2024-07-23 23:05:09 +08:00
refit.py	Update TensorRT-LLM (#2532)	2024-12-04 21:16:56 +08:00
serve.py	feat: Disaggregated router class (#3584)	2025-04-19 00:34:12 +08:00