pcastonguay ae5671644a feat: Disaggregated router class (#3584) ... * Add draft scheduler class Signed-off-by: Shunkang <182541032+Shunkangz@users.noreply.github.co> * Refactor the design Signed-off-by: Shunkang <182541032+Shunkangz@users.noreply.github.co> * feat: Introduce router class for disaggregated server Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com> * Add unit tests for router class Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com> * Adding tests for disagg_utils Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com> * Fixing missing import Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com> * Fixing disagg integration tests Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com> * Addressing MR review comments Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com> --------- Signed-off-by: Shunkang <182541032+Shunkangz@users.noreply.github.co> Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com> Co-authored-by: Shunkang <182541032+Shunkangz@users.noreply.github.co>		2025-04-19 00:34:12 +08:00
..
__init__.py	chore: refactor the LlmArgs with Pydantic and migrate remaining pybinding configs to python (#3025)	2025-04-05 13:31:48 +08:00
_perf_evaluator.py	Add thread leak check and fix thread/memory leak issues. (#3270)	2025-04-08 19:03:18 +08:00
build_cache.py	Update TensorRT-LLM (#2413)	2024-11-05 16:27:06 +08:00
disagg_utils.py	feat: Disaggregated router class (#3584)	2025-04-19 00:34:12 +08:00
llm_args.py	chore: remove usernames from comments (#3291)	2025-04-05 13:44:28 +08:00
llm_utils.py	fix: LLM API _hf_model_dir for non-cached case (#3562)	2025-04-16 10:39:34 +08:00
llm.py	chore: Unify Python NVTX call (#3450)	2025-04-15 23:25:36 +08:00
mgmn_leader_node.py	Update (#2978)	2025-03-23 16:39:35 +08:00
mgmn_worker_node.py	Update TensorRT-LLM (#2333)	2024-10-15 15:28:40 +08:00
mpi_session.py	fix hmac in remote mpi session (#3649)	2025-04-18 17:47:51 +08:00
tokenizer.py	Update TensorRT-LLM (#2873)	2025-03-11 21:13:42 +08:00
tracer.py	Update TensorRT-LLM (#2413)	2024-11-05 16:27:06 +08:00
trtllm-llmapi-launch	fix hmac in remote mpi session (#3649)	2025-04-18 17:47:51 +08:00
utils.py	chore: Unify Python NVTX call (#3450)	2025-04-15 23:25:36 +08:00