pcastonguay b763051ba4 chore: Refactor disaggregated serving scripts (#3073) ... * chore: Refactor to reduce duplicated code in disagg server, reuse trtllm-serve Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com> * Updating README, removing launch script Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com> * Fixing integration tests Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com> * Adding scripts to populate urls section of disagg config based on SLURM env vars Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com> --------- Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com>		2025-04-03 14:55:05 -04:00
..
__init__.py	test: Accuracy test improvement (Part 3.1): Extend accuracy test suite with LLM API and initial implementation of trtllm-eval (#3167)	2025-04-01 22:20:29 +08:00
_perf_evaluator.py	Update TensorRT-LLM (#2849)	2025-03-04 18:44:00 +08:00
build_cache.py	Update TensorRT-LLM (#2413)	2024-11-05 16:27:06 +08:00
disagg_utils.py	chore: Refactor disaggregated serving scripts (#3073)	2025-04-03 14:55:05 -04:00
llm_args.py	test: Accuracy test improvement (Part 3.1): Extend accuracy test suite with LLM API and initial implementation of trtllm-eval (#3167)	2025-04-01 22:20:29 +08:00
llm_utils.py	test: Accuracy test improvement (Part 3.1): Extend accuracy test suite with LLM API and initial implementation of trtllm-eval (#3167)	2025-04-01 22:20:29 +08:00
llm.py	Refactor return of first gen token in PD (#2986)	2025-04-01 12:28:27 +08:00
mgmn_leader_node.py	Update (#2978)	2025-03-23 16:39:35 +08:00
mgmn_worker_node.py	Update TensorRT-LLM (#2333)	2024-10-15 15:28:40 +08:00
mpi_session.py	Update (#2978)	2025-03-23 16:39:35 +08:00
tokenizer.py	Update TensorRT-LLM (#2873)	2025-03-11 21:13:42 +08:00
tracer.py	Update TensorRT-LLM (#2413)	2024-11-05 16:27:06 +08:00
trtllm-llmapi-launch	Update (#2978)	2025-03-23 16:39:35 +08:00
utils.py	Update TensorRT-LLM (#2755)	2025-02-11 03:01:00 +00:00