pcastonguay e7ae5e2824 feat: Add support for disaggregation with pp with pytorch backend (#6369) ... Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com> Signed-off-by: raayandhar <rdhar@nvidia.com> Signed-off-by: Lizhi Zhou <1432185+reasonsolo@users.noreply.github.com> Signed-off-by: pcastonguay <55748270+pcastonguay@users.noreply.github.com> Co-authored-by: raayandhar <rdhar@nvidia.com> Co-authored-by: Lizhi Zhou <1432185+reasonsolo@users.noreply.github.com> Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>		2025-07-30 09:42:13 -04:00
..
__init__.py	Update TensorRT-LLM (#2755)	2025-02-11 03:01:00 +00:00
_util.py	chore: remove draft_model_engine from init parameter list of PyExecutor (#6325)	2025-07-30 03:31:49 -04:00
config_utils.py	feat: support kv cache reuse for MLA (#3571)	2025-05-15 15:22:21 +08:00
config.py	[TRTLLM-4279] feat: Multistream initial support for torch compile flow (#5847)	2025-07-21 19:10:22 +08:00
cuda_graph_runner.py	[refactor] Simplification of Speculative decoding configs (#5639)	2025-07-10 11:37:30 -04:00
executor_request_queue.py	chore: remove unused variables in pyexecutor (#6280)	2025-07-24 13:16:15 +08:00
finish_reason.py	[TRTLLM-5974][feat] Support disaggregated serving in TRTLLM Sampler (#5328)	2025-06-25 17:41:36 +02:00
grammar_matcher.py	feat: TRTLLM-5941 Upgrade xgrammar to 0.1.18 (#5364)	2025-07-01 20:12:55 +08:00
guided_decoder.py	[TRTLLM-6406] feat: Enable guided decoding with overlap scheduler (#6000)	2025-07-17 17:46:10 +08:00
handle_logits.py	feat: Optimize TRTLLM Sampler perf single beam single step (#5550)	2025-07-07 15:44:47 +02:00
kv_cache_transceiver.py	feat: Add support for disaggregation with pp with pytorch backend (#6369)	2025-07-30 09:42:13 -04:00
layerwise_nvtx_marker.py	Update TensorRT-LLM (#2849)	2025-03-04 18:44:00 +08:00
llm_request.py	[TRTLLM-6453][feat] Support chunked prefill on spec decode 2 model (#6104)	2025-07-24 21:50:11 -04:00
make_decoding_batch_input_output.py	feat: Optimize TRTLLM Sampler perf single beam single step (#5550)	2025-07-07 15:44:47 +02:00
model_engine.py	[https://nvbugs/5402719][fix]: Add cuda graph dummy requests to the spec_resource_manager (#6258)	2025-07-26 20:32:39 -04:00
py_executor_creator.py	chore: remove draft_model_engine from init parameter list of PyExecutor (#6325)	2025-07-30 03:31:49 -04:00
py_executor.py	feat: Add support for disaggregation with pp with pytorch backend (#6369)	2025-07-30 09:42:13 -04:00
resource_manager.py	feat: Add support for disaggregation with pp with pytorch backend (#6369)	2025-07-30 09:42:13 -04:00
sampler.py	[TRTLLM-6651][feat] Enable Overlap scheduler + Beam Search in TRTLLM Sampler (#6223)	2025-07-23 12:30:50 +02:00
scheduler.py	[TRTLLM-5826][feat] Support pytorch LoRA adapter eviction (#5616)	2025-07-20 08:00:14 +03:00
seq_slot_manager.py	feat: Optimize TRTLLM Sampler perf single beam single step (#5550)	2025-07-07 15:44:47 +02:00