TensorRT-LLMs/tensorrt_llm/llmapi
YueWeng b1621e8d4e
feat: add relaxed acceptance for DS (#3865)
* add relaxed acceptance for DS R1

Signed-off-by: Yue Weng <25103990+yweng0828@users.noreply.github.com>

* clean and update docs

Signed-off-by: Yue Weng <25103990+yweng0828@users.noreply.github.com>

* fix

Signed-off-by: Yue Weng <25103990+yweng0828@users.noreply.github.com>

* Modified based on review

Signed-off-by: Yue Weng <25103990+yweng0828@users.noreply.github.com>

* fix mtp manager issue

Signed-off-by: Yue Weng <25103990+yweng0828@users.noreply.github.com>

---------

Signed-off-by: Yue Weng <25103990+yweng0828@users.noreply.github.com>
Co-authored-by: Fanrong Li <23290157+lfr-0531@users.noreply.github.com>
2025-05-01 21:50:36 +08:00
..
__init__.py cacheTransceiver buffer manager (#3798) 2025-04-27 11:48:15 +08:00
_perf_evaluator.py Add thread leak check and fix thread/memory leak issues. (#3270) 2025-04-08 19:03:18 +08:00
build_cache.py Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00
disagg_utils.py feat: Disaggregated router class (#3584) 2025-04-19 00:34:12 +08:00
llm_args.py feat: add relaxed acceptance for DS (#3865) 2025-05-01 21:50:36 +08:00
llm_utils.py fix: trtllm-bench build trt engine on slurm (#3825) 2025-04-27 22:26:23 +08:00
llm.py Llama4 processor fixes (#3994) 2025-05-01 12:45:53 +08:00
mgmn_leader_node.py fix: trtllm-bench build trt engine on slurm (#3825) 2025-04-27 22:26:23 +08:00
mgmn_worker_node.py Update TensorRT-LLM (#2333) 2024-10-15 15:28:40 +08:00
mpi_session.py fix: trtllm-bench build trt engine on slurm (#3825) 2025-04-27 22:26:23 +08:00
tokenizer.py test [TRTLLM-4477,TRTLLM-4481]: Accuracy test improvement (Part 3.5): Support GSM8K and GPQA (#3483) 2025-04-22 07:38:16 +08:00
tracer.py Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00
trtllm-llmapi-launch fix hmac in remote mpi session (#3649) 2025-04-18 17:47:51 +08:00
utils.py fix: trtllm-bench build trt engine on slurm (#3825) 2025-04-27 22:26:23 +08:00