TensorRT-LLMs/tensorrt_llm
Yan Chunwei 794f61c997
fix: fix single-node cannot quit issue on slurm (#3140)
Signed-off-by: Superjomn <328693+Superjomn@users.noreply.github.com>
2025-03-31 10:15:27 +08:00
..
_torch Add initial EAGLE-3 implementation (#3035) 2025-03-29 22:31:24 +08:00
auto_parallel Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
bench fix gpus_per_node in trtllm-bench when world_size < device_count (#3007) 2025-03-27 09:31:40 +08:00
commands Update (#2978) 2025-03-23 16:39:35 +08:00
executor fix: fix single-node cannot quit issue on slurm (#3140) 2025-03-31 10:15:27 +08:00
inputs Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
layers fix: fix for cp > kvHeadNum (#3002) 2025-03-26 12:39:02 +08:00
llmapi fix: fix single-node cannot quit issue on slurm (#3140) 2025-03-31 10:15:27 +08:00
models Add initial EAGLE-3 implementation (#3035) 2025-03-29 22:31:24 +08:00
plugin Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
quantization fix: fix for cp > kvHeadNum (#3002) 2025-03-26 12:39:02 +08:00
runtime Update (#2978) 2025-03-23 16:39:35 +08:00
scaffolding move BuildConfig functional args to llmargs (#3036) 2025-03-29 02:20:18 +08:00
serve Update (#2978) 2025-03-23 16:39:35 +08:00
tools Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
__init__.py Update (#2978) 2025-03-23 16:39:35 +08:00
_common.py Update (#2978) 2025-03-23 16:39:35 +08:00
_ipc_utils.py Update TensorRT-LLM (#2783) 2025-02-13 18:40:22 +08:00
_utils.py Update (#2978) 2025-03-23 16:39:35 +08:00
builder.py Update TensorRT-LLM (#2820) 2025-02-25 21:21:49 +08:00
disaggregated_params.py Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
functional.py fix: fix for cp > kvHeadNum (#3002) 2025-03-26 12:39:02 +08:00
graph_rewriting.py Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
logger.py Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
lora_manager.py Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
mapping.py fix: fix for cp > kvHeadNum (#3002) 2025-03-26 12:39:02 +08:00
module.py Update (#2978) 2025-03-23 16:39:35 +08:00
network.py Update TensorRT-LLM (#2820) 2025-02-25 21:21:49 +08:00
parameter.py Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
profiler.py Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
prompt_adapter_manager.py Update TensorRT-LLM (#2333) 2024-10-15 15:28:40 +08:00
python_plugin.py Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
sampling_params.py v1.2 (#3082) 2025-03-26 23:31:29 +08:00
top_model_mixin.py Update TensorRT-LLM (#2053) 2024-07-30 21:25:01 +08:00
version.py chore: bump version to "0.19.0.dev2025032500" (#3019) 2025-03-25 10:04:17 +08:00