TensorRT-LLMs/tensorrt_llm
Fanrong Li 0976360204
add support for MTP+cuda_graph_padding. (#3096)
Signed-off-by: Fanrong Li <23290157+lfr-0531@users.noreply.github.com>
2025-03-27 16:06:14 +08:00
..
_torch add support for MTP+cuda_graph_padding. (#3096) 2025-03-27 16:06:14 +08:00
auto_parallel Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
bench fix gpus_per_node in trtllm-bench when world_size < device_count (#3007) 2025-03-27 09:31:40 +08:00
commands Update (#2978) 2025-03-23 16:39:35 +08:00
executor Fix: fuse message not aligned on different processes (#3067) 2025-03-26 17:15:27 +08:00
inputs Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
layers fix: fix for cp > kvHeadNum (#3002) 2025-03-26 12:39:02 +08:00
llmapi test: [TRTLLM-4334] Create 1.0 criteria scope from API stability references (#3069) 2025-03-26 18:14:35 +08:00
models Add EXAONE-Deep (#3054) 2025-03-26 14:24:04 +08:00
plugin Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
quantization fix: fix for cp > kvHeadNum (#3002) 2025-03-26 12:39:02 +08:00
runtime Update (#2978) 2025-03-23 16:39:35 +08:00
scaffolding doc: Add README.md for scaffolding (#3048) 2025-03-25 13:58:01 +08:00
serve Update (#2978) 2025-03-23 16:39:35 +08:00
tools Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
__init__.py Update (#2978) 2025-03-23 16:39:35 +08:00
_common.py Update (#2978) 2025-03-23 16:39:35 +08:00
_ipc_utils.py Update TensorRT-LLM (#2783) 2025-02-13 18:40:22 +08:00
_utils.py Update (#2978) 2025-03-23 16:39:35 +08:00
builder.py Update TensorRT-LLM (#2820) 2025-02-25 21:21:49 +08:00
disaggregated_params.py Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
functional.py fix: fix for cp > kvHeadNum (#3002) 2025-03-26 12:39:02 +08:00
graph_rewriting.py Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
logger.py Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
lora_manager.py Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
mapping.py fix: fix for cp > kvHeadNum (#3002) 2025-03-26 12:39:02 +08:00
module.py Update (#2978) 2025-03-23 16:39:35 +08:00
network.py Update TensorRT-LLM (#2820) 2025-02-25 21:21:49 +08:00
parameter.py Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
profiler.py Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
prompt_adapter_manager.py Update TensorRT-LLM (#2333) 2024-10-15 15:28:40 +08:00
python_plugin.py Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
sampling_params.py v1.2 (#3082) 2025-03-26 23:31:29 +08:00
top_model_mixin.py Update TensorRT-LLM (#2053) 2024-07-30 21:25:01 +08:00
version.py chore: bump version to "0.19.0.dev2025032500" (#3019) 2025-03-25 10:04:17 +08:00