..
_torch
fix: fix the acceptance rate of pytorch workflow in trtllm-bench ( #3240 )
2025-04-03 15:12:24 +08:00
auto_parallel
Update TensorRT-LLM ( #2936 )
2025-03-18 21:25:19 +08:00
bench
fix: fix the acceptance rate of pytorch workflow in trtllm-bench ( #3240 )
2025-04-03 15:12:24 +08:00
commands
test: Accuracy test improvement (Part 3.1): Extend accuracy test suite with LLM API and initial implementation of trtllm-eval ( #3167 )
2025-04-01 22:20:29 +08:00
evaluate
test: Accuracy test improvement (Part 3.2): Move Qwen tests (NvBug 5135332) ( #3219 )
2025-04-02 17:29:57 +08:00
executor
fix: fix the acceptance rate of pytorch workflow in trtllm-bench ( #3240 )
2025-04-03 15:12:24 +08:00
inputs
Update TensorRT-LLM ( #2873 )
2025-03-11 21:13:42 +08:00
layers
fix: fix for cp > kvHeadNum ( #3002 )
2025-03-26 12:39:02 +08:00
llmapi
test: Accuracy test improvement (Part 3.1): Extend accuracy test suite with LLM API and initial implementation of trtllm-eval ( #3167 )
2025-04-01 22:20:29 +08:00
models
Add support for Phi-4-mini ( #2990 )
2025-04-02 08:34:39 +08:00
plugin
Update TensorRT-LLM ( #2936 )
2025-03-18 21:25:19 +08:00
quantization
test: Accuracy test improvement (Part 3.1): Extend accuracy test suite with LLM API and initial implementation of trtllm-eval ( #3167 )
2025-04-01 22:20:29 +08:00
runtime
Update ( #2978 )
2025-03-23 16:39:35 +08:00
scaffolding
feat: refactor scaffolding worker and support openai api worker ( #3166 )
2025-04-01 18:31:52 +08:00
serve
fix streaming in dist-serving ( #3087 )
2025-04-02 10:08:07 +08:00
tools
Update TensorRT-LLM ( #2849 )
2025-03-04 18:44:00 +08:00
__init__.py
Update ( #2978 )
2025-03-23 16:39:35 +08:00
_common.py
Update ( #2978 )
2025-03-23 16:39:35 +08:00
_ipc_utils.py
Update TensorRT-LLM ( #2783 )
2025-02-13 18:40:22 +08:00
_utils.py
Update ( #2978 )
2025-03-23 16:39:35 +08:00
builder.py
Update TensorRT-LLM ( #2820 )
2025-02-25 21:21:49 +08:00
disaggregated_params.py
Update TensorRT-LLM ( #2936 )
2025-03-18 21:25:19 +08:00
functional.py
perf: Add optimizations for deepseek in min latency mode ( #3093 )
2025-04-02 09:05:24 +08:00
graph_rewriting.py
Update TensorRT-LLM ( #2755 )
2025-02-11 03:01:00 +00:00
logger.py
Update TensorRT-LLM ( #2873 )
2025-03-11 21:13:42 +08:00
lora_manager.py
Update TensorRT-LLM ( #2873 )
2025-03-11 21:13:42 +08:00
mapping.py
fix: fix for cp > kvHeadNum ( #3002 )
2025-03-26 12:39:02 +08:00
module.py
Update ( #2978 )
2025-03-23 16:39:35 +08:00
network.py
Update TensorRT-LLM ( #2820 )
2025-02-25 21:21:49 +08:00
parameter.py
Update TensorRT-LLM ( #2873 )
2025-03-11 21:13:42 +08:00
profiler.py
Update TensorRT-LLM ( #2936 )
2025-03-18 21:25:19 +08:00
prompt_adapter_manager.py
Update TensorRT-LLM ( #2333 )
2024-10-15 15:28:40 +08:00
python_plugin.py
Update TensorRT-LLM ( #2755 )
2025-02-11 03:01:00 +00:00
sampling_params.py
v1.2 ( #3082 )
2025-03-26 23:31:29 +08:00
top_model_mixin.py
Update TensorRT-LLM ( #2053 )
2024-07-30 21:25:01 +08:00
version.py
chore: bump version to 0.19.0.dev2025040800 ( #3171 )
2025-04-02 08:21:55 +08:00
1fe64b90be