| .. |
|
_torch
|
fix: Fix an error related to dummy request when MTP is used (#3146)
|
2025-04-03 11:08:12 +08:00 |
|
auto_parallel
|
Update TensorRT-LLM (#2936)
|
2025-03-18 21:25:19 +08:00 |
|
bench
|
perf: Readd iteration logging for trtllm-bench. (#3039)
|
2025-04-01 08:13:09 +08:00 |
|
commands
|
test: Accuracy test improvement (Part 3.1): Extend accuracy test suite with LLM API and initial implementation of trtllm-eval (#3167)
|
2025-04-01 22:20:29 +08:00 |
|
evaluate
|
test: Accuracy test improvement (Part 3.2): Move Qwen tests (NvBug 5135332) (#3219)
|
2025-04-02 17:29:57 +08:00 |
|
executor
|
Refactor return of first gen token in PD (#2986)
|
2025-04-01 12:28:27 +08:00 |
|
inputs
|
Update TensorRT-LLM (#2873)
|
2025-03-11 21:13:42 +08:00 |
|
layers
|
fix: fix for cp > kvHeadNum (#3002)
|
2025-03-26 12:39:02 +08:00 |
|
llmapi
|
test: Accuracy test improvement (Part 3.1): Extend accuracy test suite with LLM API and initial implementation of trtllm-eval (#3167)
|
2025-04-01 22:20:29 +08:00 |
|
models
|
Add support for Phi-4-mini (#2990)
|
2025-04-02 08:34:39 +08:00 |
|
plugin
|
Update TensorRT-LLM (#2936)
|
2025-03-18 21:25:19 +08:00 |
|
quantization
|
test: Accuracy test improvement (Part 3.1): Extend accuracy test suite with LLM API and initial implementation of trtllm-eval (#3167)
|
2025-04-01 22:20:29 +08:00 |
|
runtime
|
Update (#2978)
|
2025-03-23 16:39:35 +08:00 |
|
scaffolding
|
feat: refactor scaffolding worker and support openai api worker (#3166)
|
2025-04-01 18:31:52 +08:00 |
|
serve
|
fix streaming in dist-serving (#3087)
|
2025-04-02 10:08:07 +08:00 |
|
tools
|
Update TensorRT-LLM (#2849)
|
2025-03-04 18:44:00 +08:00 |
|
__init__.py
|
Update (#2978)
|
2025-03-23 16:39:35 +08:00 |
|
_common.py
|
Update (#2978)
|
2025-03-23 16:39:35 +08:00 |
|
_ipc_utils.py
|
Update TensorRT-LLM (#2783)
|
2025-02-13 18:40:22 +08:00 |
|
_utils.py
|
Update (#2978)
|
2025-03-23 16:39:35 +08:00 |
|
builder.py
|
Update TensorRT-LLM (#2820)
|
2025-02-25 21:21:49 +08:00 |
|
disaggregated_params.py
|
Update TensorRT-LLM (#2936)
|
2025-03-18 21:25:19 +08:00 |
|
functional.py
|
perf: Add optimizations for deepseek in min latency mode (#3093)
|
2025-04-02 09:05:24 +08:00 |
|
graph_rewriting.py
|
Update TensorRT-LLM (#2755)
|
2025-02-11 03:01:00 +00:00 |
|
logger.py
|
Update TensorRT-LLM (#2873)
|
2025-03-11 21:13:42 +08:00 |
|
lora_manager.py
|
Update TensorRT-LLM (#2873)
|
2025-03-11 21:13:42 +08:00 |
|
mapping.py
|
fix: fix for cp > kvHeadNum (#3002)
|
2025-03-26 12:39:02 +08:00 |
|
module.py
|
Update (#2978)
|
2025-03-23 16:39:35 +08:00 |
|
network.py
|
Update TensorRT-LLM (#2820)
|
2025-02-25 21:21:49 +08:00 |
|
parameter.py
|
Update TensorRT-LLM (#2873)
|
2025-03-11 21:13:42 +08:00 |
|
profiler.py
|
Update TensorRT-LLM (#2936)
|
2025-03-18 21:25:19 +08:00 |
|
prompt_adapter_manager.py
|
Update TensorRT-LLM (#2333)
|
2024-10-15 15:28:40 +08:00 |
|
python_plugin.py
|
Update TensorRT-LLM (#2755)
|
2025-02-11 03:01:00 +00:00 |
|
sampling_params.py
|
v1.2 (#3082)
|
2025-03-26 23:31:29 +08:00 |
|
top_model_mixin.py
|
Update TensorRT-LLM (#2053)
|
2024-07-30 21:25:01 +08:00 |
|
version.py
|
chore: bump version to 0.19.0.dev2025040800 (#3171)
|
2025-04-02 08:21:55 +08:00 |
