| .. |
|
_torch
|
refactor: collect executor and decoder states into dataclass (#3234)
|
2025-04-15 16:31:45 +08:00 |
|
auto_parallel
|
chore: remove usernames from comments (#3291)
|
2025-04-05 13:44:28 +08:00 |
|
bench
|
fix: Add nested aliases for Llama 4 (#3381)
|
2025-04-10 10:18:53 +08:00 |
|
commands
|
Use llm.tokenizer in OpenAIServer (#3199)
|
2025-04-08 14:55:02 +08:00 |
|
evaluate
|
test: Accuracy test improvement (Part 3.2): Move Qwen tests (NvBug 5135332) (#3219)
|
2025-04-02 17:29:57 +08:00 |
|
executor
|
chore: Unify Python NVTX call (#3450)
|
2025-04-15 23:25:36 +08:00 |
|
inputs
|
make LLM-API slurm examples executable (#3402)
|
2025-04-13 21:42:45 +08:00 |
|
layers
|
feat: Add FP8 support for SM 120 (#3248)
|
2025-04-14 16:05:41 -07:00 |
|
llmapi
|
chore: Unify Python NVTX call (#3450)
|
2025-04-15 23:25:36 +08:00 |
|
models
|
fix: nvbugs/5075538: fix cross attention mask when decoder input len > 1 (#3585)
|
2025-04-16 08:31:33 +08:00 |
|
plugin
|
Update TensorRT-LLM (#2936)
|
2025-03-18 21:25:19 +08:00 |
|
quantization
|
test:add fp8_kv_cache functionality test case. (#3457)
|
2025-04-15 09:16:46 +08:00 |
|
runtime
|
test: Fix breaking Phi3 multimodal tests (#3544)
|
2025-04-15 08:02:34 +08:00 |
|
scaffolding
|
feat: Make scaffolding Controller more generic #3408 (#3416)
|
2025-04-12 21:35:38 +08:00 |
|
serve
|
chore: Unify Python NVTX call (#3450)
|
2025-04-15 23:25:36 +08:00 |
|
tools
|
test: Fix breaking Phi3 multimodal tests (#3544)
|
2025-04-15 08:02:34 +08:00 |
|
__init__.py
|
Update (#2978)
|
2025-03-23 16:39:35 +08:00 |
|
_common.py
|
Update (#2978)
|
2025-03-23 16:39:35 +08:00 |
|
_ipc_utils.py
|
fix: Proper error bubbling for PyExecutor (#3321)
|
2025-04-15 14:49:46 +08:00 |
|
_utils.py
|
chore: Unify Python NVTX call (#3450)
|
2025-04-15 23:25:36 +08:00 |
|
builder.py
|
chore: remove usernames from comments (#3291)
|
2025-04-05 13:44:28 +08:00 |
|
disaggregated_params.py
|
Update TensorRT-LLM (#2936)
|
2025-03-18 21:25:19 +08:00 |
|
functional.py
|
Cache sin cos in model instead of global LRU cache. (#3378)
|
2025-04-14 11:19:09 +08:00 |
|
graph_rewriting.py
|
Update TensorRT-LLM (#2755)
|
2025-02-11 03:01:00 +00:00 |
|
logger.py
|
Update TensorRT-LLM (#2873)
|
2025-03-11 21:13:42 +08:00 |
|
lora_manager.py
|
Feat/ Integrate peftCacheManager in PyExecutor creation (#3372)
|
2025-04-15 15:14:43 +08:00 |
|
mapping.py
|
chore: unify pp_layers helpers (#3429)
|
2025-04-15 04:49:17 +08:00 |
|
module.py
|
Update (#2978)
|
2025-03-23 16:39:35 +08:00 |
|
network.py
|
chore: remove usernames from comments (#3291)
|
2025-04-05 13:44:28 +08:00 |
|
parameter.py
|
Update TensorRT-LLM (#2873)
|
2025-03-11 21:13:42 +08:00 |
|
profiler.py
|
Update TensorRT-LLM (#2936)
|
2025-03-18 21:25:19 +08:00 |
|
prompt_adapter_manager.py
|
Update TensorRT-LLM (#2333)
|
2024-10-15 15:28:40 +08:00 |
|
python_plugin.py
|
Update TensorRT-LLM (#2755)
|
2025-02-11 03:01:00 +00:00 |
|
sampling_params.py
|
v1.2 (#3082)
|
2025-03-26 23:31:29 +08:00 |
|
top_model_mixin.py
|
Update TensorRT-LLM (#2053)
|
2024-07-30 21:25:01 +08:00 |
|
version.py
|
chore: bump version to 0.19.0rc0 (#3535)
|
2025-04-14 18:11:20 +08:00 |
da47d5f27e