..
_tensorrt_engine
[TRTLLM-5208][BREAKING CHANGE] chore: make pytorch LLM the default ( #5312 )
2025-06-20 03:01:10 +08:00
_torch
[TRTLLM-4501][feat] Add input tensor pre-hook function API for the tuning process. ( #6924 )
2025-10-15 21:18:11 +08:00
auto_parallel
[None][chore] Some clean-ups for CUDA 13.0 dependencies ( #7979 )
2025-09-26 08:46:11 +08:00
bench
[None][chore] extract weights loading related logic to model loader ( #7579 )
2025-09-25 10:19:22 -07:00
commands
[None][feat] AutoDeploy: dive deeper into token generation bugs + enable_block_reuse ( #8108 )
2025-10-03 04:57:26 -07:00
evaluate
[TRTLLM-8269][test] do not explicitly pass temperature=0 to select greedy sampling ( #8110 )
2025-10-02 10:20:32 +02:00
executor
[TRTLLM-8507][fix] Fix ray resource cleanup and error handling in LoRA test ( #8175 )
2025-10-14 23:46:30 +08:00
inputs
[TRTLLM-7328][feat] E-PD Disagg Support via llmapi (3/N) ( #7577 )
2025-09-22 19:07:18 -07:00
layers
[TRTLLM-5863][feat] Support MoE INT8 Weight-Only-Quantization in PyTorch Workflow ( #6629 )
2025-08-15 17:15:49 -04:00
llmapi
[TRTLLM-8551][feat] add cache_salt in LLM.generate and refactor test_return_logits.py ( #8317 )
2025-10-15 02:53:57 -07:00
metrics
[None][feat] Core Metrics Implementation ( #5785 )
2025-08-09 02:48:53 -04:00
models
[None][chore] update torch_dtype -> dtype in 'transformers' ( #8263 )
2025-10-15 17:09:30 +09:00
plugin
[None][chroe] Rename TensorRT-LLM to TensorRT LLM for source code. ( #7851 )
2025-09-25 21:02:35 +08:00
quantization
[None][chore] update torch_dtype -> dtype in 'transformers' ( #8263 )
2025-10-15 17:09:30 +09:00
runtime
[None][chore] update torch_dtype -> dtype in 'transformers' ( #8263 )
2025-10-15 17:09:30 +09:00
scaffolding
[None][feat] Move StreamGeneration to scaffolding main directory ( #8347 )
2025-10-14 17:16:04 +08:00
serve
[TRTLLM-7846][feat] implement etcd storage for disagg cluster ( #8210 )
2025-10-14 16:48:41 -04:00
tools
[None][chore] update torch_dtype -> dtype in 'transformers' ( #8263 )
2025-10-15 17:09:30 +09:00
__init__.py
[ #6102 ][fix] support non-system python installation ( #7763 )
2025-09-26 10:16:15 +08:00
_common.py
[None][chroe] Rename TensorRT-LLM to TensorRT LLM for source code. ( #7851 )
2025-09-25 21:02:35 +08:00
_dlpack_utils.py
linting(python): Enable ruff on more files (wave 1/N) ( #5140 )
2025-06-14 19:19:34 +08:00
_ipc_utils.py
[TRTLLM-7349][feat] Adding new orchestrator type -- ray ( #7520 )
2025-10-04 08:12:24 +08:00
_mnnvl_utils.py
[ https://nvbugs/5477730 ][fix] Fix the alltoall case when tp_size larger than ep_size ( #7331 )
2025-09-04 08:10:03 -04:00
_ray_utils.py
[TRTLLM-8507][fix] Fix ray resource cleanup and error handling in LoRA test ( #8175 )
2025-10-14 23:46:30 +08:00
_utils.py
[ https://nvbugs/5510879 ][fix] Fix pytorch & TRT-python flows fused LoRA adapter modules weight split with TP>1 ( #8063 )
2025-10-12 12:29:52 -07:00
builder.py
[None][chroe] Rename TensorRT-LLM to TensorRT LLM for source code. ( #7851 )
2025-09-25 21:02:35 +08:00
disaggregated_params.py
[TRTLLM-7328][feat] E-PD Disagg Support via llmapi (3/N) ( #7577 )
2025-09-22 19:07:18 -07:00
functional.py
[None][chroe] Rename TensorRT-LLM to TensorRT LLM for source code. ( #7851 )
2025-09-25 21:02:35 +08:00
graph_rewriting.py
linting(python): Enable ruff on more files (wave 1/N) ( #5140 )
2025-06-14 19:19:34 +08:00
logger.py
[None][chore] Mass integration of release/1.0 - 3rd ( #7519 )
2025-09-08 14:03:04 +08:00
lora_helper.py
[ https://nvbugs/5510879 ][fix] Fix pytorch & TRT-python flows fused LoRA adapter modules weight split with TP>1 ( #8063 )
2025-10-12 12:29:52 -07:00
lora_manager.py
[ https://nvbugs/5510879 ][fix] Fix pytorch & TRT-python flows fused LoRA adapter modules weight split with TP>1 ( #8063 )
2025-10-12 12:29:52 -07:00
mapping.py
[TRTLLM-7349][feat] Adding new orchestrator type -- ray ( #7520 )
2025-10-04 08:12:24 +08:00
math_utils.py
perf: Optimize swizzle_sf, unswizzle_sf, reswizzle_sf ( #5318 )
2025-06-26 14:03:56 +08:00
module.py
[None][chroe] Rename TensorRT-LLM to TensorRT LLM for source code. ( #7851 )
2025-09-25 21:02:35 +08:00
network.py
chore: remove usernames from comments ( #3291 )
2025-04-05 13:44:28 +08:00
parameter.py
fix: https://nvbugs/5234033 enable starcoder trt-flow with transforme… ( #3909 )
2025-05-15 11:16:45 +08:00
profiler.py
linting(python): Enable ruff on more files (wave 1/N) ( #5140 )
2025-06-14 19:19:34 +08:00
prompt_adapter_manager.py
linting(python): Enable ruff on more files (wave 1/N) ( #5140 )
2025-06-14 19:19:34 +08:00
python_plugin.py
linting(python): Enable ruff on more files (wave 1/N) ( #5140 )
2025-06-14 19:19:34 +08:00
ray_stub.py
[TRTLLM-8507][fix] Fix ray resource cleanup and error handling in LoRA test ( #8175 )
2025-10-14 23:46:30 +08:00
sampling_params.py
[TRTLLM-4517] [feat] Additional model outputs ( #7206 )
2025-10-13 15:33:18 +02:00
scheduling_params.py
[None][feat] Add support of scheduling attention dp request ( #6246 )
2025-08-01 20:38:01 -04:00
serialization.py
[None] [feat] Add model gpt-oss ( #6645 )
2025-08-07 03:04:18 -04:00
top_model_mixin.py
[None][fix] Refactoring to avoid circular import when importing torch models ( #6720 )
2025-08-11 18:00:42 -04:00
version.py
[None][chore] Bump version to 1.2.0rc1 ( #8097 )
2025-09-30 06:00:25 -04:00
56c20665a9