kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
322ac565fc
TensorRT-LLMs/tensorrt_llm/_torch/pyexecutor
History
Mike Iovine 5416966ddb
Add initial EAGLE-3 implementation (#3035) 
Signed-off-by: Mike Iovine <miovine@nvidia.com>
2025-03-29 22:31:24 +08:00
..
__init__.py Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
_util.py Add initial EAGLE-3 implementation (#3035) 2025-03-29 22:31:24 +08:00
config.py move BuildConfig functional args to llmargs (#3036) 2025-03-29 02:20:18 +08:00
cuda_graph_runner.py Refactor imports inside tensorrt_llm._torch. (#3015) 2025-03-26 11:01:07 +08:00
decoder.py Add initial EAGLE-3 implementation (#3035) 2025-03-29 22:31:24 +08:00
distributed.py Only gather responses on rank 0 (#3040) 2025-03-24 21:54:51 -07:00
guided_decoder.py Update (#2978) 2025-03-23 16:39:35 +08:00
kv_cache_transceiver.py Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
layerwise_nvtx_marker.py Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
llm_request.py Add initial EAGLE-3 implementation (#3035) 2025-03-29 22:31:24 +08:00
model_engine.py Add initial EAGLE-3 implementation (#3035) 2025-03-29 22:31:24 +08:00
py_executor_creator.py Add initial EAGLE-3 implementation (#3035) 2025-03-29 22:31:24 +08:00
py_executor.py Add initial EAGLE-3 implementation (#3035) 2025-03-29 22:31:24 +08:00
resource_manager.py Add initial EAGLE-3 implementation (#3035) 2025-03-29 22:31:24 +08:00
scheduler.py Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00