TensorRT-LLMs/tensorrt_llm/_torch/pyexecutor
bhsueh_NV 0c07d4dc21
Fix/executor bugs (#3681)
* fix bugs of py executor

Signed-off-by: bhsueh <11360707+byshiue@users.noreply.github.com>

* fix bugs of py executor

Signed-off-by: bhsueh <11360707+byshiue@users.noreply.github.com>

* revert changes about mpi_barrier()

Signed-off-by: bhsueh <11360707+byshiue@users.noreply.github.com>

---------

Signed-off-by: bhsueh <11360707+byshiue@users.noreply.github.com>
2025-04-22 07:23:27 +08:00
..
__init__.py Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
_util.py Fix/executor bugs (#3681) 2025-04-22 07:23:27 +08:00
config.py feat: [Deepseek] Add trtllm-gen MOE FP4 MOE backend (#3387) 2025-04-21 10:01:33 +08:00
cuda_graph_runner.py Support CUDA graphs for EAGLE3 (#3176) 2025-04-17 04:53:50 +08:00
decoder.py refactor: collect executor and decoder states into dataclass (#3234) 2025-04-15 16:31:45 +08:00
guided_decoder.py Update (#2978) 2025-03-23 16:39:35 +08:00
kv_cache_transceiver.py bug: Fix hang bug when context server doesn't have enough capacity for KV Cache (#3095) 2025-04-21 15:16:55 +08:00
layerwise_nvtx_marker.py Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
llm_request.py fix: Proper error bubbling for PyExecutor (#3321) 2025-04-15 14:49:46 +08:00
model_engine.py fix: Support TLLM_OVERRIDE_LAYER_NUM for llama4. (#3679) 2025-04-21 12:28:56 +08:00
py_executor_creator.py Fix/executor bugs (#3681) 2025-04-22 07:23:27 +08:00
py_executor.py Fix/executor bugs (#3681) 2025-04-22 07:23:27 +08:00
resource_manager.py feat: allocate minimal blocks per window size (#3028) 2025-04-17 16:04:57 +08:00
scheduler.py refactor: collect executor and decoder states into dataclass (#3234) 2025-04-15 16:31:45 +08:00