Enwei Zhu 1745102e72 [TRTLLM-7027][feat] Fuse d2t to logitsBitmaskKernel and fix a race condition in one-model spec (#7481) ... Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> Co-authored-by: Jin Li <59594262+liji-nv@users.noreply.github.com>		2025-09-04 23:30:14 +08:00
..
__init__.py
_util.py	[None][chore] Use llm args in create_py_executor (#7239)	2025-09-01 16:27:55 -07:00
config_utils.py	[None][fix] fix hunyuan_moe init bug (#7502)	2025-09-04 03:06:00 -04:00
config.py	[TRTLLM-7326][feat] Add standalone multimodal encoder (#6743)	2025-08-19 21:42:50 -07:00
cuda_graph_runner.py	[https://nvbugs/5480289][fix] release slot manager in mtp MTPHiddenStatesManager (#7340)	2025-09-02 19:37:51 -07:00
executor_request_queue.py	[None][opt] Balance the request based on number of tokens in AttentionDP (#7183)	2025-08-27 11:16:12 +08:00
finish_reason.py
grammar_matcher.py	[TRTLLM-7028][feat] Enable guided decoding with speculative decoding (part 2: one-model engine) (#6948)	2025-09-03 15:16:11 -07:00
guided_decoder.py	[TRTLLM-7027][feat] Fuse d2t to logitsBitmaskKernel and fix a race condition in one-model spec (#7481)	2025-09-04 23:30:14 +08:00
handle_logits.py	[TRTLLM-7155][feat] Unify sampler handle logits implementation. (#6867)	2025-08-22 08:09:30 +02:00
kv_cache_connector.py	[None][chore] rm executor config in kv cache connector (#7372)	2025-09-03 08:13:13 +08:00
kv_cache_transceiver.py
layerwise_nvtx_marker.py
llm_request.py	[TRTLLM-7346][fix] Improve performance of PyTorchModelEngine._get_lora_params_from_requests (#7033)	2025-08-25 10:37:40 +03:00
make_decoding_batch_input_output.py
mamba_cache_manager.py
model_engine.py	[None][feat] MultiLayer Eagle (#7234)	2025-09-04 10:49:13 -04:00
py_executor_creator.py	[None][chore] Remove two unused parameters in create_py_executor (#7458)	2025-09-04 07:31:31 +08:00
py_executor.py	[TRTLLM-7028][feat] Enable guided decoding with speculative decoding (part 2: one-model engine) (#6948)	2025-09-03 15:16:11 -07:00
resource_manager.py	[https://nvbugs/5480289][fix] release slot manager in mtp MTPHiddenStatesManager (#7340)	2025-09-02 19:37:51 -07:00
sampler.py	[TRTLLM-7155][feat] Unify sampler handle logits implementation. (#6867)	2025-08-22 08:09:30 +02:00
scheduler.py
seq_slot_manager.py