QI JUN
|
1529a6f22d
|
[None][chore] extract weights loading related logic to model loader (#7579)
Signed-off-by: junq <22017000+QiJune@users.noreply.github.com>
|
2025-09-25 10:19:22 -07:00 |
|
Liao Lanyu
|
18095a7cb8
|
[https://nvbugs/5503440][fix] Fix potential hang due to wrong type of ZMQ socket and protocol for worker_init_status_queue (#7646)
Signed-off-by: Lanyu Liao <lancelly@users.noreply.github.com>
|
2025-09-19 18:13:33 +08:00 |
|
Mike Iovine
|
b3c57a7042
|
[TRTLLM-7353][feat] Implement capturable drafting loops for speculation (#7100)
Signed-off-by: Mike Iovine <6158008+mikeiovine@users.noreply.github.com>
|
2025-09-01 14:37:44 -04:00 |
|
Shunkangz
|
ff4047414b
|
[None][opt] Balance the request based on number of tokens in AttentionDP (#7183)
Signed-off-by: Shunkang <182541032+Shunkangz@users.noreply.github.co>
Co-authored-by: Shunkang <182541032+Shunkangz@users.noreply.github.co>
|
2025-08-27 11:16:12 +08:00 |
|
qixiang-99
|
b165f8bc97
|
fix/improve kvcache allocation in PyTorch runtime (#5933)
Signed-off-by: qixiang-99 <203170375+qixiang-99@users.noreply.github.com>
|
2025-08-26 12:40:22 +08:00 |
|
QI JUN
|
bea5e07fb7
|
[None][refactor] refactor the CUDA graph runner to manage all CUDA graphs (#6846)
Signed-off-by: junq <22017000+QiJune@users.noreply.github.com>
|
2025-08-25 20:52:05 +08:00 |
|
Robin Kobus
|
b95cab2a7c
|
[None][ci] move unittests to sub-directories (#6635)
Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>
|
2025-08-20 05:42:22 -04:00 |
|