This website requires JavaScript.
Explore
Help
Sign In
kanshan
/
TensorRT-LLMs
Watch
1
Star
0
Fork
0
You've already forked TensorRT-LLMs
mirror of
https://github.com/NVIDIA/TensorRT-LLM.git
synced
2026-02-04 18:21:52 +08:00
Code
Issues
Actions
1
Packages
Projects
Releases
Wiki
Activity
ce561b6a8e
TensorRT-LLMs
/
cpp
/
include
/
tensorrt_llm
/
batch_manager
History
Thor Johnsen
0998a7bf20
[
https://nvbugs/5721661
][fix] Prevent out-of-bounds read (
#9879
)
...
Signed-off-by: thorjohnsen <41591019+thorjohnsen@users.noreply.github.com>
2026-01-15 10:51:40 -06:00
..
allocateKvCache.h
assignReqSeqSlots.h
cacheTransceiver.h
[TRTLLM-8540][feat] Add support for disagg in DSv3.2 (
#8735
)
2025-11-12 08:21:11 -08:00
capacityScheduler.h
common.h
contextProgress.h
createNewDecoderRequests.h
[None] [refactor] Minor cleanup and improvements (
#7619
)
2025-10-03 11:40:06 +02:00
decoderBuffers.h
[None][refactor] decoding inputs, part 2 (
#5799
)
2025-11-18 14:38:51 +01:00
evictionPolicy.h
[TLLM-6777][feature] Support SWA KV cache reuse OOW block detach (
#7922
)
2025-10-13 09:18:12 -07:00
guidedDecoder.h
refactor: Enhanced handling of decoder requests and logits within the batch manager (
#6055
)
2025-07-18 12:12:08 +02:00
handleContextLogits.h
handleGenerationLogits.h
kvCacheConnector.h
[None][feat] KV Cache Connector API (
#7228
)
2025-08-28 23:09:27 -04:00
kvCacheEventManager.h
[TRTLLM-6881][feat] Include attention dp rank info with KV cache events (
#6563
)
2025-08-07 14:17:07 +02:00
kvCacheManager.h
[
https://nvbugs/5721661
][fix] Prevent out-of-bounds read (
#9879
)
2026-01-15 10:51:40 -06:00
kvCacheTransferManager.h
[
https://nvbugs/5627710
][fix] Fix synchronization bugs in KvCacheTransferManager that can cause corrupted blocks (
#9056
)
2025-12-02 09:10:21 -06:00
kvCacheType.h
kvCacheUtils.h
[None][feat] Add support for KVCache reuse for DSv32 (
#9383
)
2025-12-02 11:14:30 +08:00
llmRequest.h
[TRTLLM-9942][feat] new request states and kvcache transceiver APIs in generation-first disagg (
#10406
)
2026-01-15 19:18:21 +08:00
logitsPostProcessor.h
[None][chore] Mass integration of release/1.0 - 3rd (
#7519
)
2025-09-08 14:03:04 +08:00
makeDecodingBatchInputOutput.h
[None][refactor] decoding inputs, part 2 (
#5799
)
2025-11-18 14:38:51 +01:00
medusaBuffers.h
microBatchScheduler.h
pauseRequests.h
peftCacheManager.h
peftCacheManagerConfig.h
promptTuningBuffers.h
rnnStateManager.h
runtimeBuffers.h
Revert "feat: nanobind bindings (
#5961
)" (
#6160
)
2025-07-18 10:12:54 +08:00
sequenceSlotManager.h
transformerBuffers.h
updateDecoderBuffers.h