mirror of
https://github.com/NVIDIA/TensorRT-LLM.git
synced 2026-01-14 06:27:45 +08:00
aaacc9bd68
* Update TensorRT-LLM --------- Co-authored-by: Starrick Liu <73152103+StarrickLiu@users.noreply.github.com>
11 lines
442 B
Markdown
11 lines
442 B
Markdown
# Key Features
|
|
|
|
This document lists key features supported in TensorRT-LLM.
|
|
|
|
- [Quantization](../source/reference/precision.md)
|
|
- [Inflight Batching](../source/advanced/gpt-attention.md#in-flight-batching)
|
|
- [Chunked Context](../source/advanced/gpt-attention.md#chunked-context)
|
|
- [LoRA](../source/advanced/lora.md)
|
|
- [KV Cache Reuse](../source/advanced/kv-cache-reuse.md)
|
|
- [Speculative Sampling](../source/advanced/speculative-decoding.md)
|