mirror of
https://github.com/NVIDIA/TensorRT-LLM.git
synced 2026-01-24 12:42:54 +08:00
11 lines
442 B
Markdown
11 lines
442 B
Markdown
# Key Features
|
|
|
|
This document lists key features supported in TensorRT-LLM.
|
|
|
|
- [Quantization](../source/reference/precision.md)
|
|
- [Inflight Batching](../source/advanced/gpt-attention.md#in-flight-batching)
|
|
- [Chunked Context](../source/advanced/gpt-attention.md#chunked-context)
|
|
- [LoRA](../source/advanced/lora.md)
|
|
- [KV Cache Reuse](../source/advanced/kv-cache-reuse.md)
|
|
- [Speculative Sampling](../source/advanced/speculative-decoding.md)
|