diff --git a/docs/source/blogs/tech_blog/blog16_Accelerating_Long_Context_Inference_with_Skip_Softmax_Attention.md b/docs/source/blogs/tech_blog/blog16_Accelerating_Long_Context_Inference_with_Skip_Softmax_Attention.md index 18fd3ff58f..57d6c9775a 100644 --- a/docs/source/blogs/tech_blog/blog16_Accelerating_Long_Context_Inference_with_Skip_Softmax_Attention.md +++ b/docs/source/blogs/tech_blog/blog16_Accelerating_Long_Context_Inference_with_Skip_Softmax_Attention.md @@ -29,7 +29,7 @@ In this way, we can indirectly control the sparsity via the threshold. The thres The method is fully dynamic, and can be applied to both the prefilling and decoding. The algorithm of Skip Softmax Attention is described in the paper [BLASST: Dynamic Blocked Attention Sparsity via Softmax Thresholding](https://arxiv.org/pdf/2512.12087). We have also published a [Developer Blog](https://developer.nvidia.com/blog/accelerating-long-context-inference-with-skip-softmax-in-nvidia-tensorrt-llm/) for explanation. Please refer to these resources for in-depth dive into the algorithm details. We will focus on the application of Skip Softmax Attention in TensorRT-LLM to accelerate long-context inference.

- BLASST Illustration + BLASST Illustration

## Example Usage @@ -152,16 +152,16 @@ The following figures plot **speedup vs. achieved sparsity**, on top of the base

Hopper (H200)

Prefill

- Hopper prefill kernel + Hopper prefill kernel

Decode

- Hopper decode kernel + Hopper decode kernel

Blackwell (B200)

Prefill

- Blackwell prefill kernel + Blackwell prefill kernel

Decode

- Blackwell decode kernel + Blackwell decode kernel