zhhuang-nv 8452775db8 [TRTLLM-5070][feat] Support FP8 KV Cache Reuse for MLA (#4535) ... * optimize kv cache reuse workflow for MLA write kv cache first and only call up-projection GEMM once relax contiguous requirements of k/v for setting paged kv cache return two contiguous tensors when loading MLA KV Cache Signed-off-by: Zhen Huang <145532724+zhhuang-nv@users.noreply.github.com> * support fp8 kv cache for MLA kv cache reuse Signed-off-by: Zhen Huang <145532724+zhhuang-nv@users.noreply.github.com> * resolve comments Signed-off-by: Zhen Huang <145532724+zhhuang-nv@users.noreply.github.com> --------- Signed-off-by: Zhen Huang <145532724+zhhuang-nv@users.noreply.github.com>		2025-05-23 19:47:50 +08:00
..
contrib	refactor: use x is None instead of x == None. (#4244)	2025-05-15 20:00:04 +08:00
core	[TRTLLM-5070][feat] Support FP8 KV Cache Reuse for MLA (#4535)	2025-05-23 19:47:50 +08:00