kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-02-05 18:51:38 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
bf16fbd86c
TensorRT-LLMs/examples/configs/database/nvidia/DeepSeek-R1-0528-FP4-v2/B200
History
Anish Shanbhag 7c82605327
[None][fix] enable KV cache reuse for config database (#10094)
2025-12-19 15:16:56 -08:00
..
1k1k_tp4_conc4.yaml [None][fix] enable KV cache reuse for config database (#10094) 2025-12-19 15:16:56 -08:00
1k1k_tp4_conc8.yaml [None][fix] enable KV cache reuse for config database (#10094) 2025-12-19 15:16:56 -08:00
1k1k_tp4_conc16.yaml [None][fix] enable KV cache reuse for config database (#10094) 2025-12-19 15:16:56 -08:00
1k1k_tp4_conc32.yaml [None][fix] enable KV cache reuse for config database (#10094) 2025-12-19 15:16:56 -08:00
1k1k_tp4_conc64.yaml [None][fix] enable KV cache reuse for config database (#10094) 2025-12-19 15:16:56 -08:00
1k1k_tp4_conc128.yaml [None][fix] enable KV cache reuse for config database (#10094) 2025-12-19 15:16:56 -08:00
1k1k_tp4_conc256.yaml [None][fix] enable KV cache reuse for config database (#10094) 2025-12-19 15:16:56 -08:00
1k1k_tp8_conc4.yaml [None][fix] enable KV cache reuse for config database (#10094) 2025-12-19 15:16:56 -08:00
1k1k_tp8_conc8.yaml [None][fix] enable KV cache reuse for config database (#10094) 2025-12-19 15:16:56 -08:00
1k1k_tp8_conc16.yaml [None][fix] enable KV cache reuse for config database (#10094) 2025-12-19 15:16:56 -08:00
1k1k_tp8_conc32.yaml [None][fix] enable KV cache reuse for config database (#10094) 2025-12-19 15:16:56 -08:00
1k1k_tp8_conc64.yaml [None][fix] enable KV cache reuse for config database (#10094) 2025-12-19 15:16:56 -08:00
1k1k_tp8_conc128.yaml [None][fix] enable KV cache reuse for config database (#10094) 2025-12-19 15:16:56 -08:00
1k1k_tp8_conc256.yaml [None][fix] enable KV cache reuse for config database (#10094) 2025-12-19 15:16:56 -08:00
8k1k_tp4_conc4.yaml [None][fix] enable KV cache reuse for config database (#10094) 2025-12-19 15:16:56 -08:00
8k1k_tp4_conc8.yaml [None][fix] enable KV cache reuse for config database (#10094) 2025-12-19 15:16:56 -08:00
8k1k_tp4_conc16.yaml [None][fix] enable KV cache reuse for config database (#10094) 2025-12-19 15:16:56 -08:00
8k1k_tp4_conc32.yaml [None][fix] enable KV cache reuse for config database (#10094) 2025-12-19 15:16:56 -08:00
8k1k_tp4_conc64.yaml [None][fix] enable KV cache reuse for config database (#10094) 2025-12-19 15:16:56 -08:00
8k1k_tp4_conc128.yaml [None][fix] enable KV cache reuse for config database (#10094) 2025-12-19 15:16:56 -08:00
8k1k_tp4_conc256.yaml [None][fix] enable KV cache reuse for config database (#10094) 2025-12-19 15:16:56 -08:00
8k1k_tp8_conc4.yaml [None][fix] enable KV cache reuse for config database (#10094) 2025-12-19 15:16:56 -08:00
8k1k_tp8_conc8.yaml [None][fix] enable KV cache reuse for config database (#10094) 2025-12-19 15:16:56 -08:00
8k1k_tp8_conc16.yaml [None][fix] enable KV cache reuse for config database (#10094) 2025-12-19 15:16:56 -08:00
8k1k_tp8_conc32.yaml [None][fix] enable KV cache reuse for config database (#10094) 2025-12-19 15:16:56 -08:00
8k1k_tp8_conc64.yaml [None][fix] enable KV cache reuse for config database (#10094) 2025-12-19 15:16:56 -08:00
8k1k_tp8_conc128.yaml [None][fix] enable KV cache reuse for config database (#10094) 2025-12-19 15:16:56 -08:00
8k1k_tp8_conc256.yaml [None][fix] enable KV cache reuse for config database (#10094) 2025-12-19 15:16:56 -08:00