TensorRT-LLMs/tensorrt_llm/bench/build
shaharmor98 14b36e07d7
[TRTLLM-6174][feat] Enable FP32 mamba ssm cache (#6574)
Signed-off-by: Shahar Mor <17088876+shaharmor98@users.noreply.github.com>
2025-08-10 16:27:51 -04:00
..
__init__.py Update TensorRT-LLM 2024-08-20 18:55:15 +08:00
build.py [TRTLLM-5838][fix] fix max batch size and max tokens in kv cache estimations for Nemotron-H (#5371) 2025-07-09 11:30:15 +03:00
dataclasses.py [TRTLLM-6174][feat] Enable FP32 mamba ssm cache (#6574) 2025-08-10 16:27:51 -04:00
tuning.py [TRTLLM-6174][feat] Enable FP32 mamba ssm cache (#6574) 2025-08-10 16:27:51 -04:00
utils.py Update TensorRT-LLM (#2532) 2024-12-04 21:16:56 +08:00