TensorRT-LLMs/tensorrt_llm/runtime
Kaiyu Xie 6755a3f077
Update TensorRT-LLM (#422)
* Update TensorRT-LLM

---------

Co-authored-by: Tltin <TltinDeng01@gmail.com>
Co-authored-by: zhaohb <zhaohbcloud@126.com>
Co-authored-by: Bradley Heilbrun <brad@repl.it>
Co-authored-by: nqbao11 <nqbao11.01@gmail.com>
Co-authored-by: Nikhil Varghese <nikhil@bot-it.ai>
2023-11-18 00:05:54 +08:00
..
__init__.py Update TensorRT-LLM (#422) 2023-11-18 00:05:54 +08:00
generation.py Update TensorRT-LLM (#422) 2023-11-18 00:05:54 +08:00
kv_cache_manager.py Update TensorRT-LLM (#349) 2023-11-10 22:30:31 +08:00
lora_manager.py Update TensorRT-LLM (#422) 2023-11-18 00:05:54 +08:00
model_runner.py Update TensorRT-LLM (#422) 2023-11-18 00:05:54 +08:00
session.py Update TensorRT-LLM (#422) 2023-11-18 00:05:54 +08:00