TensorRT-LLMs/tensorrt_llm/runtime
石晓伟 59f41c067d
Update TensorRT-LLM (#708)
* Update TensorRT-LLM

* update

* Bump version to 0.7.0
2023-12-20 16:38:28 +08:00
..
__init__.py Update TensorRT-LLM (#708) 2023-12-20 16:38:28 +08:00
generation.py Update TensorRT-LLM (#708) 2023-12-20 16:38:28 +08:00
kv_cache_manager.py Update TensorRT-LLM (#708) 2023-12-20 16:38:28 +08:00
lora_manager.py Update TensorRT-LLM (#708) 2023-12-20 16:38:28 +08:00
model_runner_cpp.py Update TensorRT-LLM (#708) 2023-12-20 16:38:28 +08:00
model_runner.py Update TensorRT-LLM (#708) 2023-12-20 16:38:28 +08:00
session.py Update TensorRT-LLM (#708) 2023-12-20 16:38:28 +08:00