TensorRT-LLMs/tensorrt_llm
Kaiyu Xie 4de32a86ae
Update TensorRT-LLM (#188)
* Update batch manager
* Update src

---------

Co-authored-by: Shixiaowei02 <39303645+Shixiaowei02@users.noreply.github.com>
Co-authored-by: jdemouth-nvidia <11447840+jdemouth-nvidia@users.noreply.github.com>
2023-10-30 16:06:41 +08:00
..
layers Update TensorRT-LLM (#148) 2023-10-27 12:10:00 +08:00
models Update TensorRT-LLM (#148) 2023-10-27 12:10:00 +08:00
plugin Update TensorRT-LLM (#148) 2023-10-27 12:10:00 +08:00
quantization Update TensorRT-LLM (#148) 2023-10-27 12:10:00 +08:00
runtime Update TensorRT-LLM (#188) 2023-10-30 16:06:41 +08:00
tools Update TensorRT-LLM (#148) 2023-10-27 12:10:00 +08:00
__init__.py Update code 2023-09-28 09:00:05 -07:00
_common.py Update code 2023-09-28 09:00:05 -07:00
_ipc_utils.py Kaiyu/update main (#5) 2023-10-18 22:38:53 +08:00
_utils.py Update TensorRT-LLM (#148) 2023-10-27 12:10:00 +08:00
builder.py Update code 2023-09-28 09:00:05 -07:00
functional.py Update TensorRT-LLM (#148) 2023-10-27 12:10:00 +08:00
graph_rewriting.py Update TensorRT-LLM (#148) 2023-10-27 12:10:00 +08:00
logger.py Update TensorRT-LLM (#148) 2023-10-27 12:10:00 +08:00
mapping.py Update 2023-10-10 23:22:17 -07:00
module.py Initial commit 2023-09-20 00:29:41 -07:00
network.py Update TensorRT-LLM (#148) 2023-10-27 12:10:00 +08:00
parameter.py Update TensorRT-LLM (#148) 2023-10-27 12:10:00 +08:00
profiler.py Initial commit 2023-09-20 00:29:41 -07:00