TensorRT-LLMs/tensorrt_llm/hlapi
Kaiyu Xie db4edea1e1
Update TensorRT-LLM (#1763)
* Update TensorRT-LLM

---------

Co-authored-by: Kota Tsuyuzaki <bloodeagle40234@gmail.com>
Co-authored-by: Pzzzzz <hello-cd.plus@hotmail.com>
Co-authored-by: Patrick Reiter Horn <patrick.horn@gmail.com>
2024-06-11 16:59:02 +08:00
..
__init__.py Update TensorRT-LLM (#1763) 2024-06-11 16:59:02 +08:00
_perf_evaluator.py Update TensorRT-LLM (#1763) 2024-06-11 16:59:02 +08:00
llm.py Update TensorRT-LLM (#1763) 2024-06-11 16:59:02 +08:00
mgmn_worker_node.py Update TensorRT-LLM (#1598) 2024-05-14 16:43:41 +08:00
mpi_session.py Update TensorRT-LLM (#1688) 2024-05-28 20:07:49 +08:00
tokenizer.py Update TensorRT-LLM (#1315) 2024-03-19 17:36:42 +08:00
trtllm-hlapi-launch Update TensorRT-LLM (#1598) 2024-05-14 16:43:41 +08:00
utils.py Update TensorRT-LLM (#1763) 2024-06-11 16:59:02 +08:00