TensorRT-LLMs/tensorrt_llm/llmapi
Kaiyu Xie 385626572d
Update TensorRT-LLM (#2502)
* Update TensorRT-LLM

---------

Co-authored-by: 岑灿 <yunyi.hyy@alibaba-inc.com>
2024-11-26 16:51:34 +08:00
..
__init__.py Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00
_perf_evaluator.py Update TensorRT-LLM (#2502) 2024-11-26 16:51:34 +08:00
build_cache.py Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00
llm_utils.py Update TensorRT-LLM (#2502) 2024-11-26 16:51:34 +08:00
llm.py Update TensorRT-LLM (#2502) 2024-11-26 16:51:34 +08:00
mgmn_worker_node.py Update TensorRT-LLM (#2333) 2024-10-15 15:28:40 +08:00
mpi_session.py Update TensorRT-LLM (#2333) 2024-10-15 15:28:40 +08:00
tokenizer.py Update TensorRT-LLM (#2363) 2024-10-22 20:27:35 +08:00
tracer.py Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00
trtllm-llmapi-launch Update TensorRT-LLM (#2333) 2024-10-15 15:28:40 +08:00
utils.py Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00