TensorRT-LLMs/tensorrt_llm/llmapi
石晓伟 8f91cff22e
TensorRT-LLM Release 0.15.0 (#2529)
Co-authored-by: Kaiyu Xie <26294424+kaiyux@users.noreply.github.com>
2024-12-04 13:44:56 +08:00
..
__init__.py TensorRT-LLM Release 0.15.0 (#2529) 2024-12-04 13:44:56 +08:00
_perf_evaluator.py TensorRT-LLM Release 0.15.0 (#2529) 2024-12-04 13:44:56 +08:00
build_cache.py TensorRT-LLM Release 0.15.0 (#2529) 2024-12-04 13:44:56 +08:00
llm_utils.py TensorRT-LLM Release 0.15.0 (#2529) 2024-12-04 13:44:56 +08:00
llm.py TensorRT-LLM Release 0.15.0 (#2529) 2024-12-04 13:44:56 +08:00
mgmn_worker_node.py TensorRT-LLM Release 0.15.0 (#2529) 2024-12-04 13:44:56 +08:00
mpi_session.py TensorRT-LLM Release 0.15.0 (#2529) 2024-12-04 13:44:56 +08:00
tokenizer.py TensorRT-LLM Release 0.15.0 (#2529) 2024-12-04 13:44:56 +08:00
tracer.py TensorRT-LLM Release 0.15.0 (#2529) 2024-12-04 13:44:56 +08:00
trtllm-llmapi-launch TensorRT-LLM Release 0.15.0 (#2529) 2024-12-04 13:44:56 +08:00
utils.py TensorRT-LLM Release 0.15.0 (#2529) 2024-12-04 13:44:56 +08:00