TensorRT-LLMs/tensorrt_llm/hlapi
2024-08-29 17:25:07 +08:00
..
__init__.py TensorRT-LLM v0.12 Update (#2164) 2024-08-29 17:25:07 +08:00
_perf_evaluator.py TensorRT-LLM v0.11 Update (#1969) 2024-07-17 20:45:02 +08:00
build_cache.py TensorRT-LLM v0.11 Update (#1969) 2024-07-17 20:45:02 +08:00
llm_utils.py TensorRT-LLM v0.12 Update (#2164) 2024-08-29 17:25:07 +08:00
llm.py TensorRT-LLM v0.12 Update (#2164) 2024-08-29 17:25:07 +08:00
mgmn_worker_node.py TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
mpi_session.py TensorRT-LLM v0.12 Update (#2164) 2024-08-29 17:25:07 +08:00
openai_protocol.py TensorRT-LLM v0.12 Update (#2164) 2024-08-29 17:25:07 +08:00
tokenizer.py TensorRT-LLM v0.11 Update (#1969) 2024-07-17 20:45:02 +08:00
trtllm-hlapi-launch TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
utils.py TensorRT-LLM v0.12 Update (#2164) 2024-08-29 17:25:07 +08:00