TensorRT-LLMs/tensorrt_llm/hlapi
2024-11-01 19:48:44 +08:00
..
__init__.py Update TensorRT-LLM v0.14.0 (#2401) 2024-11-01 19:48:44 +08:00
_perf_evaluator.py TensorRT-LLM v0.13 Update (#2269) 2024-09-30 16:20:23 +08:00
build_cache.py TensorRT-LLM v0.13 Update (#2269) 2024-09-30 16:20:23 +08:00
llm_utils.py Update TensorRT-LLM v0.14.0 (#2401) 2024-11-01 19:48:44 +08:00
llm.py Update TensorRT-LLM v0.14.0 (#2401) 2024-11-01 19:48:44 +08:00
mgmn_worker_node.py TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
mpi_session.py TensorRT-LLM v0.13 Update (#2269) 2024-09-30 16:20:23 +08:00
openai_protocol.py TensorRT-LLM v0.13 Update (#2269) 2024-09-30 16:20:23 +08:00
tokenizer.py TensorRT-LLM v0.11 Update (#1969) 2024-07-17 20:45:02 +08:00
trtllm-hlapi-launch TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
utils.py Update TensorRT-LLM v0.14.0 (#2401) 2024-11-01 19:48:44 +08:00