TensorRT-LLMs/tensorrt_llm
2024-11-19 18:30:34 +08:00
..
auto_parallel Update TensorRT-LLM (#2460) 2024-11-19 18:30:34 +08:00
bench Update TensorRT-LLM (#2460) 2024-11-19 18:30:34 +08:00
commands Update TensorRT-LLM (#2460) 2024-11-19 18:30:34 +08:00
layers Update TensorRT-LLM (#2460) 2024-11-19 18:30:34 +08:00
llmapi Update TensorRT-LLM (#2460) 2024-11-19 18:30:34 +08:00
models Update TensorRT-LLM (#2460) 2024-11-19 18:30:34 +08:00
plugin Update TensorRT-LLM (#2436) 2024-11-12 15:27:49 +08:00
quantization Update TensorRT-LLM (#2460) 2024-11-19 18:30:34 +08:00
runtime Update TensorRT-LLM (#2460) 2024-11-19 18:30:34 +08:00
serve Update TensorRT-LLM (#2460) 2024-11-19 18:30:34 +08:00
tools Update TensorRT-LLM (#2460) 2024-11-19 18:30:34 +08:00
__init__.py Update TensorRT-LLM (#2389) 2024-10-29 22:24:38 +08:00
_common.py Update TensorRT-LLM (#2110) 2024-08-13 22:34:33 +08:00
_ipc_utils.py Update TensorRT-LLM 2024-08-20 18:55:15 +08:00
_utils.py Update TensorRT-LLM (#2460) 2024-11-19 18:30:34 +08:00
builder.py Update TensorRT-LLM (#2460) 2024-11-19 18:30:34 +08:00
executor.py Update TensorRT-LLM (#2436) 2024-11-12 15:27:49 +08:00
functional.py Update TensorRT-LLM (#2460) 2024-11-19 18:30:34 +08:00
graph_rewriting.py Update TensorRT-LLM (#2436) 2024-11-12 15:27:49 +08:00
logger.py Update TensorRT-LLM (#1891) 2024-07-04 14:37:19 +08:00
lora_manager.py Update TensorRT-LLM (#2389) 2024-10-29 22:24:38 +08:00
mapping.py Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00
module.py Update TensorRT-LLM (#2253) 2024-09-24 17:27:31 +02:00
network.py Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00
parameter.py Update TensorRT-LLM (#2460) 2024-11-19 18:30:34 +08:00
profiler.py Update TensorRT-LLM (#2094) 2024-08-07 16:44:43 +08:00
prompt_adapter_manager.py Update TensorRT-LLM (#2333) 2024-10-15 15:28:40 +08:00
python_plugin.py Update TensorRT-LLM (#2389) 2024-10-29 22:24:38 +08:00
top_model_mixin.py Update TensorRT-LLM (#2053) 2024-07-30 21:25:01 +08:00
version.py Update TensorRT-LLM (#2460) 2024-11-19 18:30:34 +08:00