TensorRT-LLMs/tensorrt_llm/llmapi
Yan Chunwei 531b98ed62
feat: Add several pure python configs to LlmArgs (#2997)
* add SchedulerConfig
* add PeftCacheConfig
2025-03-24 16:16:17 +08:00
..
__init__.py Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
_perf_evaluator.py Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
build_cache.py Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00
disagg_utils.py Update (#2978) 2025-03-23 16:39:35 +08:00
llm_args.py feat: Add several pure python configs to LlmArgs (#2997) 2025-03-24 16:16:17 +08:00
llm_utils.py Update (#2978) 2025-03-23 16:39:35 +08:00
llm.py feat: Add several pure python configs to LlmArgs (#2997) 2025-03-24 16:16:17 +08:00
mgmn_leader_node.py Update (#2978) 2025-03-23 16:39:35 +08:00
mgmn_worker_node.py Update TensorRT-LLM (#2333) 2024-10-15 15:28:40 +08:00
mpi_session.py Update (#2978) 2025-03-23 16:39:35 +08:00
tokenizer.py Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
tracer.py Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00
trtllm-llmapi-launch Update (#2978) 2025-03-23 16:39:35 +08:00
utils.py Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00