obscura/vllm
2
0
Fork 0
mirror of https://github.com/vllm-project/vllm.git synced 2026-08-18 19:50:17 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
codex/rocm-artifact-tensorizer
vllm/docs/deployment/integrations/kaito.md
T
abhisheksheth28andGitHub 77c95f72f7 [Doc] add KAITO to integrations (#25521) 
Signed-off-by: "Abhishek Sheth" <[email protected]>
2025-10-06 17:30:03 +08:00

395 B
Raw Permalink Blame History

KAITO

KAITO is a Kubernetes operator that supports deploying and serving LLMs with vLLM. It offers managing large models via container images with built-in OpenAI-compatible inference, auto-provisioning GPU nodes and curated model presets.

Please refer to quick start for more details.

Reference in New Issue View Git Blame Copy Permalink