obscura/vllm
2
0
Fork 0
mirror of https://github.com/vllm-project/vllm.git synced 2026-08-24 14:40:09 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
tokenspeed
vllm/docs/deployment/frameworks/triton.md
T

422 B
Raw Permalink Blame History

NVIDIA Triton

The Triton Inference Server hosts a tutorial demonstrating how to quickly deploy a simple facebook/opt-125m model using vLLM. Please see Deploying a vLLM model in Triton for more details.

Reference in New Issue View Git Blame Copy Permalink