R1-Onevision/LLaMA-Factory/examples/inference/llama3_vllm.yaml
2025-04-13 07:27:40 +00:00

6 lines
142 B
YAML
Executable File

model_name_or_path: meta-llama/Meta-Llama-3-8B-Instruct
template: llama3
infer_backend: vllm
vllm_enforce_eager: true
trust_remote_code: true