LoRA Adapters Guide

Like vLLM, vllm-ascend supports LoRA as well. The usage and more details can be found in vLLM official document.

You can also refer to this to find which models support LoRA in vLLM.

Tips

If you fail to run vllm-ascend with LoRA, you may follow this instruction to disable graph mode and try again.