https://community.databricks.com/t5/machine-learning/using-qwen-with-vllm/m-p/154081#M4603 <P>There are many conflict and dependency issues when trying to install VLLM and use the Qwen models (on serverless), even the v2 families.<BR />I tried following this guide&nbsp;<A href="https://docs.databricks.com/aws/en/machine-learning/sgc-examples/tutorials/sgc-raydata-vllm" target="_blank" rel="noopener">https://docs.databricks.com/aws/en/machine-learning/sgc-examples/tutorials/sgc-raydata-vllm</A><BR />It lists very specific module versions to install. But VLLM normally fails to inspect the model architecture of Qwen. Is there an easier way to use these models (Specifically the VL-Instruct ones)?</P> Fri, 10 Apr 2026 15:11:29 GMT pfzoz 2026-04-10T15:11:29Z https://community.databricks.com/t5/machine-learning/using-qwen-with-vllm/m-p/154081#M4603 <P>There are many conflict and dependency issues when trying to install VLLM and use the Qwen models (on serverless), even the v2 families.<BR />I tried following this guide&nbsp;<A href="https://docs.databricks.com/aws/en/machine-learning/sgc-examples/tutorials/sgc-raydata-vllm" target="_blank" rel="noopener">https://docs.databricks.com/aws/en/machine-learning/sgc-examples/tutorials/sgc-raydata-vllm</A><BR />It lists very specific module versions to install. But VLLM normally fails to inspect the model architecture of Qwen. Is there an easier way to use these models (Specifically the VL-Instruct ones)?</P> Fri, 10 Apr 2026 15:11:29 GMT https://community.databricks.com/t5/machine-learning/using-qwen-with-vllm/m-p/154081#M4603 pfzoz 2026-04-10T15:11:29Z