cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Serving model issue in databricks

Shivani_Pande
Visitor

Iโ€™m facing an issue while trying to deploy a custom pyfunc model for Qwen3-Embedding-8B (GGUF format) registered in Unity Catalog. The GGUF model file is stored inside a Unity Catalog Volume, and during model training and registration everything works correctlyโ€”logging completes successfully and a new version is created in the UC model registry. However, when I attempt to deploy the model via Databricks Model Serving, the deployment fails with the error: โ€œModel path does not existโ€, referring to the absolute path inside /Volumes/... where the GGUF file is located. The file is accessible and visible from an interactive notebook on a cluster (verified via listing and copying), but the serverless Model Serving environment appears unable to read from that location. The underlying issue seems to be that serverless serving does not have direct access to /Volumes paths referenced inside the model wrapper. I am seeking clarification on whether serverless model serving supports reading external files from UC Volumes, and whether the recommended approach is instead to log the GGUF file as a model artifact and load it via context.artifacts rather than referencing /Volumes directly.

0 REPLIES 0