cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Vector Search Index Sync fails in Initializing

tiho
New Contributor

Vector Search Index Sync fails in Initializing. This index table was already up and running, and when I tried to sync it, it failed in Initializing. See the attached. 

tiho_0-1709733181256.png

 

5 REPLIES 5

Kaniz_Fatma
Community Manager
Community Manager

Hi @tihoI understand that youโ€™re encountering issues with the Vector Search Index in Azure Databricks.

Letโ€™s troubleshoot this together.

  1. Temporary Issue: It appears that youโ€™re not alone in experiencing this problem. Other users have reported similar issues, and in some cases, it resolved itself after a period of time. For instance, one user mentioned that the issue was resolved within 48 hours without any changes mad...1. So, it might be a temporary glitch with Databricks.

  2. Region and Provisioning: You mentioned that youโ€™re using Azure Databricks in the West Europe region. Sometimes, the provisioning process can take longer due to various factors. However, if this persists, consider the following steps:

    • Check Logs: Inspect the logs or error messages to identify any specific issues during the provisioning process.
    • Retry: Retry the provisioning process after some time. If it still fails, proceed to the next step.
    • Resource Constraints: Ensure that there are no resource constraints (such as memory or CPU) affecting the provisioning process.
    • Network Connectivity: Verify that your Databricks cluster has proper network connectivity to the required services.
  3. Delta Sync Index: When creating a Vector Search Index, there are two types: Delta Sync Index and Non-Delta Sync Index. The Delta Sync Index automatically syncs with a source Delta Table, incrementally updating the index...2. Make sure youโ€™re using the appropriate type for your use case.

  4. Python SDK and REST API: You mentioned using both the UI and the Python VectorSearchClient. If the UI is not working as expected, try creating the index programmatically using the Python SDK or the REST API. This might provide additional insights into any issues.

 

amitpphatak
New Contributor II

Were you able to resolve this issue? I am facing the same issue right now - I am on AWS.

jnkthms
New Contributor III

We are still running in the same issue. On Azure in Westeurope Region. Any updates?

casgiedus
New Contributor II

I'm having a similar issue - it's stuck at "Waiting for initial sync...".

Nothing is happening, I'm not getting any requests on the embedding endpoint.

jnkthms
New Contributor III

The issue for us was most likely that we used CPU compute for the deployed embedding model, switching to GPU (small) solved the issue. 

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group