Vector Search Indexes on dlt pipelines / materialized views
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-15-2025 11:37 AM
Hello,
I am not seeing the "create vector search index" option on my materialized views I created from Databricks Asset Bundles using dlt.
Is this expected behavior?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-16-2025 12:30 PM
DLT materialized views have different properties than regular Delta tables, and vector search indexing may not be directly supported on them through the UI.
Try creating programatically.
client = VectorSearchClient()
# Create the index
client.create_delta_sync_index(
endpoint_name="your-endpoint-name",
index_name="your-index-name",
source_table_name="your.dlt.materialized_view",
pipeline_type="TRIGGERED", # or "CONTINUOUS"
primary_key="id",
embedding_source_column="text_column",
embedding_model_endpoint_name="your-embedding-endpoint"
)
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-16-2025 12:59 PM
Yes, that failed because I didn't have change data capture on, which I learned materialized views don't support.
I really like the dev/prod Databricks Asset Bundles, but I'm not sure the forcing of materialized views is compatible with a lot of work I need to do?