topic Re: Vector Search Indexes on dlt pipelines / materialized views in Generative AI

Vector Search Indexes on dlt pipelines / materialized views

dbx_beginner_10 — Tue, 15 Jul 2025 18:37:13 GMT

Hello,

I am not seeing the "create vector search index" option on my materialized views I created from Databricks Asset Bundles using dlt.

Is this expected behavior?

Re: Vector Search Indexes on dlt pipelines / materialized views

nayan_wylde — Wed, 16 Jul 2025 19:30:12 GMT

DLT materialized views have different properties than regular Delta tables, and vector search indexing may not be directly supported on them through the UI.

Try creating programatically.

client = VectorSearchClient() # Create the index client.create_delta_sync_index( endpoint_name="your-endpoint-name", index_name="your-index-name", source_table_name="your.dlt.materialized_view", pipeline_type="TRIGGERED", # or "CONTINUOUS" primary_key="id", embedding_source_column="text_column", embedding_model_endpoint_name="your-embedding-endpoint" )

Re: Vector Search Indexes on dlt pipelines / materialized views

dbx_beginner_10 — Wed, 16 Jul 2025 19:59:35 GMT

Yes, that failed because I didn't have change data capture on, which I learned materialized views don't support.

I really like the dev/prod Databricks Asset Bundles, but I'm not sure the forcing of materialized views is compatible with a lot of work I need to do?