Lakeflow clarification

Ramki — Wed, 18 Jun 2025 21:35:46 GMT

Are there options to modify the streaming table after it has been created by the Lakeflow pipeline? In the use case I'm trying to solve, I need to add delta.enableIcebergCompatV2 and delta.universalFormat.enabledFormats to the target streaming table. The pipeline is set in triggered mode and is not running continuously.

Thank you for your assistance.

Re: Lakeflow clarification

lingareddy_Alva — Wed, 18 Jun 2025 23:44:25 GMT

Hi @Ramki

Yes, you can modify a streaming table created by a LakeFlow pipeline, especially when the pipeline is in triggered mode (not running continuously).
In your case, you want to add the following Delta table properties:

TBLPROPERTIES ( 'delta.enableIcebergCompatV2' = 'true', 'delta.universalFormat.enabledFormats' = 'iceberg' )

Since your pipeline is in triggered mode, you can safely alter the target table outside of the pipeline run using a regular SQL command
in a Databricks notebook or SQL editor:

ALTER TABLE <your_table_name> SET TBLPROPERTIES ( 'delta.enableIcebergCompatV2' = 'true', 'delta.universalFormat.enabledFormats' = 'iceberg' );

topic Re: Lakeflow clarification in Data Engineering

Lakeflow clarification

Re: Lakeflow clarification