Lakeflow clarification

Ramki
New Contributor

‎06-18-2025 02:35 PM

Are there options to modify the streaming table after it has been created by the Lakeflow pipeline? In the use case I'm trying to solve, I need to add delta.enableIcebergCompatV2 and delta.universalFormat.enabledFormats to the target streaming table. The pipeline is set in triggered mode and is not running continuously.

Thank you for your assistance.

0 Kudos

lingareddy_Alva
Esteemed Contributor

‎06-18-2025 04:40 PM - edited ‎06-18-2025 04:44 PM

Hi @Ramki 

Yes, you can modify a streaming table created by a LakeFlow pipeline, especially when the pipeline is in triggered mode (not running continuously).
In your case, you want to add the following Delta table properties:

 

TBLPROPERTIES (
  'delta.enableIcebergCompatV2' = 'true',
  'delta.universalFormat.enabledFormats' = 'iceberg'
)

 

Since your pipeline is in triggered mode, you can safely alter the target table outside of the pipeline run using a regular SQL command
in a Databricks notebook or SQL editor:

 

ALTER TABLE <your_table_name>
SET TBLPROPERTIES (
  'delta.enableIcebergCompatV2' = 'true',
  'delta.universalFormat.enabledFormats' = 'iceberg'
);

 

 

LR
0 Kudos