Lakeflow clarification

[Ramki]

Are there options to modify the streaming table after it has been created by the Lakeflow pipeline? In the use case I'm trying to solve, I need to add delta.enableIcebergCompatV2 and delta.universalFormat.enabledFormats to the target streaming table. The pipeline is set in triggered mode and is not running continuously.

Thank you for your assistance.

[lingareddy_Alva]

Hi @Ramki 

Yes, you can modify a streaming table created by a LakeFlow pipeline, especially when the pipeline is in triggered mode (not running continuously).
In your case, you want to add the following Delta table properties:

TBLPROPERTIES (
  'delta.enableIcebergCompatV2' = 'true',
  'delta.universalFormat.enabledFormats' = 'iceberg'
)

Since your pipeline is in triggered mode, you can safely alter the target table outside of the pipeline run using a regular SQL command
in a Databricks notebook or SQL editor:

ALTER TABLE <your_table_name>
SET TBLPROPERTIES (
  'delta.enableIcebergCompatV2' = 'true',
  'delta.universalFormat.enabledFormats' = 'iceberg'
);