Lakeflow Connect - Column filtering

[amitpm]

Hi community , I am interested in learning more about the feature that was mentioned in recent summit about query pushdown in lakeflow connect for SQL server. I believe this feature will allow to select only the required columns from source tables. Is there any indication when this feature will be available for trial? Until we wait for this feature are there other alternatives that anyone recommends?

[Isi]

Hey @amitpm 

According to the documentation, this feature is currently in Public Preview, so if your Databricks account has access to public preview features, you can reach out to support to enable it and start testing performance.

Setup guide for Lakehouse Federation with SQL Server

Supported pushdowns (predicates, projections, etc.)

While Lakehouse Federation has some performance limitations, it’s a solid alternative if you want to avoid using the Spark connector and prefer a declarative connection model.

Comparison between Lakehouse Federation vs. LakeFlow Connect 

Known limitations of Lakehouse Federation

Hope this helps, 🙂

Isi