Poorva21
Contributor II

Yes, it’s possible to have a Lakehouse table synced with a Delta table in Unity Catalog. You have a few options:

  1. Direct read: Register the Delta table in Unity Catalog and query it directly from your Streamlit app.

  2. Delta Live Tables (DLT): Create a DLT pipeline that reads the Delta table and writes a managed Lakehouse table that automatically updates on changes.

  3. Materialized view: Create a SQL materialized view on the Delta table and refresh it periodically.

For production with transformations, use a DLT pipeline; for simple dashboards, direct Delta read works. Streamlit can connect via Databricks SQL Connector or JDBC/ODBC to fetch the latest data.

This ensures your app always sees the updated data in near real-time.