Databricks Community

MariuszK · 02-04-2025

Hi,Sometime ago, I got a message that there will be a change (starting from 01/31/2025) in "deletion behavior of Materialized View and Streaming Tables defined by Delta Live Table", but when I remove dlt pipeline, it also removes related tables, will...

MariuszK

If you want to play with SQL Server the easy way is to use Azure SQL that will be visuable for Databricks. Alternativly you can use ADF with slef-hosted run time to extract data to Azure from SQL Server.Network configuration requires many steps and i...

MariuszK

Hi,It's not so easy. It could work, but you would need a VNet integrated with your onpremises network where this computer is connected, configured private endpoints for Databricks and configured entries in DNS for LAPTOP-XXXXXX.

MariuszK

This code will not work. You can try this:import osfrom sqlalchemy import create_engineaccess_token = os.getenv("DATABRICKS_TOKEN")server_hostname = os.getenv("DATABRICKS_SERVER_HOSTNAME")http_path = os.getenv("DATABRICKS_HTTP_PATH")catalog = os.gete...

MariuszK

Hi,Did you check a possibility to use if/else task? You could define some scriteria and pass it from a notebok that will check if it's time for full refresh or just resfres.

MariuszK

I think some one add the SP using the add new button in the service principal wirndow. You can add there display name and application id.

Databricks Community

User Stats

User Activity

Changes to deletion behavior of Materialized View and Streaming Tables defined by Delta Live Table

Re: ON-Prem SQL Server Direct Connection with Azure Databricks

Re: ON-Prem SQL Server Direct Connection with Azure Databricks

Re: Connecting to SQL on Databricks Using SQLAlchemy or pyodbc

Re: DLT pipeline task with full refresh once in a while

Re: Service Principal Name vs. Application ID in Catalog Explorer – How to Display Only Names?