Databricks Community

Akash_Varuna · 02-18-2026

Data Leakage in Historical Table from Streaming TableEnvironmentPlatform: Azure Databricks + Azure Event HubsStreaming Framework: Spark Structured StreamingStorage: Delta LakePipeline Event Hubs → stream_messages (live 24hr rolling window) → message...

Akash_Varuna · 03-14-2025

Hi @cony2025 Could you load the whole table as TempView and see if what happensdf = (spark.read.format("jdbc") .option("url", jdbc_url) .option("dbtable", "wphub_poc.gold.v_d_building") .option("user", "token") .option("password", acc...

Akash_Varuna · 03-13-2025

Hi @ShailenGenpact Could you check this post maybe this might help you https://community.databricks.com/t5/data-engineering/sparkcontext-in-runtime-15-3/td-p/81646In this they have said similar case and some alternate workarounds they have used

Databricks Community

User Stats

User Activity

Streaming Table data leakage to historical permanent table

Re: Use Python notebook to read data from Databricks

Re: How to Create Cluster for running JOB