Databricks Community

SaugatMukherjee

According to this https://iceberg.apache.org/docs/latest/spark-structured-streaming/ , we can stream from iceberg tables. I have ensured that my source table is Iceberg version 3, but no matter what I do, I get Iceberg does not streaming reads. Looki...

SaugatMukherjee · 12-18-2023

Hi,I am sending databricks sql alerts to an email. I am trying to get the query results table in the body of the email.I have used a custom template with {{QUERY_RESULT_TABLE}}and this works fine for a teams alert. In Teams, I can see the table prope...

SaugatMukherjee

Hi,Iceberg streaming is possible in Databricks. One does not need to change to Delta Lake. In my previous attempt, I used "load" while reading the source iceberg table. One should instead use "table". Load apparently seems to take a path and not a ta...

SaugatMukherjee · 09-09-2025

Hi,I have done this in the past successfully. You do not have to delete a metastore if you are moving anywhere within the same tenant.Metastore is essentially 2 things1. Storage account , whose identifier is of the format abfss://container@datalakena...

SaugatMukherjee · 01-02-2024

Hi Subbaram,You should post a new question for this. I will then try to answer.

SaugatMukherjee · 12-20-2023

Ok, so I have been able to test this.Basically to remove permissions, you will have to use the "Set SQL Warehouse permissions" using "PUT" and provide it the full list of people, who should have access, leaving out those, who shouldn't, like I mentio...

SaugatMukherjee · 12-19-2023

I use Terraform to set sql warehouse permissions, but it should be the same. I use the rest api for other things.So, basically for a warehouse id, you need to pass on the entire array of users who would have access.So, if there were 3 users with perm...

Databricks Community

User Stats

User Activity

Structured streaming for iceberg tables

SQL Alert Email with QUERY_RESULTS_TABLE results in table with no border

Re: Structured streaming for iceberg tables

Re: Move metastore to another azure subscription

Re: Creating Databricks Alerts/Notifications without using the UI

Re: "Revoke" permissions for SQL-Warehouse with API

Re: "Revoke" permissions for SQL-Warehouse with API