Databricks

ajbush · 05-22-2023

Hi all,I'm deploying Unity Catalog into a large enterprise with quite strict controls. I want to give my users some autonomy over creating tables from upstream datasets they have select access on, but also restrict these controls. I've been through a...

ajbush · 02-07-2023

Hi,I have an Azure Databricks instance configured to use VNet injection with secure cluster connectivity. I have an Azure Firewall configured and controlling all traffic ingress and egress locations as per this article: https://learn.microsoft.com/en...

ajbush · 01-26-2023

Hi all,I'm just reaching out to see if anyone has information or can point me in a useful direction. I need to connect to Snowflake from Azure Databricks using the connector: https://learn.microsoft.com/en-us/azure/databricks/external-data/snowflakeT...

ajbush · 06-08-2023

We had confirmation from Databricks that the approach detailed in my reply was the only workable approach for user-based SSO. We ended up replicating data across from Snowflake into Databricks in the end. Another approach is to use a service account ...

ajbush · 02-12-2023

It might be useful to update the Azure docs to include the addresses of the sample Datasets in AWS so they can be accessed from clusters in Azure that are using a Firewall: https://learn.microsoft.com/en-us/azure/databricks/resources/supported-region...

ajbush · 02-08-2023

Hi Debayan,Thank you for the reply and the links.I have configured the workspace and Azure infrastructure as described in the links. All the storage and clusters were working except for the sample datasets.I did a little digging into the firewall log...

ajbush · 01-31-2023

The above question refers to SAML authentication for SSO in Snowflake with AAD.I can see this isn't going to work without some proxying magic of the localhost session on the driver that serves the authentication redirect.Since then, I tried to go dow...

Databricks

User Stats

User Activity

Unity Catalog permissions approach for strict controls when creating tables

Sample Datasets URL in Azure Databricks / access sample datasets when NPIP and Firewall is enabled

Connecting to Snowflake using an SSO user from Azure Databricks

Re: Connecting to Snowflake using an SSO user from Azure Databricks

Re: Sample Datasets URL in Azure Databricks / access sample datasets when NPIP and Firewall is enabled

Re: Sample Datasets URL in Azure Databricks / access sample datasets when NPIP and Firewall is enabled

Re: Connecting to Snowflake using an SSO user from Azure Databricks