by
ajbush
• New Contributor III
- 9268 Views
- 6 replies
- 2 kudos
Hi all,I'm just reaching out to see if anyone has information or can point me in a useful direction. I need to connect to Snowflake from Azure Databricks using the connector: https://learn.microsoft.com/en-us/azure/databricks/external-data/snowflakeT...
- 9268 Views
- 6 replies
- 2 kudos
Latest Reply
@ludgervisser We are trying to connect to Snowflake via Azure AD user through the externalbrowser method but the browser window doesn't open. Could you please share an example code of how you managed to achieve this, or to some documentation? @BobGeo...
5 More Replies
by
Jon
• New Contributor II
- 1851 Views
- 4 replies
- 5 kudos
How can I fix the IP address of my Azure Cluster so that I can whitelist the IP address to run my job daily on my python notebook? Or can I find out the IP address to perform whitelisting? Thanks
- 1851 Views
- 4 replies
- 5 kudos
Latest Reply
Depends on the scenario. You could expose a single ip address to the external internet, but databricks itself will always use many addresses.
3 More Replies
- 15915 Views
- 27 replies
- 14 kudos
Databricks Repos best-practices recommend using the Repos REST API to update a repo via your git provider. The REST API requires authentication, which can be done one of two ways:A user / personal access tokenA service principal access tokenUsing a u...
- 15915 Views
- 27 replies
- 14 kudos
Latest Reply
Having the exact same problem. Did you find a solution @michael_mehrten ?In my case Im using a managed identity so the solution some topics suggest on generating an access token from a Entra ID service principal is not applicable.
26 More Replies
- 2071 Views
- 3 replies
- 0 kudos
I am trying to evaluate options for Monitoring and Alerting tools like New Relic, Datadog, Grafana with Databricks on Azure . No one supports when reached out to them. I would like to hear from the databricks team on the recommended tool / framework ...
- 2071 Views
- 3 replies
- 0 kudos
Latest Reply
I'd recommend this new tool we've been trying out. It's really helpful for monitoring and provides good insights on how Azure Databricks clusters, pools & jobs are doing – like if they're healthy or having issues. It brings everything together, makin...
2 More Replies
- 2832 Views
- 5 replies
- 1 kudos
I have setup authentication using this page https://docs.databricks.com/sql/api/authentication.html and run curl -n -X GET https://<databricks-instance>.cloud.databricks.com/api/2.0/sql/history/queriesTo get history of all sql endpoint queries, but I...
- 2832 Views
- 5 replies
- 1 kudos
Latest Reply
Are you sure this works?payload = { "filter_by": { }, "max_results": 1} Returns 1 result. payload = { "filter_by": { "query_start_time_range":{ "start_time_ms" :1640995200000, "end_time_ms" : 1641081599000 } }, "max_results": 1...
4 More Replies
- 2855 Views
- 9 replies
- 2 kudos
HelloAfter creating an Databricks Workspace in Azure with No Public IP and VNET Injection, I'm unable to use DBSQL Serverless because the option to enable it in SQL warehouse Settings is missing. ​Is it by design? Is it a limitation when using Privat...
- 2855 Views
- 9 replies
- 2 kudos
Latest Reply
I am starting up with databricks and having the same issue. This is very unexpected, since SQL Serverless is advertised so heavily. I have only seen it noted in one place thus far that restricted networking can preclude you from using this. Please le...
8 More Replies
- 18858 Views
- 18 replies
- 11 kudos
Hi Team,May i know how to read Azure storage data in Databricks through Python.
- 18858 Views
- 18 replies
- 11 kudos
Latest Reply
@Kaniz Fatma​ need full syllabus of Azure Databricks
17 More Replies
by
Hal
• New Contributor II
- 604 Views
- 1 replies
- 3 kudos
Can someone share with me the proper way to connect Power BI running on Azure to Databricks running on AWS?
- 604 Views
- 1 replies
- 3 kudos
Latest Reply
Have the same question. Do we have to take care of any specific tasks to make it work. Anyone who implemented it?
by
Bas1
• New Contributor III
- 5957 Views
- 17 replies
- 20 kudos
In Azure Databricks the DBFS storage account is open to all networks. Changing that to use a private endpoint or minimizing access to selected networks is not allowed.Is there any way to add network security to this storage account? Alternatively, is...
- 5957 Views
- 17 replies
- 20 kudos
Latest Reply
How can we secure the storage account in the managed resource group which holds the DBFS with restricted network access, since access from all networks is blocked by our Azure storage account policy?
16 More Replies
- 2289 Views
- 4 replies
- 5 kudos
Hi, everyone. I just recently started using Databricks on Azure so my question is probably very basic but I am really stuck right now.I need to capture some streaming metrics (number of input rows and their time) so I tried using the Spark Rest Api ...
- 2289 Views
- 4 replies
- 5 kudos
Latest Reply
hi @Roberto Baldrez​ ,if you think that @Gaurav Rupnar​ solved your question, then please select it as best response to it can be moved to the top of the topic and it will help more users in the future.Thank you
3 More Replies
- 1886 Views
- 3 replies
- 2 kudos
We already know that we can mount Azure Data Lake Gen2 with OAuth2 using this:configs = {"fs.azure.account.auth.type": "OAuth",
"fs.azure.account.oauth.provider.type": "org.apache.hadoop.fs.azurebfs.oauth2.ClientCredsTokenProvider",
...
- 1886 Views
- 3 replies
- 2 kudos
Latest Reply
Is there any update on this feature request? OAuth still seems not to be working with Azure Blob Storage... Configuration works fine for ADLS gen 2, but for Azure Blob Storage still only SAS and Account key seems to be working.
2 More Replies
- 21084 Views
- 7 replies
- 11 kudos
Hi everyone,Do you guys know if it's possible to automate the Databricks workflow deployment through azure devops (like what we do with the deployment of notebooks)?
- 21084 Views
- 7 replies
- 11 kudos
Latest Reply
Did you get a chance to try Brickflows - https://github.com/Nike-Inc/brickflowYou can find the documentation here - https://engineering.nike.com/brickflow/v0.11.2/Brickflow uses - Databricks Asset Bundles(DAB) under the hood but provides a Pythonic w...
6 More Replies
by
ChrisS
• New Contributor III
- 1917 Views
- 7 replies
- 8 kudos
I learning data bricks for the first time following the book that is copywrited in 2020 so I imagine it might be a little outdated at this point. What I am trying to do is move data from an online source (in this specific case using shell script but ...
- 1917 Views
- 7 replies
- 8 kudos
Latest Reply
In Databricks, you can install external libraries by going to the Clusters tab, selecting your cluster, and then adding the Maven coordinates for Deequ. This represents the best b2b data enrichment services in Databricks.In your notebook or script, y...
6 More Replies
- 2349 Views
- 6 replies
- 3 kudos
Hello, we have Databricks Python workbooks accessing Delta tables. These workbooks are scheduled/invoked by Azure Data Factory. How can I enable Photon on the linked services that are used to call Databricks?If I specify new job cluster, there does n...
- 2349 Views
- 6 replies
- 3 kudos
Latest Reply
When you create a cluster on Databricks, you can enable Photon by selecting the "Photon" option in the cluster configuration settings. This is typically done when creating a new cluster, and you would find the option in the advanced cluster configura...
5 More Replies
- 3095 Views
- 7 replies
- 2 kudos
Hi allI have a task of type Notebook, source is Git (Azure DevOps). This task runs fine with my user, but if I change the Owner to a service principal, I get the following error:Run result unavailable: run failed with error message Failed to checkout...
- 3095 Views
- 7 replies
- 2 kudos
Latest Reply
@pgruetter​ :To enable a service principal to access a specific Azure DevOps repository, you need to grant it the necessary permissions at both the organization and repository levels.Here are the steps to grant the service principal the necessary per...
6 More Replies
