- 2820 Views
- 4 replies
- 0 kudos
Secrets ACL API Behavior Change
Hey all,Has the behavior of the Secrets ACL API changed over the last 24 hours? With no code changes on our scope-deployment pipeline, I am suddenly getting strange errors back from this endpoint.Anybody else noticing a change?Thanks,Alex
- 2820 Views
- 4 replies
- 0 kudos
- 0 kudos
Idk, I control the resource group myself and I don't remember ever granting or revoking contributor roles on that RG for any of these users which are now suddenly throwing errors. Interesting to see that line from the docs... I wonder if that was alw...
- 0 kudos
- 1321 Views
- 0 replies
- 0 kudos
Unity Catalog Enabled Clusters using PrivateNIC
Hello,When reviewing the VM settings for Databricks worker VMs, we can see that there are two(2) NICs.A primary ( PublicNIC (primary)) and a secondary (PrivateNIC (primary)).The workers VM is always assigned the PublicNIC and this is reachable from w...
- 1321 Views
- 0 replies
- 0 kudos
- 4855 Views
- 4 replies
- 1 kudos
Databricks is taking too long to run a query
I ran a simple query. It is taking too much time and it doesn't stop running. I am the only one who is using cluster. It's happening to every notebook in the workspace.
- 4855 Views
- 4 replies
- 1 kudos
- 3956 Views
- 2 replies
- 1 kudos
Resolved! Native service principal support in JDBC/ODBC drivers
Read from Databricks integration best practises about the native support for Service Principal authentication on JDBC/ODBC drivers. The timetable mentioned for this was "expected to land in 2023", is this referring to the https://docs.databricks.com/...
- 3956 Views
- 2 replies
- 1 kudos
- 1 kudos
@harripy As it says in the documentation, JDBC driver 2.6.36 and above supports Azure Databricks OAuth secrets for OAuth M2M or OAuth 2.0 client credentials authentication. Microsoft Entra ID secrets are not supported.https://learn.microsoft.com/en-u...
- 1 kudos
- 3065 Views
- 1 replies
- 2 kudos
Resolved! What happens to the Workspace when deleting the user that created that workspace
Hi,Background:In Azure-Datebricks:We have a personal account that created a workspace, this workspace is our main workspace. The users Microsoft Office account is already deleted but the user still exist in Databricks.Question 1 is:What happens to th...
- 3065 Views
- 1 replies
- 2 kudos
- 2 kudos
What happens to this workspace if we delete the User from workspace? Will the Workspace be deleted? → Workspace will not get deleted. It will continue to function.Is it possible to change Workspace own to another account i.e. a service account. If so...
- 2 kudos
- 4798 Views
- 1 replies
- 1 kudos
Resolved! Import folder (no .whl or .jar files) and run the `python3 setup.py bdist_wheel` for lib install
I want to import the ibapi python module in Azure Databricks Notebook.Before this, I downloaded the the TWS API folder from https://interactivebrokers.github.io/# I need to go through the following steps to install the API:Download and install TWS Ga...
- 4798 Views
- 1 replies
- 1 kudos
- 1 kudos
You can try to upload the folder in the workspace location and try to cd in the desired folder and try to install in via notebook. But it would be a notebook scope installation. If you are looking for a cluster scoped installation then you would need...
- 1 kudos
- 2650 Views
- 3 replies
- 0 kudos
Permission denied using patchelf
Hello all I would like to run a Python script on a Shared cluster: The Python script tries to do, under the hood, a call to `patchelf` utility, in order to set a r-path. Something along those lines:execute('patchelf',['--set-rpath', rpath, lib])The p...
- 2650 Views
- 3 replies
- 0 kudos
- 0 kudos
I basically followed this tutorial https://learn.microsoft.com/en-gb/azure/databricks/data-governance/unity-catalog/get-started and it seemed to be working, so I guess Unity Catalog is enabled?
- 0 kudos
- 3302 Views
- 1 replies
- 0 kudos
Why does use of Azure SSO require Databricks PAT enabled ?
My org uses Databricks and SSO. We are keen to disable the use of PAT but have noticed that when it's disabled, we're not able to use SSO. May I ask why does SSO have a dependency on PATs [arguably they are two distinct authentication methods] ?Also,...
- 3302 Views
- 1 replies
- 0 kudos
- 6361 Views
- 2 replies
- 0 kudos
Resolved! Call an Azure Function App with Access Restrictions from a Databricks Workspace
Hello,As the title says, I am trying to call an function from an Azure Function App configured with access restrictions from a python notebook in my Databricks workspace. The Function App resource is in a different subscription as the Databricks work...
- 6361 Views
- 2 replies
- 0 kudos
- 0 kudos
Update : Problem was fixed ! The key was to set an VNET rule in the access restriction, giving access directly to the subnets used by Databricks.It seems like for Microsoft to Microsoft connections, the IP addresses are not used, so adding the IP ran...
- 0 kudos
- 2702 Views
- 0 replies
- 0 kudos
Azure Devops repos access
I have a Databricks setup, where the users and their permissions are handled in Microsoft Azure using AD groups and then provisioned (account level) using a provisioning connector to Databricks. The code repositories are in Azure Devops where users a...
- 2702 Views
- 0 replies
- 0 kudos
- 7916 Views
- 3 replies
- 2 kudos
How to bind a User assigned Managed identity to Databricks to access external resources?
Is there a way to bind a user assigned managed identity to Databricks? We want to access some SQL DBs, Redis cache from our Spark code running on Databricks using Managed Identity instead of Service Principals and basic authentication.As of today, Da...
- 7916 Views
- 3 replies
- 2 kudos
- 2 kudos
@Carpender correcting my comment above, Databricks assigned Managed Identity is working and we are able to access but as stated in the original question we are looking for authorization using User Assigned Managed Identity (UAMI). With UAMI we cannot...
- 2 kudos
- 6080 Views
- 1 replies
- 0 kudos
How to setup service principal to assing account-level groups to workspaces using terraform
Based on best practices, we have set up SCIM provisioning using Microsoft Entra ID to synchronize Entra ID groups to our Databricks account. All workspaces have identity federation enabled.However, how should workspace administrators assign account-l...
- 6080 Views
- 1 replies
- 0 kudos
- 0 kudos
Have you tried giving Manager role on the group to the service principal which is workspace admin? Once you do this you may be able to use the settings to In workspace context, adding account-level group to a workspace in databricks_permission_assig...
- 0 kudos
- 2359 Views
- 1 replies
- 0 kudos
Resolved! Instances are not being terminated in time (extra AWS costs)
For a few days we have been trying to figure out why our AWS costs suddenly went up around March 20th, and we just found the answer: the EC2 instances are left in an unterminated state for a couple of minutes at the end of each run! This is a very se...
- 2359 Views
- 1 replies
- 0 kudos
- 0 kudos
Nevermind, this was actually due to a reservation that expired. 臘
- 0 kudos
- 3208 Views
- 2 replies
- 1 kudos
Error: Node.js SQL Driver auth using M2M
I am trying to follow the documentation in order to establish a M2M authentication through the Node.js SQL Driver. I am however having issues as it results in the following error message. What is it that I am not seeing here?Error msg:{"level":"info"...
- 3208 Views
- 2 replies
- 1 kudos
- 1 kudos
Not sure if you're still suck on this but I had the same issue and managed to resolve it by adding azureTenantId: <my-tenant-id> and useDatabricksOAuthInAzure: true in the client connection options. Hope this helps!
- 1 kudos
- 5352 Views
- 2 replies
- 0 kudos
Setup unity catalog external location to minio
We have a minio server running in Azure that we have connected to the spark clusters directly. As we move to unity catalog, we would like to make the data stored in our minio servers accessible as an external location in Azure Databricks account via ...
- 5352 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Retired_mod ,I have a server on Azure that supports the S3 protocol, and I am trying to follow these instructions in order to use Unity on Azure DataBricks with it. I am not sure about this part of your reply:Set the Spark configuration values i...
- 0 kudos
