- 81 Views
- 0 replies
- 0 kudos
Hello Community. I have a user trying to use R and receive the error message illustrated on the attachment. I can't seem to find correct documentation on enabling R on an existing cluster. Would anyone be able to point me in the right direction? Than...
- 81 Views
- 0 replies
- 0 kudos
- 5469 Views
- 8 replies
- 8 kudos
Simple question : what is the way to go to install libraries on job clusters ? There does not seem to be a "Libraries" tab on the UI as opposed to regular clusters. Does it mean that the only option is to use init scripts ?
- 5469 Views
- 8 replies
- 8 kudos
Latest Reply
@daniel_sahalflappy birdIs there another way to add libraries to the ADF Databricks task even faster?
7 More Replies
- 131 Views
- 5 replies
- 0 kudos
Tried to use M2M OAuth connectivity on Databricks SQL Warehouse in Python:from databricks.sdk.core import Config, oauth_service_principal
from databricks import sql
....
config = Config(host=f"https://{host}",
client_...
- 131 Views
- 5 replies
- 0 kudos
Latest Reply
@harripy I've just looked through the Databricks SDK code and it looks like m2m auth is generating oauth bearer token to authenticate, that's why you see "access_token", but it's different from PAT (https://github.com/databricks/databricks-sdk-py/blo...
4 More Replies
- 411 Views
- 2 replies
- 1 kudos
Hi everyone,Is it possible with Terraform or Azure CLI or any other not manual method to get the value for Azure Databricks Account ID and not to use manual method as is described here - https://learn.microsoft.com/en-us/azure/databricks/administrati...
- 411 Views
- 2 replies
- 1 kudos
Latest Reply
Hi @RozaZaharieva, To retrieve the Azure Databricks Account ID without manual intervention, you can use the following methods:
Azure CLI: You can use the Azure CLI to query the account details. Run the following command to get the account ID:
a...
1 More Replies
- 578 Views
- 6 replies
- 3 kudos
We have Azure Databricks with standard private link (back-end and front-end private link).We are able to successfully attach a Databricks workspace to the Databricks metastore (ADLS Gen2 storage).However, when trying to create tables in a catalog in ...
- 578 Views
- 6 replies
- 3 kudos
Latest Reply
can confirm that the approach will solve your error. Ran into a similar issue a while back.
5 More Replies
- 237 Views
- 4 replies
- 0 kudos
Hey all,Has the behavior of the Secrets ACL API changed over the last 24 hours? With no code changes on our scope-deployment pipeline, I am suddenly getting strange errors back from this endpoint.Anybody else noticing a change?Thanks,Alex
- 237 Views
- 4 replies
- 0 kudos
Latest Reply
Idk, I control the resource group myself and I don't remember ever granting or revoking contributor roles on that RG for any of these users which are now suddenly throwing errors. Interesting to see that line from the docs... I wonder if that was alw...
3 More Replies
- 182 Views
- 1 replies
- 0 kudos
For the current Databricks service principal API or the Databricks SDK, an ID is required. However, when dealing with Databricks-managed service principals, you typically only have the name. For registering with cloud providers, like Microsoft Entra ...
- 182 Views
- 1 replies
- 0 kudos
Latest Reply
@SunilPoluri, could you please provide some more context by providing screenshots?
- 300 Views
- 0 replies
- 0 kudos
Hello,When reviewing the VM settings for Databricks worker VMs, we can see that there are two(2) NICs.A primary ( PublicNIC (primary)) and a secondary (PrivateNIC (primary)).The workers VM is always assigned the PublicNIC and this is reachable from w...
- 300 Views
- 0 replies
- 0 kudos
- 147 Views
- 0 replies
- 0 kudos
Is it possible to trigger a git reset --hard programatically?I'm running a platform service where, as part of CI/CD, repos get deployed into the Databricks workspace. Normally, our developers work with upstream repos both from their local IDEs and fr...
- 147 Views
- 0 replies
- 0 kudos
- 263 Views
- 4 replies
- 1 kudos
I ran a simple query. It is taking too much time and it doesn't stop running. I am the only one who is using cluster. It's happening to every notebook in the workspace.
- 263 Views
- 4 replies
- 1 kudos
Latest Reply
Do you see spark jobs running in Spark UI ?
3 More Replies
- 233 Views
- 2 replies
- 0 kudos
Hi, We are executing DML calls on Databricks SQL Warehouse programmatically, with Java and Python.There can be thousands of executions running on daily level, so in case of an error occurs, it would be very beneficial to spot the Statement ID of the ...
- 233 Views
- 2 replies
- 0 kudos
Latest Reply
Hi @harripy,
To retrieve the Statement ID from a Databricks SQL Warehouse execution using the Java SDK, you can follow these steps:
Execute the Query: First, execute your DML query using the Java JDBC connection. You can use the java.sql.Statement ...
1 More Replies
- 372 Views
- 2 replies
- 1 kudos
Read from Databricks integration best practises about the native support for Service Principal authentication on JDBC/ODBC drivers. The timetable mentioned for this was "expected to land in 2023", is this referring to the https://docs.databricks.com/...
- 372 Views
- 2 replies
- 1 kudos
Latest Reply
@harripy As it says in the documentation, JDBC driver 2.6.36 and above supports Azure Databricks OAuth secrets for OAuth M2M or OAuth 2.0 client credentials authentication. Microsoft Entra ID secrets are not supported.https://learn.microsoft.com/en-u...
1 More Replies
by
Swoops
• New Contributor II
- 736 Views
- 1 replies
- 2 kudos
Hi,Background:In Azure-Datebricks:We have a personal account that created a workspace, this workspace is our main workspace. The users Microsoft Office account is already deleted but the user still exist in Databricks.Question 1 is:What happens to th...
- 736 Views
- 1 replies
- 2 kudos
Latest Reply
What happens to this workspace if we delete the User from workspace? Will the Workspace be deleted? → Workspace will not get deleted. It will continue to function.Is it possible to change Workspace own to another account i.e. a service account. If so...
by
Dicer
• Valued Contributor
- 769 Views
- 1 replies
- 0 kudos
I want to import the ibapi python module in Azure Databricks Notebook.Before this, I downloaded the the TWS API folder from https://interactivebrokers.github.io/# I need to go through the following steps to install the API:Download and install TWS Ga...
- 769 Views
- 1 replies
- 0 kudos
Latest Reply
You can try to upload the folder in the workspace location and try to cd in the desired folder and try to install in via notebook. But it would be a notebook scope installation. If you are looking for a cluster scoped installation then you would need...
- 415 Views
- 1 replies
- 0 kudos
Hello,I'm trying to test SSO with Azure AD.The test sso is passing on dtabricks and I can connect to databricks using SSO.When I try to test with postman to obtain a token I have the next error message :{"error_description":"OAuth application with ...
- 415 Views
- 1 replies
- 0 kudos
Latest Reply
Hi @Daniela_Boamba The error message you're seeing indicates that the OAuth application with client_id: 'fba3-ecc4-4b27-b48c-46' is not available in your Databricks account. This could mean that the client_id is incorrect or the OAuth application has...