- 1786 Views
- 1 replies
- 0 kudos
Azure SP OAuth wont generate token
Hi all,Hopefully someone has had this issue and fixed it before. No matter how many times I try, no token is generated (yes, i am in a premium tier). Any ideas? I tried using the API but I got this error that apparently is because I am in Azure. for ...
- 1786 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @_rafa ,Currently, we do not have an API similar to the "https://<databricks-instance>/api/2.0/token-management/on-behalf-of/tokens" in azure as Azure supports the service principle authentication by default. Please authenticate to normal PAT ...
- 0 kudos
- 3260 Views
- 1 replies
- 0 kudos
Azure Databricks SQL Warehouse tags not being populated
In Azure cost monitor I am trying to get list of my cluster names and cost associated to it.It works fine with job cluster and all purpos clusters but not for SQL Warehouses.When you look at below example, where I am querying only for my SQL Warehous...
- 3260 Views
- 1 replies
- 0 kudos
- 0 kudos
@Wojciech_BUK I would recommend you get in touch with the Azure Pricing team once to check this in a great deatil.
- 0 kudos
- 1301 Views
- 1 replies
- 0 kudos
How to delete or update cluster-scoped init scripts
We are working on to deprecate the dbfs based cluster-scoped init scripts and replace them with workspace based, therefore finding a way to delete the dbfs cluster-scoped init scripts from all the clusters that are running in our environment using RE...
- 1301 Views
- 1 replies
- 0 kudos
- 0 kudos
@dbx_8451 There is no direct way for doing it, you may need to automate using the list Cluster API.
- 0 kudos
- 2161 Views
- 1 replies
- 0 kudos
No enable option for Customize containers with Databricks Container Services on Azure and GCP
Customize containers with Databricks Container ServicesI want to create a spark cluster with the hail container [1]. But there is no Enable Container Services on the Workspace configuration for Azure Databricks and GCP Databricks.The API does not ret...
- 2161 Views
- 1 replies
- 0 kudos
- 0 kudos
Did you tested out using the cluster API ?
- 0 kudos
- 1879 Views
- 1 replies
- 0 kudos
Change users status in account console
One of our users has status = Inactive in Admin setting. I tried to set it to active using rest api and the documentation but seems like api is not changing status.I tested api and I can list users so api setting are ok.api request: import requests i...
- 1879 Views
- 1 replies
- 0 kudos
- 0 kudos
@alesventus Can you test the same using CLI or may be try to make the status as inactive for a dummy user? Just want to validate if the API is actually working for you or not.
- 0 kudos
- 1162 Views
- 1 replies
- 0 kudos
spark.databricks documentation
I cannot find any documentation related to the spark.databricks.* I was able to find the spark related documentation but it does not contain any information on possible properties or arguments for spark.databricks in particular. Thank you!
- 1162 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @ianc , Databricks have documentation for the product feature and its underlying spark properties(as applicable). If you are looking for one place documentation for all the spark.databricks.*, it is not available. hOwever we can help to find pr...
- 0 kudos
- 1409 Views
- 1 replies
- 0 kudos
Installing databricks CLI on windows . sh ??¿?
I am following databricks documentaiton for installing the cli on windows and i found that uses sh command which of course doesnt work.My windows in admin mode says cannot find "sh" application. I could install cgwyn and tools like that but since the...
- 1409 Views
- 1 replies
- 0 kudos
- 0 kudos
Here is the doc which you can refer:AWS, GCP, and Azure
- 0 kudos
- 3269 Views
- 1 replies
- 1 kudos
Resolved! Guide to Migrating from AWS to Azure
Hello, I would like to know if we have any documents, checklists, or step-by-step instructions for migrating from Databricks on AWS to Azure.
- 3269 Views
- 1 replies
- 1 kudos
- 1 kudos
Yes, Databricks Migration Tool is available on Github
- 1 kudos
- 1085 Views
- 1 replies
- 0 kudos
Error upgrading Databricks workspace to premium
I tried to update a databricks workspace from Standard to Premium in the Azure portal clicking "Upgrade to Premium" but even when it was supposedly "upgraded", I still can't restrict the use of clusters or modify permissions (I'm an administrator on ...
- 1085 Views
- 1 replies
- 0 kudos
- 0 kudos
You might need to open a support ticket with Azure to get more details on this issue
- 0 kudos
- 1895 Views
- 1 replies
- 0 kudos
getting alerts in AWS UnauthorizedAccess:IAMUser/InstanceCredentialExfiltration.InsideAWS
Hi folks, I have been using IAM instance profile as a credentials provider to Databricks workspace. I am getting this error "Credentials created exclusively for an EC2 instance using instance role <role-arn> have been used from a remote AWS account 4...
- 1895 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @anurag_dev Databricks runs a commit service that coordinates writes to Amazon S3 from multiple clusters. This service runs in the Databricks control plane. (441371677306)The S3 commit service helps guarantee consistency of writes across multiple...
- 0 kudos
- 9151 Views
- 9 replies
- 2 kudos
Resolved! Adding a service principal to workspace fails
Trying to add an Azure Service Principal to a workspace fails, whether via the web UI or the databricks cli. With the databricks, the console gives this:databricks service-principals -p ************* create --application-id ********-****-****-****-**...
- 9151 Views
- 9 replies
- 2 kudos
- 2019 Views
- 0 replies
- 0 kudos
i want file upload in volume using api
how to upload file in volume using api??
- 2019 Views
- 0 replies
- 0 kudos
- 2411 Views
- 1 replies
- 1 kudos
Unable to start a SQL cluster
We have a GCP databricks hosted deployment. last night our SQL warehouse failed to start and now just sits with this message:"Cluster Start-up Delayed. Please wait while we continue to try and start the cluster. No action is required from you"It didn...
- 2411 Views
- 1 replies
- 1 kudos
- 1 kudos
Could you share the driver logs if you have them??
- 1 kudos
- 1535 Views
- 2 replies
- 0 kudos
Dashboard programmatical update
Hi,The question that I would like to answer is: How can one replicate dashboards across different environments? Ideally I would like to be able to store the definition of a dashboard in my repository and upload it to Databricks with code: this could ...
- 1535 Views
- 2 replies
- 0 kudos
- 0 kudos
@pawelzak - The Dashboards can not be exported using workspace /export API.
- 0 kudos
- 4201 Views
- 3 replies
- 0 kudos
Azure Databricks with metastore, cannot create managed table
We have set up Azure Databricks with Unity Catalog (metastore) in an ADLS Gen2 storage account.Used Managed Identity (Databricks Access Connector) for connection from workspace(s) to ADLS Gen2ADLS Gen2 storage account has Storage Blob Data Owner and ...
- 4201 Views
- 3 replies
- 0 kudos
- 0 kudos
@m997al Were you able to resolve this issue? I have same issue as you described. I am able to upload into Volumes but not able to create managed tables in ADLS metastore storage account..
- 0 kudos
