- 2106 Views
- 1 replies
- 1 kudos
Disabling Default Personal Compute Policy in Terraform (AWS)
I'm looking to disable the Personal Compute Policy in Terraform, however I don't see an option to do this. According to this documentation here https://docs.databricks.com/en/admin/clusters/personal-compute.html#customize-the-personal-compute-policy ...
- 2106 Views
- 1 replies
- 1 kudos
- 1 kudos
I have the same issue in terraform-provider-google.I found how to do it from Admin UI (UI -> Settings -> Features Enablement -> disable Personal compute). At the same time I didn't find how to have the same behavior from Terraform.
- 1 kudos
- 4391 Views
- 3 replies
- 2 kudos
Resolved! Message queue to directly trigger job
Hi All,I'm very new to Databricks and trying to understand my use case a bit better.I have a databricks script / job that I want to be reactive to events outside of my databricks environment. A best case scenario would be if my script / job could aut...
- 4391 Views
- 3 replies
- 2 kudos
- 2 kudos
Hi @AmandaOhare ,You can use AWS Lambda to achieve that. You can setup queue trigger that will activate AWS lambda function. In that function you can call datbricks rest API that will launch workflow/job.
- 2 kudos
- 725 Views
- 1 replies
- 0 kudos
Unable to access databricls workspaces
Hi Team, Previously we are able to access databricks workspaces using username and password but now its asking for token, But we dont have access to mail account with username that we are using while login. Could you please assist on the issue how ca...
- 725 Views
- 1 replies
- 0 kudos
- 0 kudos
Anyone can help on this ?
- 0 kudos
- 2231 Views
- 1 replies
- 0 kudos
Resolved! Using Databricks Connect with PyCharm behind Proxy
I am using Databricks connect with PyCharm in order to locally develop my pipelines before deploying to Databricks. I set up authentication for databricks-connect using the following guide https://learn.microsoft.com/en-us/azure/databricks/dev-tools/...
- 2231 Views
- 1 replies
- 0 kudos
- 0 kudos
I managed to solve the problem by including my login and password in the HTTPS_PROXY environment variable.I set it to something like this HTTPS_PROXY = "http://username:password@proxy.company.com:port" and databricks-connect can create spark sessions...
- 0 kudos
- 1094 Views
- 3 replies
- 1 kudos
Can't login to new AWS databricks workspace
Just get our first AWS Databricks workspace created by following the instructions: https://docs.databricks.com/en/admin/workspace/create-uc-workspace.htmladopted the customer-managed VPC and private link for the setup. Upon reviewing the network conf...
- 1094 Views
- 3 replies
- 1 kudos
- 1 kudos
the problem resolved after networking team currently set the DNS to point to the endpoint. We can login through the workspace link now.
- 1 kudos
- 2475 Views
- 2 replies
- 0 kudos
Databricks REST API to fetch mount points
Is there a way to fetch workspace mount points ( mount infos) through REST API or SQL-query ? ( similar to the python API "display(dbutils.fs.mounts())" ) I couldn't find any REST API for the mounts in the official databricks API documentation ( ...
- 2475 Views
- 2 replies
- 0 kudos
- 9646 Views
- 4 replies
- 3 kudos
Resolved! Does REST API usage is chargeable ?
If we use REST API to perform some operation on the Databricks cluster- like running some SQL Statements, will that be chargeable, will it costs us.
- 9646 Views
- 4 replies
- 3 kudos
- 3 kudos
Yep, to sum up - anything that requires compute power and makes the cluster to spin up will be charged.
- 3 kudos
- 3242 Views
- 3 replies
- 1 kudos
Resolved! Confusion about SCC, NAT, and Internet connection (Azure)
Hi all,I created an Azure Databricks workspace with the below featuresDeployed in my Azure virtual network (VNet injection)Enabled Secure cluster connectivityEnabled the Back-end Private LinkI did not create and use a NAT. I found that I still can ac...
- 3242 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @AlbertWang ,If you choose SCC option, there shouldn't be NAT gateway created. You can check that yourself if you go the managed resource group that is created when you deploying databricks workspace.When you use SCC then if you would like to have...
- 1 kudos
- 1354 Views
- 2 replies
- 1 kudos
Resolved! Delta sharing gold layer data within organisation but outside of Vnet
Hi all,The organisation I’m working for has a data engineering team using medallion architecture and wants to share materialised views in the gold layer to members of the organisation who do not have access to the Vnet to be delivered in power BI rep...
- 1354 Views
- 2 replies
- 1 kudos
- 902 Views
- 1 replies
- 0 kudos
Databricks Account Admin architecture
Hi,I have a couple of question regarding the Databricks Account architecture. I was given an Azure admin user to create Databricks admin account. When open the Databricks admin account console, there are some metastores already & some workspaces, whi...
- 902 Views
- 1 replies
- 0 kudos
- 0 kudos
Also another question is, I have assigned a user to be account admin, but he can not see the previews in the account console? Why is that?Ok now is work, I guess Databricks API is broken!
- 0 kudos
- 4085 Views
- 6 replies
- 4 kudos
What is the Databricks equivalent of a stored procedure that works with Power BI?
Is there a way to query Databricks using Power BI, via a stored procedure or similar? In my use case the query will have multiple parameters, that the user will provide values for at runtime. I don't think Databricks notebooks can be consumed directl...
- 4085 Views
- 6 replies
- 4 kudos
- 4 kudos
Hi @BrahmareddySorry ... But Stored procedures are much more than just views. This is a big loss for DATABRICKS users. Can they not implement something ? SOON ?
- 4 kudos
- 2547 Views
- 3 replies
- 1 kudos
session expired Error
Within two minutes of logging into Databricks Community Edition, I am receiving the following error message: "Session expired." The session has ended; please log in again." I've attempted to log in again, but the message "Authenticate the session is ...
- 2547 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @Rajatkumar002, Please review the response and let us know if it answers your question. Your feedback is valuable to us and the community. If the response resolves your issue, kindly mark it as the accepted solution. This will help close the threa...
- 1 kudos
- 1765 Views
- 1 replies
- 0 kudos
Config sso and user provioning on databricks via terraform or api
Hi All,I am looking for a way to automate SSO configuration and user provisioning on Databricks. I see that this is feasible via the Databricks console, as documented SSO in your Databricks account console | Databricks on AWS. However, I am not sure ...
- 1765 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi I am also looking to configure SSO in databricks using REST API. Were you able to figure out a way to do that?Thanks
- 0 kudos
- 737 Views
- 1 replies
- 0 kudos
Google SSO Login after renew Google SSO Cert
Hey there,SSO for Databricks was enabled and worked for us. After renewing the Google SSO Cert, it´s not possible to renew the cert also in DataBricks... can you help me?
- 737 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @mickl089, Thank you for sharing your concern with us! To expedite your request, please list your concerns on our ticketing portal. Our support staff would be able to act faster on the resolution (our standard resolution time is 24-48 hours).
- 0 kudos
- 3867 Views
- 4 replies
- 5 kudos
Resolved! Databricks Community Edition -- Service Status Page
Databricks Community Edition Service Status Page is not available. Or if available the link is well hidden. This feature will be beneficial to all users of Databricks Community Edition.
- 3867 Views
- 4 replies
- 5 kudos
- 5 kudos
Hi @clentin and @szymon_dybczak, Between 22:00 UTC on August 14, 2024, and 14:43 UTC on August 19, 2024, you may have been a user of Databricks' Community Edition who experienced errors citing "Your session has expired, please authenticate again" wit...
- 5 kudos
