- 2187 Views
- 2 replies
- 1 kudos
Resolved! aws databricks with frontend private link
In aws databricks documentation, frontend PrivateLink assumes a separate transit VPC connected via Direct Connect/VPN. However, I'm implementing a different architecture using Tailscale for private network access.My setup: Tailscale subnet router de...
- 2187 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi everyone,I have a question about the IAM role for workspace root storage when deploying Databricks on AWS with custom configurations (customer-managed VPC, storage configurations, credential configurations, etc.).At an earlier stage of our deploym...
- 1 kudos
- 1198 Views
- 3 replies
- 2 kudos
Resolved! Removing access to Lakehouse and only allowing Databricks One?
Hello, I am trying to set up a user group for business users in our Azure Databricks that will only be able to query data. It looks like Databricks One is the solution to use. So I followed the documentation and granted the user group Consumer Access...
- 1198 Views
- 3 replies
- 2 kudos
- 2 kudos
Yeah, that was it. I had set up Databricks with Entra groups from the beginning and had done all my permission work there. I didn't even think of checking the default groups. Thank you!
- 2 kudos
- 1440 Views
- 1 replies
- 2 kudos
Resolved! how to complete connection to snowflake
Hi all,Simple test creating connection to my snowflake trial account was successful, and..Anyway:dbx > external data > connections > create connection > ... > [Test] successful but still see last 2 steps todo (5 access, 6 metadata) but don't see any ...
- 1440 Views
- 1 replies
- 2 kudos
- 2 kudos
Hi @emanueol ,From you description it seems that you were able to set up connection. Not every step in the wizard has "next button". From example in step 4 (catalog basic) if you create a catalog then you will be automatically transfered to the next ...
- 2 kudos
- 947 Views
- 1 replies
- 0 kudos
Resolved! scroll bar disappears on widgets in dashboards
Databricks newbie.I've created a dashboard that has several widgets to allow users to select multiple values from a drop-down list. When I first open the widget to select the values, there is a scroll bar on the right side of the box which allows me...
- 947 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @RichC! You’re not missing any setting here. This is expected behavior. The scrollbar auto-hides after a couple of seconds, but it’s still active. If you start scrolling again (mouse wheel or trackpad), the scrollbar will reappear.
- 0 kudos
- 1473 Views
- 3 replies
- 1 kudos
Tracing SQL costs
Hello, Databricks community!In our Account Usage Dashboard, the biggest portion of our costs are labeled simply "SQL".We want to drill deeper to see where the SQL costs are coming from.By querying the `system.usage.billing` table we see that it's mos...
- 1473 Views
- 3 replies
- 1 kudos
- 1 kudos
@simenheg - first of all, It’s not an error as Serverls SQL often produces null metadata fields.So you will need to follow below steps for the costUse SQL Warehouse Query Historyjoin billing data with SQL query history - system.billing.usage.usage_da...
- 1 kudos
- 2590 Views
- 4 replies
- 3 kudos
Resolved! AI/BI Dashboard embed issue in Databricks App
Hi everyone,I’ve created an AI/BI Dashboard in Azure Databricks and successfully published it, generated an embed link. My goal is to embed this dashboard inside a Databricks App (Streamlit) using an iframe.However, when I try to render the dashboard...
- 2590 Views
- 4 replies
- 3 kudos
- 3 kudos
Hi @Louis_Frolio ,I have made changes my master menu with page navigation and used iframe inside submenu and it does work... Thanks for your insightful solution.
- 3 kudos
- 750 Views
- 2 replies
- 0 kudos
Databricks Job : Unable to read Databricks job run parameter in scala code and sql query.
we are created data bricks job with Jar (scala code) and provided parameters/jar parameters and able to read those as arguments in main method. we are running job with parameters (run parameters / job parameters) , those parametes are not able to re...
- 750 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Louis_Frolio Thank you for your suggestion. We are following the approach you recommended, but we encountered an issue while creating the job.We are creating a Databricks job using a JSON file through a pipeline. When we declare job-level parame...
- 0 kudos
- 1131 Views
- 2 replies
- 1 kudos
Resolved! Databricks Asset Bundles capability for cross cloud migration
Hi everyone,We are planning a migration from Azure Databricks to GCP Databricks and would like to understand whether Databricks Asset Bundles (DAB) can be used to migrate workspace assets such as jobs, pipelines, notebooks, and custom serving endpoin...
- 1131 Views
- 2 replies
- 1 kudos
- 1481 Views
- 2 replies
- 1 kudos
How do you manage alerts?
Hey all,I'm curious how do teams manage Databricks alerts?My use case is that I have around 10 Spark workflows, and need to validate their output tables.My first iteration was to create alerts manually, e.g. define SQL, evaluation criteria, notificat...
- 1481 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @smirnoal ,If you want to have more dynamic behaviour you can use Python for Databricks Asset Bundles which extends Databricks Asset Bundles so that you can:Define resources in Python code. These definitions can coexist with resources defined in Y...
- 1 kudos
- 1385 Views
- 4 replies
- 7 kudos
Issue when creating Salesforce Connector
HiI'm trying to create a Salesforce Connector in Lakeflow.In the "salesforce authentication step", I'm entering my Salesforce Username and Password and then I get stucked with the following error message : "OAUTH_APPROVAL_ERROR_GENERIC"My Salesforce...
- 1385 Views
- 4 replies
- 7 kudos
- 7 kudos
Hi guys Sorry to bother you again...I know, the salesforce adm in my company is quite "narrow-minded" regarding security issues, and I don't know enough about security protocol to answer him.Do you know why we need a "Connected App" usage while we ar...
- 7 kudos
- 570 Views
- 3 replies
- 0 kudos
Can't display histogram in Databricks Notebooks
Is it a known bug? It says to use display(dataframe) for is not workingHow can I display it using Databricks Visualizations? Thanks in advance
- 570 Views
- 3 replies
- 0 kudos
- 0 kudos
The describe looks like a completely different table to the image of values, they have different field names and different types. At what point do you get the error? Does it let you get the visualisation pop up? It should work fine. Is it when you tr...
- 0 kudos
- 1059 Views
- 2 replies
- 3 kudos
Resolved! Databricks Free Edition Account Migration
Hello,I set up a Databricks Free Edition account with the intention of running it on Azure, since my environment is based in the Azure cloud. However, the account was provisioned on AWS instead. Is there a way to migrate it? Please provide the steps ...
- 1059 Views
- 2 replies
- 3 kudos
- 3 kudos
@libpekin - Short Answer - its AWS-only and no such 'automated' path/choice to migrate to Azure.
- 3 kudos
- 1212 Views
- 5 replies
- 0 kudos
Proxy configuration - while bootstraping
I am trying to start a cluster in Az databricks,our policy is to use proxy for outbound traffic. I have configured http_proxy, https_proxy, HTTP_PROXY, HTTPS_PROXY, no_proxy and NO_PROXY List in env variables and global . Made sure proxy is bypassin...
- 1212 Views
- 5 replies
- 0 kudos
- 1296 Views
- 2 replies
- 2 kudos
Resolved! Model serving with provisioned throughput fails
I'm trying to serve a model with provisioned throughput but I'm getting this error:Build could not start due to an internal error. If you are serving a model from UC and Azure storage firewall or Private Link is configured on your storage account, pl...
- 1296 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi team, Creating an endpoint in your workspace needs Serverless, and so you need to update the storage account’s firewall to allow Databricks serverless compute via your workspace’s Network Connectivity Configuration (NCC). If the storage account f...
- 2 kudos
- 1792 Views
- 1 replies
- 1 kudos
Resolved! Updating projects created from Databricks Asset Bundles
Hi allWe are using Databricks Asset Bundles for our data science / ML projects. The asset bundle we have, have spawned quite a few projects by now, but now we need to make some updates to the asset bundle. The updates should also be added to the spaw...
- 1792 Views
- 1 replies
- 1 kudos
- 1 kudos
Greetings @Sleiny , Here’s what’s really going on, plus a pragmatic, field-tested plan you can actually execute without tearing up your repo strategy. Let’s dig in. What’s happening Databricks Asset Bundles templates are used at initialization time ...
- 1 kudos
