cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Marco37
by Contributor III
  • 3077 Views
  • 7 replies
  • 3 kudos

Resolved! Neeed help with setting up a connection from Databricks to an Azure SQL Database with the REST API

Good day,I need some help with automating a connection from databricks to an Azure SQL Database. I'am able to configure the connection with the UI (Catalog Explorer), but I also want to configure it with a REST API (or SQL script), so that I can inte...

  • 3077 Views
  • 7 replies
  • 3 kudos
Latest Reply
EddieHpk
New Contributor II
  • 3 kudos

Just had a simmilar issue and after not fingind the answer in the TF module Imanaged to compile a working sintax for an Azure SQL Database:################################################################################# Variable for Databricks Conne...

  • 3 kudos
6 More Replies
satniks_o
by New Contributor III
  • 1632 Views
  • 2 replies
  • 0 kudos

Can we provide custom dns name for Databricks app?

Hi All,I want to access my Databricks app https://myapp.aws.databricksapps.com/ using https://myapp.mycompaney.com  Is this possible? We tried DNS mapping but it is not working.  

  • 1632 Views
  • 2 replies
  • 0 kudos
Latest Reply
marioquark
New Contributor II
  • 0 kudos

Up!

  • 0 kudos
1 More Replies
robertayoung520
by New Contributor
  • 320 Views
  • 2 replies
  • 0 kudos

Init Script to Install ODBC Driver Causes Cluster Crash (JVM Thread Dump)

Hello Databricks Community,I am facing a critical issue where our cluster fails to start when using an init script designed to install the Databricks ODBC driver. I'm hoping someone can shed light on what might be happening within our specific enviro...

  • 320 Views
  • 2 replies
  • 0 kudos
Latest Reply
aleksandra_ch
Databricks Employee
  • 0 kudos

Hi @robertayoung520, Could you elaborate on why do you need to connect to a remote DBSQL warehouse in another Databricks workspace?  If it's to query data in that other workspace, there are other better ways (sorted from the most recommended to least...

  • 0 kudos
1 More Replies
lkahn
by New Contributor
  • 705 Views
  • 2 replies
  • 0 kudos

Resolved! UI issue with R plots

Starting on May 6, our workspace in ap-southeast-2 stopped being able to display R plots correctly. This is specific to this workspace (we have 3), and specific to R plots, and is occurring for all users and clusters.The figure itself can be resized ...

  • 705 Views
  • 2 replies
  • 0 kudos
Latest Reply
Lu_Wang_ENB_DBX
Databricks Employee
  • 0 kudos

This looks like a workspace-side notebook UI regression.  Recommendation Open a Databricks support ticket and treat it as a Notebook UI / rendering regression for that workspace. Include: Workspace IDRegion: ap-southeast-2Start date: May 6A notebook...

  • 0 kudos
1 More Replies
Kirsten
by New Contributor
  • 503 Views
  • 1 replies
  • 0 kudos

Resolved! Workspaces stuck in a provisioning state

We are attempting to create a workspace on Databricks but encountering an issueWorkspace provisioning has been stuck in PROVISIONING state for over 2 hours. Only partial resources were created (IAM role and S3 bucket), and no VPC or CloudFormation re...

  • 503 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 0 kudos

Hi @Kirsten, I've checked internally. Based on what you described, this appears most consistent with the AWS credential/cross-account role validation failing early in workspace creation, rather than a later-stage workspace issue. Can you verify the f...

  • 0 kudos
Anonymous
by Not applicable
  • 630 Views
  • 8 replies
  • 2 kudos

How to get Databricks to delete my account?

I have created a test account which I don't need/want anymore. There is no option to delete it (that I can find). I have contacted help@databricks.com about this multiple times, but they ghost me. Is there anything (short of asking a lawyer to write ...

  • 630 Views
  • 8 replies
  • 2 kudos
Latest Reply
Anonymous
Not applicable
  • 2 kudos

Oh. Yes. help@ has been ghosting me for over a month now. 

  • 2 kudos
7 More Replies
uhuru_furuta
by Databricks Partner
  • 4252 Views
  • 6 replies
  • 1 kudos

Can't start Serverless Warehouse after extend budget

As my budget was exhausted, my serverless warehouse stopped and I extended my budget, which is now 'Under Budget'.However, my serverless warehouse still can't start as pasted. It is about 19 hours after when I extend budget.Do I need to do any other ...

  • 4252 Views
  • 6 replies
  • 1 kudos
Latest Reply
MoJaMa
Databricks Employee
  • 1 kudos

To add to what Ganesh said, it seems that you have a Databricks Team (Account Executive and Solutions Architect). I would escalate this to them while you create the Support ticket in parallel. Based on what I can see, I think you had a Trial Account ...

  • 1 kudos
5 More Replies
jasmin_mbi
by New Contributor II
  • 532 Views
  • 1 replies
  • 0 kudos

Resolved! solved

the problem disappeared but so did the button for deleting this post. 

  • 532 Views
  • 1 replies
  • 0 kudos
Latest Reply
Sumit_7
Esteemed Contributor
  • 0 kudos

@jasmin_mbi Accept this reply as solution and it'll be treated as complete thread.

  • 0 kudos
NikhilS
by New Contributor
  • 561 Views
  • 1 replies
  • 0 kudos

Resolved! ACCOUNT BLOCKED

Hi Can someone help me to unblock my account : 7474656648634648

  • 561 Views
  • 1 replies
  • 0 kudos
Latest Reply
Sumit_7
Esteemed Contributor
  • 0 kudos

@NikhilS Please check with your Account Admin. Additionally raise a ticket here - https://help.databricks.com/s/contact-us

  • 0 kudos
greengil
by Contributor
  • 3106 Views
  • 18 replies
  • 0 kudos

Resolved! Delta Jira data import to Databricks

We need to import large amount of Jira data into Databricks, and should import only the delta changes.  What's the best approach to do so?  Using the Fivetran Jira connector or develop our own Python scripts/pipeline code?  Thanks.

  • 3106 Views
  • 18 replies
  • 0 kudos
Latest Reply
abhi_dabhi
Databricks Partner
  • 0 kudos

Hi @greengil  good question, I went through this something similar recently, so sharing what I found.My instinct was also to build it in Python, but once I dug in, the "just write a script" path hides a lot of pain:Deletions are invisible. Jira's RES...

  • 0 kudos
17 More Replies
kohei-matsumura
by Databricks Partner
  • 990 Views
  • 3 replies
  • 1 kudos

Resolved! Best practices for health monitoring

Status page: https://status.databricks.com/ REST API: https://docs.databricks.com/api/workspace/workspace/getstatus I'm trying to perform health monitoring using the above status page and API, but is this the best method? If the API returns an error ...

  • 990 Views
  • 3 replies
  • 1 kudos
Latest Reply
kohei-matsumura
Databricks Partner
  • 1 kudos

We are considering using batch processing for system monitoring, but can we obtain the same information as the status page using the following API?https://docs.databricks.com/aws/ja/resources/status#%E5%85%AC%E9%96%8B%E3%82%B9%E3%83%86%E3%83%BC%E3%82...

  • 1 kudos
2 More Replies
liu
by Databricks Partner
  • 959 Views
  • 5 replies
  • 0 kudos

Inquiry regarding Serverless outbound IP ranges and Serverless compute firewall configuration

I am looking to obtain the Serverless outbound IP ranges. I found the instructions for obtaining them in this announcement "Serverless compute firewall configuration", which states that Databricks provides the outbound IP addresses in JSON format via...

  • 959 Views
  • 5 replies
  • 0 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 0 kudos

Hi @liu ,If you're on Azure then this feature is in Private Preview. If you want to try it you need to reach out to your Azure Databricks account team:IP addresses and domains for Azure Databricks services and assets - Azure Databricks | Microsoft Le...

  • 0 kudos
4 More Replies
Marco37
by Contributor III
  • 1096 Views
  • 5 replies
  • 5 kudos

Resolved! How-to migrate catalog storage account to another storage account

Hi,we  have a Azure Databricks Workspace that uses Unity Catalog  for storing data. We use a seperate storage account to store the catalogs. We need to enable the option "Infrastructure encryption" on this storage account and this is unfortunatly onl...

  • 1096 Views
  • 5 replies
  • 5 kudos
Latest Reply
lukaszmaron
New Contributor III
  • 5 kudos

@Marco37 yes overall sound good.Just remember some points:Delta Lake transaction log history won't be copied (basically querying to a version of won't work)CDC history will be lostLineage can be lost after 'catalog swap'RLS/column masking stuff can't...

  • 5 kudos
4 More Replies
simmestd
by New Contributor
  • 444 Views
  • 2 replies
  • 1 kudos

Built a chrome extension that shows live $/hr inside the databricks UI

Got annoyed by not being able to see real-time costs in Databricks whilst manipulating data pipelines. Built a Chrome extension sitting in the corner of the page, pulls cluster and warehouse state from the API every few seconds, multiplies by DBU rat...

  • 444 Views
  • 2 replies
  • 1 kudos
Latest Reply
nayan_wylde
Esteemed Contributor II
  • 1 kudos

Yes, I’d install it — live cost is compelling — but it becomes daily-use only once it nudges behavior, not just informs.Live cost aloneValuable during notebook work, tuning, and experimentationHelps build immediate cost intuitionFeels “nice to have” ...

  • 1 kudos
1 More Replies
lukaszmaron
by New Contributor III
  • 354 Views
  • 1 replies
  • 0 kudos

Databricks permissions management at scale

Working with permissions in Databricks at scale gets tricky pretty fast.A few patterns that keep coming up:permissions spread across workspaces, catalogs, groupshard to answer simple questions like “who actually has access to X?”lots of manual queryi...

lukaszmaron_0-1778534349989.png
  • 354 Views
  • 1 replies
  • 0 kudos
Latest Reply
KrisJohannesen
Valued Contributor
  • 0 kudos

Cool solution!A lot of the auditing of what you have built will actually be available as part of the Governance Hub. It is built on the system tables- It also contains a lot of other cool features that are more in the areas of Data Quality, Classific...

  • 0 kudos