cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

jasmin_mbi
by New Contributor II
  • 582 Views
  • 1 replies
  • 0 kudos

Resolved! solved

the problem disappeared but so did the button for deleting this post. 

  • 582 Views
  • 1 replies
  • 0 kudos
Latest Reply
Sumit_7
Esteemed Contributor
  • 0 kudos

@jasmin_mbi Accept this reply as solution and it'll be treated as complete thread.

  • 0 kudos
NikhilS
by New Contributor
  • 624 Views
  • 1 replies
  • 0 kudos

Resolved! ACCOUNT BLOCKED

Hi Can someone help me to unblock my account : 7474656648634648

  • 624 Views
  • 1 replies
  • 0 kudos
Latest Reply
Sumit_7
Esteemed Contributor
  • 0 kudos

@NikhilS Please check with your Account Admin. Additionally raise a ticket here - https://help.databricks.com/s/contact-us

  • 0 kudos
greengil
by Contributor
  • 3478 Views
  • 18 replies
  • 0 kudos

Resolved! Delta Jira data import to Databricks

We need to import large amount of Jira data into Databricks, and should import only the delta changes.  What's the best approach to do so?  Using the Fivetran Jira connector or develop our own Python scripts/pipeline code?  Thanks.

  • 3478 Views
  • 18 replies
  • 0 kudos
Latest Reply
abhi_dabhi
Databricks Partner
  • 0 kudos

Hi @greengil  good question, I went through this something similar recently, so sharing what I found.My instinct was also to build it in Python, but once I dug in, the "just write a script" path hides a lot of pain:Deletions are invisible. Jira's RES...

  • 0 kudos
17 More Replies
kohei-matsumura
by Databricks Partner
  • 1095 Views
  • 3 replies
  • 1 kudos

Resolved! Best practices for health monitoring

Status page: https://status.databricks.com/ REST API: https://docs.databricks.com/api/workspace/workspace/getstatus I'm trying to perform health monitoring using the above status page and API, but is this the best method? If the API returns an error ...

  • 1095 Views
  • 3 replies
  • 1 kudos
Latest Reply
kohei-matsumura
Databricks Partner
  • 1 kudos

We are considering using batch processing for system monitoring, but can we obtain the same information as the status page using the following API?https://docs.databricks.com/aws/ja/resources/status#%E5%85%AC%E9%96%8B%E3%82%B9%E3%83%86%E3%83%BC%E3%82...

  • 1 kudos
2 More Replies
liu
by Databricks Partner
  • 1103 Views
  • 5 replies
  • 0 kudos

Inquiry regarding Serverless outbound IP ranges and Serverless compute firewall configuration

I am looking to obtain the Serverless outbound IP ranges. I found the instructions for obtaining them in this announcement "Serverless compute firewall configuration", which states that Databricks provides the outbound IP addresses in JSON format via...

  • 1103 Views
  • 5 replies
  • 0 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 0 kudos

Hi @liu ,If you're on Azure then this feature is in Private Preview. If you want to try it you need to reach out to your Azure Databricks account team:IP addresses and domains for Azure Databricks services and assets - Azure Databricks | Microsoft Le...

  • 0 kudos
4 More Replies
Marco37
by Contributor III
  • 1397 Views
  • 5 replies
  • 5 kudos

Resolved! How-to migrate catalog storage account to another storage account

Hi,we  have a Azure Databricks Workspace that uses Unity Catalog  for storing data. We use a seperate storage account to store the catalogs. We need to enable the option "Infrastructure encryption" on this storage account and this is unfortunatly onl...

  • 1397 Views
  • 5 replies
  • 5 kudos
Latest Reply
lukaszmaron
New Contributor III
  • 5 kudos

@Marco37 yes overall sound good.Just remember some points:Delta Lake transaction log history won't be copied (basically querying to a version of won't work)CDC history will be lostLineage can be lost after 'catalog swap'RLS/column masking stuff can't...

  • 5 kudos
4 More Replies
simmestd
by New Contributor
  • 528 Views
  • 2 replies
  • 1 kudos

Built a chrome extension that shows live $/hr inside the databricks UI

Got annoyed by not being able to see real-time costs in Databricks whilst manipulating data pipelines. Built a Chrome extension sitting in the corner of the page, pulls cluster and warehouse state from the API every few seconds, multiplies by DBU rat...

  • 528 Views
  • 2 replies
  • 1 kudos
Latest Reply
nayan_wylde
Esteemed Contributor II
  • 1 kudos

Yes, I’d install it — live cost is compelling — but it becomes daily-use only once it nudges behavior, not just informs.Live cost aloneValuable during notebook work, tuning, and experimentationHelps build immediate cost intuitionFeels “nice to have” ...

  • 1 kudos
1 More Replies
lukaszmaron
by New Contributor III
  • 453 Views
  • 1 replies
  • 0 kudos

Databricks permissions management at scale

Working with permissions in Databricks at scale gets tricky pretty fast.A few patterns that keep coming up:permissions spread across workspaces, catalogs, groupshard to answer simple questions like “who actually has access to X?”lots of manual queryi...

lukaszmaron_0-1778534349989.png
  • 453 Views
  • 1 replies
  • 0 kudos
Latest Reply
KrisJohannesen
Valued Contributor
  • 0 kudos

Cool solution!A lot of the auditing of what you have built will actually be available as part of the Governance Hub. It is built on the system tables- It also contains a lot of other cool features that are more in the areas of Data Quality, Classific...

  • 0 kudos
rdruska
by New Contributor II
  • 2295 Views
  • 4 replies
  • 1 kudos

Resolved! DBSQL MCP Server - how to specify compute cluster?

Hi,the DBSQL MCP Server is really cool, however, I am not sure how to connect it to a specific cluster, and I could not find any information in any documentation page. My MCP settings looks like this:"databricks-sql-mcp": { "type": "streamable-http",...

  • 2295 Views
  • 4 replies
  • 1 kudos
Latest Reply
WendyW
New Contributor II
  • 1 kudos

Thanks @Ashwin_DSA for your solution suggested here! we have a related situation. We have an AI-gateway that brokers connections to that externally-hosted Datbricks instance. As a result, we need a SQL warehouse to execute queries and can't alllocate...

  • 1 kudos
3 More Replies
AMStrever
by New Contributor II
  • 787 Views
  • 3 replies
  • 0 kudos

Resolved! Databricks Platform Administration Fundamentals

I have enrolled in Databricks Platform Administration Fundamentals and on the Demo: "Using Databricks Utilities and CLI" it require"  you  to " open this Notebook in your workspace: 1- Using Databricks Utilities and CLi" Where does one obtain this No...

  • 787 Views
  • 3 replies
  • 0 kudos
Latest Reply
AMStrever
New Contributor II
  • 0 kudos

Ashwin for the response win. Thanks... however, unfortunately I do have a trial, as well as access multiple corporate workspaces. There are not "recreate steps" - in the training: it simply says " now open this notebook" which you need. It first give...

  • 0 kudos
2 More Replies
jpm2617
by New Contributor II
  • 1337 Views
  • 4 replies
  • 1 kudos

Serverless Access to Public internet

HiI am trying to run notebooks on serverless compute but I cannot access the public internet. I cannot perform a get on google.com getting "[Errno -3] Temporary failure in name resolution". I checked my admin console network policies and they all wer...

  • 1337 Views
  • 4 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

Greetings @jpm2617 , I did some digging and would like to share my thoughts: @szymon_dybczak nailed the root cause. Your [Errno -3] Temporary failure in name resolution when calling google.com is the classic symptom of a workspace attached to a restr...

  • 1 kudos
3 More Replies
garyng
by New Contributor
  • 254 Views
  • 0 replies
  • 0 kudos

Getting 500 error on UC external HTTP connection to Entra with OAuth User-to-Machine Per User

I am getting 500 Internal Server Error with Unity Catalog external HTTP connection to Entra (for accessing Microsoft Graph API):There isn't any special setup with my Entra app, just the default one with my workspace url as the redirect url:Microsoft ...

garyng_0-1777659141734.png garyng_1-1777659403816.png
  • 254 Views
  • 0 replies
  • 0 kudos
Beka
by New Contributor II
  • 969 Views
  • 1 replies
  • 0 kudos

Resolved! API does not return Genie space create and last modified dates

I am using "/api/2.0/genie/spaces" endpoint to retrieve genie spaces, but this does not return "created date" and "last modified dates". Is there a way to retrieve above information?

  • 969 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 0 kudos

Hi @Beka, Unfortunately, no. Those timestamps aren’t exposed for Genie spaces today. The GenieSpace resource behind both GET /api/2.0/genie/spaces and GET /api/2.0/genie/spaces/{space_id} contains only fields such as space_id, title, description, par...

  • 0 kudos
And2
by New Contributor
  • 330 Views
  • 0 replies
  • 0 kudos

Network Check Control Plane Failure- Vnet injection

Hi,I'm receiving the following error when trying to run a classic compute:Error message: [details] X_NHC_MULTIPLE_COMPONENTS_SSL_ERROR: Instance failed network health check before bootstrapping with fatal error: X_NHC_MULTIPLE_COMPONENTS_SSL_ERROR 3 ...

  • 330 Views
  • 0 replies
  • 0 kudos
vijayakunuri1
by New Contributor III
  • 1541 Views
  • 3 replies
  • 2 kudos

Resolved! I built a free 11-tab Cost Observability Dashboard as a Databricks App — open source

I built Databricks Cost Observability — a full-stack observability dashboardthat runs natively as a Databricks App and reads directly from system tables.No data leaves your workspace, no external BI tools needed.What it covers across 11 tabs:• Execut...

  • 1541 Views
  • 3 replies
  • 2 kudos
Latest Reply
vijayakunuri1
New Contributor III
  • 2 kudos

The main tradeoff: Azure Cost Management API has a 1-2 day lag, so the data is never truly real-time, but that's fine for a cost observability use case. We can have a ingestion notebook would run daily to get those cost ingested. Azure Cost Managemen...

  • 2 kudos
2 More Replies