Hi there, what's the best way to differentiate in what environment my Spark session is running? Locally I develop with databricks-connect's DatabricksSession, but that doesn't work when running a wo...
I have an AWS based databricks account with a few workspaces and an Azure Databricks workspace. How do I combine them into one account? I am particularly interested in setting up a ...
Hi! I am following this guide: https://learn.microsoft.com/en-us/azure/databricks/security/network/serverless-network-security/serverless-private-link However in Step 3: Create private endpoint rul...
Hi Guys, I am a complete newbie to data bricks, we are trying to figure out if our data models and ETL can run on it. I have got the failure to launch message. I have read this message a...
Hi Team, We are working on a new Data Product onboarding to the current Databricks Lakehouse Platform. The first step is foundation where we should get data from SAP success factors to S3+ Bronze l...
Our application does storage autoscaling on Azure. We would like to deploy our solution with Azure databricks. But even though the service principal associated with our application has the necessary ...
Hi All, For an application that we are building, we need a encoding detector/utf-8 enforcer. For this, we used the python library chardet in combination with "with open". We open a file from a mount...
I have a web app that can read files from a person's cloud-based drive (e.g., OneDrive, Google Drive, Dropbox). The app gets access to the files using OAuth2. The app only ever has access to th...
Good day, Deceptively simple question, are there any "Databricks only" specific features that Unity Catalog offers? I understand that generally speaking enabling UC offers some of the following: D...
Hello @Cert-Team @Certificate Team, Request Id# 00432042 I encountered a pathetic experience while attempting my Databricks Certified Data Engineer Professional certification e...