Databricks Community is an open-source platform for data enthusiasts and professionals to discuss, share insights, and collaborate on everything related to Databricks. Members can ask questions, share knowledge, and support each other in an environment that ensures respectful interactions.
Hi there, I would like to get some feedback on what are the ideal/suggested ways to get UMF data from our Azure cloud into Databricks. For context, UMF can mean either: User Managed File User Main...
We have problem with import any python files as module on VNET injected workspace. For same folder structure (see bellow), the imports works on serverless clusters or in databricks managed workspac...
Hello I was previously registered with a customer profile, and have updated my profile to use my work email which is a partner email, but still I am unable to access the partner academy. I tried di...
Hey everyone, we are trying to get an overview of all users that we have in our databricks groups. We have tried to do so with the REST API as well as the SQL-queries (with normal developer accounts...
Hi everyone, I’m working on building and optimizing data pipelines in Databricks, especially for large-scale workloads, and I want to learn from others who have hands-on experience with performance ...
Hello, I am facing an issue with my Databricks Academy account. During a normal sign-in using my usual email address, I was asked to re-enter my first and last name, as if my account was being crea...
Hello, We are a team of 5 ( DE/ Architects ) exploring the idea of starting a small consulting company focused on Databricks as a SI partner and wanted to learn from others who have gone through the...
I am new to Databrcicks and was trying to create an Iceberg table. I have configured the Credentials and External Location using the UI under Catalog > External Locations and Credentials. I...
Hi, I need to ingest some data available at API endpoint. I was thinking of this option - 1. make API call from Notebook and save data to ADLS 2. use AutoLoader to load data fro...