Learning databricks
Data AI summit 2026
- 16 Views
- 0 replies
- 0 kudos
Data AI summit 2026
I want to share this as an open discussion because I have not seen many posts that bridge the gap between local hardware experimentation and Databricks cloud deployment and I think it is a conversation worth having especially for smaller teams and in...
Hi there, I've pulled together some thoughts based on experiences. The short version of what you're hitting with the shuffle differences: the Databricks Runtime is not vanilla Spark with a fancy UI bolted on. It has a load of proprietary optimisation...
Hi everyone,Hopefully this is the right place to share!Myself and a colleague @Pilsner are running a webinar next week (Tuesday 16th June, 4pm UK time), which should be useful for people working in finance, data engineering, analytics or automation.W...
Just a few hours to go before our webinar!Looking forward to seeing you there
Hello,My table in databricks is using a function to mask PII columns, in my power BI report I am using import mode.I notice that my report in power BI will have the PII masked depending on the privileges of the user who publish the report, it means i...
Hi, I've done some research on this and I think you maybe updating the credentials in the wrong place. It's slightly confusing but when you update a power bi dashboard it uses the credentials in the Power BI connection set up not the job credential...
I’m currently working at Dev Technosys, and I’ve been exploring some of the deeper technical challenges in event management app development, especially for large-scale events where thousands of users interact with the system simultaneously.One major ...
Hello everyone,I am new to databricks, i created a new free azure account and when i tried to create a new workspace by clicking on the create button on the top right hand corner, nothing happens, i am sure this is some access issue, can someone shed...
Hi Ganesh, As well as @balajij8 advice around making sure you are using a fresh browser. I'd recommend taking a look at these resources. They will help you to understand the overall UI. Customer Academy: Get Started with Databricks Platform Administ...
Hi all,When I try to execute the script (as per the screenshot below), in a Notebook cell, I get an error message. I am using Databricks Free Edition, and am not sure if the error relates to the compute cluster that I am using?Any guidance would be ...
Please attach a full error screenshot. Does Spark say something specific like:TABLE_OR_VIEW_NOT_FOUNDis not a Delta tablePERMISSION_DENIEDcheckpoint location already existsschema mismatch
Dear Databricks community I would love to meet DAIS attendees. I am a co-founder at LangGuard.AI. I have deep expertise in trusted agent development, deployment and operations. I am hosting a Brain date on Wed June 17th at 11 AM - "Claude Agents Are ...
I recently wrote about a field sales platform built on Databricks using Lakeflow, Lakebase, Unity Catalog, Mosaic AI, and Databricks Apps.The main idea is using Lakebase and Lakehouse Sync to support operational workflows and analytics in one Databri...
Hello Everyone, I have jotted down some of the points on getting started with model serving. What is it about?, How we used to do things earlier? And why to use model serving?This blog focused on the fundamentals of Databricks Model Serving and its r...
Hello everyone,I’m a beginner who is starting my journey in Data Engineering and AI Engineering. I’m currently learning basic concepts and trying to understand how everything connects in real-world projects.My goal is to become a Data Engineer / AI E...
My suggestion is to keep the path simple in the beginning. Start with SQL, basic Python, and core data engineering thinking first. Then learn Spark basics, DataFrames, transformations, and Delta Lake. After that, move into Databricks Lakehouse concep...
The conversation around AI often starts with models. In reality, long-term value comes from how well data pipelines, governance, and workflows work together.The teams moving fastest seem to be simplifying their stack instead of expanding it.What tren...
Few weeks ago I already wrote an article about it Are we still keeping the same data warehouse modelling standards in 2026 with all this AI? AI changes the way people interact with data but it does not remove the need for modelling.A bad data model w...
Hi all,I set up a serverless endpoint for my agent via an S-account. This S-account is also granted access to another serverless endpoint. During the inference of my endpoint, I use the Databricks SDK to connect to the other endpoint without explicit...
@pikachu89 wrote:Hi all,I set up a serverless endpoint for my agent via an S-account. This S-account is also granted access to another serverless endpoint. During the inference of my endpoint, I use the Databricks SDK to connect to the other endpoint...
Hello,I am having the following issue while starting the lab for the "Get Started with Databricks for Data Warehousing" course. I purchased the course with the lab option. Can you guide me to resolve this issue? I appreciate your help. Thank you. l =...
The issue has now been resolved @susmit, and the labs are running smoothly. You should be able to start the lab for the course without any errors.
Hi everyone,We're hosting the next session of our Data Engineering Masterclass Series focused on Apache Spark.This is an in-person, hands-on session for engineers interested in modern data engineering, distributed data processing, and real-world Spar...
| User | Count |
|---|---|
| 142 | |
| 123 | |
| 57 | |
| 45 | |
| 40 |