cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Data + AI Summit 2024 - Data Engineering & Streaming

Forum Posts

Start a conversation
ayushsood2
by • New Contributor II
  • 724 Views
  • 1 replies
  • 1 kudos

Advanced data engineering training

Completed 2 certifications in 2 days. Thanks to in person training and Databricks academy.

Data Engineering
Reply
  • 724 Views
  • 1 replies
  • 1 kudos
View Replies
Latest Reply
Vbp
New Contributor II
  • 1 kudos

How's the advanced exam? Was it what was covered in the in person training

  • 1 kudos
rgirishram
by • New Contributor
  • 1352 Views
  • 3 replies
  • 0 kudos

Best join approaches

What are some of the best join approaches that we need to be aware of? 

Data Engineering
Reply
  • 1352 Views
  • 3 replies
  • 0 kudos
View Replies
Latest Reply
DeanDing
New Contributor II
  • 0 kudos

This fully depends on the table size and business logic, every case are different. For example, you don’t want to do left join when right table is way smaller than left one. 

  • 0 kudos
2 More Replies
peterlandis
by • New Contributor II
  • 463 Views
  • 0 replies
  • 0 kudos

DLT templating with CDC

DLT offers apply changes.  Leveraging Python you can parameterize a DLT pipeline so that you can create a DLT template to be used for a central pipeline.  My question is around CDC, with the capability to do DLT templating, how can you obtain the pri...

Data Engineering
Reply
  • 463 Views
  • 0 replies
  • 0 kudos
PK2023
by • New Contributor
  • 339 Views
  • 0 replies
  • 0 kudos

I'm at Data+AI Summit 2023 and....

it's awesome. The Keynotes were great and I got to learn about Data Bricks and how it can help my organization. Looking forward to learning more about the possibilities of Data on Cloud and AI

Data Engineering
Reply
  • 339 Views
  • 0 replies
  • 0 kudos
Skystation
by • New Contributor II
  • 556 Views
  • 1 replies
  • 0 kudos

Newbie checkin

Checkin at data ai summit

Data Engineering
Reply
  • 556 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
Skystation
New Contributor II
  • 0 kudos

Learned about the experience on how to setup lake house for advertisement data from instacart

  • 0 kudos
Siddhuth
by • New Contributor III
  • 1077 Views
  • 1 replies
  • 3 kudos

Resolved! Delta Clean Room Preview

Which platform will this be available on for preview?

Data Engineering
Reply
  • 1077 Views
  • 1 replies
  • 3 kudos
View Replies
Latest Reply
maxnumbers
New Contributor III
  • 3 kudos

It's available in AWS for public preview, but Azure deployment date is still TBD

  • 3 kudos
brendan-mahler
by • New Contributor
  • 897 Views
  • 2 replies
  • 0 kudos

Databricka 2023

What is your favorite tool for monitoring your pipelines?

Data Engineering
Reply
  • 897 Views
  • 2 replies
  • 0 kudos
View Replies
Latest Reply
kknebel
New Contributor II
  • 0 kudos

There are a variety of third party apps that can help monitor your data and pipelines. Some big ones include calibra and bigeye

  • 0 kudos
1 More Replies
dholmgreen
by • New Contributor
  • 1013 Views
  • 0 replies
  • 0 kudos

Unity Catalog ABAC

Is there a roadmap for when ABAC (Attribute-based access control) wilö be available in Unity Catalog?

Data Engineering
Reply
  • 1013 Views
  • 0 replies
  • 0 kudos
Mac3
by • New Contributor II
  • 648 Views
  • 1 replies
  • 1 kudos

Data Engineering

What is a common problem you face when ingesting data in hot storage?

Data Engineering
Reply
  • 648 Views
  • 1 replies
  • 1 kudos
View Replies
Latest Reply
Seb
New Contributor II
  • 1 kudos

Finding the best partitioning strategy and also cost issue if you ingest huge amount of data

  • 1 kudos

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Labels