cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Ballsandeep
by New Contributor
  • 794 Views
  • 0 replies
  • 0 kudos

Exciting #dataai Summit

Excited to be attending the #DataAISummit! Joined industry leaders, experts, and data enthusiasts at this incredible event. Learning about the latest trends, advancements, and best practices in data and AI. It's a fantastic opportunity to network an...

  • 794 Views
  • 0 replies
  • 0 kudos
mkm
by New Contributor III
  • 857 Views
  • 1 replies
  • 0 kudos

job alerts

Is it possible to send job alerts via microsoft teams?

  • 857 Views
  • 1 replies
  • 0 kudos
Latest Reply
Umarshafique56
New Contributor II
  • 0 kudos

Yes , if databricks jobs are being orchestrated through ADF then you can call azure function app to send teams notifications. 

  • 0 kudos
christian_acuna
by New Contributor
  • 3669 Views
  • 3 replies
  • 0 kudos

Can you z-order a table with Spark Structured Streaming?

Hi, can you do zordering as part of a structured streaming ingestion? 

  • 3669 Views
  • 3 replies
  • 0 kudos
Latest Reply
Brian2
New Contributor III
  • 0 kudos

You can also turn on auto optimize writes for your table or session.  This is especially good if your table is partitioned.  You should also turn on auto compaction to help control the size of your files.Auto compaction can be enabled at the table or...

  • 0 kudos
2 More Replies
Foundation2023
by New Contributor II
  • 1195 Views
  • 1 replies
  • 1 kudos

Resolved! Diy spark enthusiasts?

On prem Spark enthusiasts? Setting up your own Hadooop is fun, right?

  • 1195 Views
  • 1 replies
  • 1 kudos
Latest Reply
williamong
New Contributor III
  • 1 kudos

This gives me ptsd. Hadoop and mapreduce has been nice and painful!

  • 1 kudos
Pouya
by New Contributor III
  • 1833 Views
  • 1 replies
  • 3 kudos

Resolved! Is low code/ no code right for you?

There are lots of tools around improving ETL at DAIS.Why is a low code right (or wrong) for you?

  • 1833 Views
  • 1 replies
  • 3 kudos
Latest Reply
srahgozar
New Contributor III
  • 3 kudos

Hi! I’m a pediatric dentist without any coding experience. Any help I can get with a no-code/low-code solution would be very right for me. Thank you!

  • 3 kudos
RaviM
by New Contributor
  • 521 Views
  • 0 replies
  • 0 kudos

2023 Keynote

Great stuff at the summit! Like the Satya Nadella interview!!

  • 521 Views
  • 0 replies
  • 0 kudos
ayushsood2
by New Contributor II
  • 1225 Views
  • 1 replies
  • 1 kudos

Advanced data engineering training

Completed 2 certifications in 2 days. Thanks to in person training and Databricks academy.

  • 1225 Views
  • 1 replies
  • 1 kudos
Latest Reply
Vbp
New Contributor II
  • 1 kudos

How's the advanced exam? Was it what was covered in the in person training

  • 1 kudos
rgirishram
by New Contributor
  • 2306 Views
  • 3 replies
  • 0 kudos

Best join approaches

What are some of the best join approaches that we need to be aware of? 

  • 2306 Views
  • 3 replies
  • 0 kudos
Latest Reply
DeanDing
New Contributor II
  • 0 kudos

This fully depends on the table size and business logic, every case are different. For example, you don’t want to do left join when right table is way smaller than left one. 

  • 0 kudos
2 More Replies
peterlandis
by New Contributor II
  • 745 Views
  • 0 replies
  • 0 kudos

DLT templating with CDC

DLT offers apply changes.  Leveraging Python you can parameterize a DLT pipeline so that you can create a DLT template to be used for a central pipeline.  My question is around CDC, with the capability to do DLT templating, how can you obtain the pri...

  • 745 Views
  • 0 replies
  • 0 kudos
PK2023
by New Contributor
  • 633 Views
  • 0 replies
  • 0 kudos

I'm at Data+AI Summit 2023 and....

it's awesome. The Keynotes were great and I got to learn about Data Bricks and how it can help my organization. Looking forward to learning more about the possibilities of Data on Cloud and AI

  • 633 Views
  • 0 replies
  • 0 kudos

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now
Labels