cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Start a conversation
Rsamidi
by • New Contributor
  • 791 Views
  • 0 replies
  • 0 kudos

Hi

This is Rajani 

Data Engineering
Reply
  • 791 Views
  • 0 replies
  • 0 kudos
Joko
by • New Contributor
  • 1256 Views
  • 1 replies
  • 0 kudos

Sharing data

Just learned in this mornings session that Databricks enables me to share data across organizations. What would be the first step to learn more about how to do this?

Data Engineering
Reply
  • 1256 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
Boonie123
New Contributor II
  • 0 kudos

The feature you're interested in is Delta Sharing. The feature page is located here.https://www.databricks.com/product/delta-sharingA more technical description for AWS customers can be found here:https://docs.databricks.com/data-sharing/index.html

  • 0 kudos
Ballsandeep
by • New Contributor
  • 1127 Views
  • 0 replies
  • 0 kudos

Exciting #dataai Summit

Excited to be attending the #DataAISummit! Joined industry leaders, experts, and data enthusiasts at this incredible event. Learning about the latest trends, advancements, and best practices in data and AI. It's a fantastic opportunity to network an...

Data Engineering
Reply
  • 1127 Views
  • 0 replies
  • 0 kudos
mkm
by • New Contributor III
  • 1279 Views
  • 1 replies
  • 0 kudos

job alerts

Is it possible to send job alerts via microsoft teams?

Data Engineering
Reply
  • 1279 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
Umarshafique56
New Contributor II
  • 0 kudos

Yes , if databricks jobs are being orchestrated through ADF then you can call azure function app to send teams notifications. 

  • 0 kudos
christian_acuna
by • New Contributor
  • 4588 Views
  • 3 replies
  • 0 kudos

Can you z-order a table with Spark Structured Streaming?

Hi, can you do zordering as part of a structured streaming ingestion? 

Data Engineering
Reply
  • 4588 Views
  • 3 replies
  • 0 kudos
View Replies
Latest Reply
Brian2
New Contributor III
  • 0 kudos

You can also turn on auto optimize writes for your table or session.  This is especially good if your table is partitioned.  You should also turn on auto compaction to help control the size of your files.Auto compaction can be enabled at the table or...

  • 0 kudos
2 More Replies
Foundation2023
by • New Contributor II
  • 1683 Views
  • 1 replies
  • 1 kudos

Resolved! Diy spark enthusiasts?

On prem Spark enthusiasts? Setting up your own Hadooop is fun, right?

Data Engineering
Reply
  • 1683 Views
  • 1 replies
  • 1 kudos
View Replies
Latest Reply
williamong
New Contributor III
  • 1 kudos

This gives me ptsd. Hadoop and mapreduce has been nice and painful!

  • 1 kudos
Pouya
by • New Contributor III
  • 2329 Views
  • 1 replies
  • 3 kudos

Resolved! Is low code/ no code right for you?

There are lots of tools around improving ETL at DAIS.Why is a low code right (or wrong) for you?

Data Engineering
Reply
  • 2329 Views
  • 1 replies
  • 3 kudos
View Replies
Latest Reply
srahgozar
New Contributor III
  • 3 kudos

Hi! I’m a pediatric dentist without any coding experience. Any help I can get with a no-code/low-code solution would be very right for me. Thank you!

  • 3 kudos
RaviM
by • New Contributor
  • 730 Views
  • 0 replies
  • 0 kudos

2023 Keynote

Great stuff at the summit! Like the Satya Nadella interview!!

Data Engineering
Reply
  • 730 Views
  • 0 replies
  • 0 kudos
ayushsood2
by • New Contributor II
  • 1683 Views
  • 1 replies
  • 1 kudos

Advanced data engineering training

Completed 2 certifications in 2 days. Thanks to in person training and Databricks academy.

Data Engineering
Reply
  • 1683 Views
  • 1 replies
  • 1 kudos
View Replies
Latest Reply
Vbp
New Contributor II
  • 1 kudos

How's the advanced exam? Was it what was covered in the in person training

  • 1 kudos
rgirishram
by • New Contributor
  • 3186 Views
  • 3 replies
  • 0 kudos

Best join approaches

What are some of the best join approaches that we need to be aware of? 

Data Engineering
Reply
  • 3186 Views
  • 3 replies
  • 0 kudos
View Replies
Latest Reply
DeanDing
New Contributor II
  • 0 kudos

This fully depends on the table size and business logic, every case are different. For example, you don’t want to do left join when right table is way smaller than left one. 

  • 0 kudos
2 More Replies
Labels