cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Start a conversation
whleeman
by • New Contributor III
  • 3085 Views
  • 2 replies
  • 2 kudos

Resolved! Can I use SQL to create a table and set an expiration date?

Can I use SQL to create a table and set and expiration date? So that the table will be deleted automatically after the expiration date.

Data Engineering
Reply
  • 3085 Views
  • 2 replies
  • 2 kudos
View Replies
Latest Reply
prakash1
New Contributor II
  • 2 kudos

Right now it i not possible. You can always create a custom trigger solution with parameter to call notebook and delete the table.

  • 2 kudos
1 More Replies
Rsamidi
by • New Contributor
  • 591 Views
  • 0 replies
  • 0 kudos

Hi

This is Rajani 

Data Engineering
Reply
  • 591 Views
  • 0 replies
  • 0 kudos
Joko
by • New Contributor
  • 916 Views
  • 1 replies
  • 0 kudos

Sharing data

Just learned in this mornings session that Databricks enables me to share data across organizations. What would be the first step to learn more about how to do this?

Data Engineering
Reply
  • 916 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
Boonie123
New Contributor II
  • 0 kudos

The feature you're interested in is Delta Sharing. The feature page is located here.https://www.databricks.com/product/delta-sharingA more technical description for AWS customers can be found here:https://docs.databricks.com/data-sharing/index.html

  • 0 kudos
Ballsandeep
by • New Contributor
  • 825 Views
  • 0 replies
  • 0 kudos

Exciting #dataai Summit

Excited to be attending the #DataAISummit! Joined industry leaders, experts, and data enthusiasts at this incredible event. Learning about the latest trends, advancements, and best practices in data and AI. It's a fantastic opportunity to network an...

Data Engineering
Reply
  • 825 Views
  • 0 replies
  • 0 kudos
mkm
by • New Contributor III
  • 908 Views
  • 1 replies
  • 0 kudos

job alerts

Is it possible to send job alerts via microsoft teams?

Data Engineering
Reply
  • 908 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
Umarshafique56
New Contributor II
  • 0 kudos

Yes , if databricks jobs are being orchestrated through ADF then you can call azure function app to send teams notifications. 

  • 0 kudos
christian_acuna
by • New Contributor
  • 3748 Views
  • 3 replies
  • 0 kudos

Can you z-order a table with Spark Structured Streaming?

Hi, can you do zordering as part of a structured streaming ingestion? 

Data Engineering
Reply
  • 3748 Views
  • 3 replies
  • 0 kudos
View Replies
Latest Reply
Brian2
New Contributor III
  • 0 kudos

You can also turn on auto optimize writes for your table or session.  This is especially good if your table is partitioned.  You should also turn on auto compaction to help control the size of your files.Auto compaction can be enabled at the table or...

  • 0 kudos
2 More Replies
Foundation2023
by • New Contributor II
  • 1236 Views
  • 1 replies
  • 1 kudos

Resolved! Diy spark enthusiasts?

On prem Spark enthusiasts? Setting up your own Hadooop is fun, right?

Data Engineering
Reply
  • 1236 Views
  • 1 replies
  • 1 kudos
View Replies
Latest Reply
williamong
New Contributor III
  • 1 kudos

This gives me ptsd. Hadoop and mapreduce has been nice and painful!

  • 1 kudos
Pouya
by • New Contributor III
  • 1890 Views
  • 1 replies
  • 3 kudos

Resolved! Is low code/ no code right for you?

There are lots of tools around improving ETL at DAIS.Why is a low code right (or wrong) for you?

Data Engineering
Reply
  • 1890 Views
  • 1 replies
  • 3 kudos
View Replies
Latest Reply
srahgozar
New Contributor III
  • 3 kudos

Hi! I’m a pediatric dentist without any coding experience. Any help I can get with a no-code/low-code solution would be very right for me. Thank you!

  • 3 kudos
RaviM
by • New Contributor
  • 542 Views
  • 0 replies
  • 0 kudos

2023 Keynote

Great stuff at the summit! Like the Satya Nadella interview!!

Data Engineering
Reply
  • 542 Views
  • 0 replies
  • 0 kudos

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now
Labels