cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Start a conversation
Skystation
by • New Contributor II
  • 782 Views
  • 1 replies
  • 0 kudos

Newbie checkin

Checkin at data ai summit

Data Engineering
Reply
  • 782 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
Skystation
New Contributor II
  • 0 kudos

Learned about the experience on how to setup lake house for advertisement data from instacart

  • 0 kudos
Siddhuth
by • New Contributor III
  • 1542 Views
  • 1 replies
  • 3 kudos

Resolved! Delta Clean Room Preview

Which platform will this be available on for preview?

Data Engineering
Reply
  • 1542 Views
  • 1 replies
  • 3 kudos
View Replies
Latest Reply
maxnumbers
New Contributor III
  • 3 kudos

It's available in AWS for public preview, but Azure deployment date is still TBD

  • 3 kudos
brendan-mahler
by • New Contributor
  • 1199 Views
  • 2 replies
  • 0 kudos

Databricka 2023

What is your favorite tool for monitoring your pipelines?

Data Engineering
Reply
  • 1199 Views
  • 2 replies
  • 0 kudos
View Replies
Latest Reply
kknebel
New Contributor II
  • 0 kudos

There are a variety of third party apps that can help monitor your data and pipelines. Some big ones include calibra and bigeye

  • 0 kudos
1 More Replies
dholmgreen
by • New Contributor
  • 1387 Views
  • 0 replies
  • 0 kudos

Unity Catalog ABAC

Is there a roadmap for when ABAC (Attribute-based access control) wilö be available in Unity Catalog?

Data Engineering
Reply
  • 1387 Views
  • 0 replies
  • 0 kudos
Mac3
by • New Contributor II
  • 883 Views
  • 1 replies
  • 1 kudos

Data Engineering

What is a common problem you face when ingesting data in hot storage?

Data Engineering
Reply
  • 883 Views
  • 1 replies
  • 1 kudos
View Replies
Latest Reply
Seb
New Contributor II
  • 1 kudos

Finding the best partitioning strategy and also cost issue if you ingest huge amount of data

  • 1 kudos
DebanjanB
by • New Contributor
  • 528 Views
  • 0 replies
  • 0 kudos

Autloader processing semantics

Queue based Autoloader processes files in the order they are received only when the job is up and running. However when the job is down, the files that queue up are processed in lexical order once the job is up. Since autoloader jobs need to be stopp...

Data Engineering
Reply
  • 528 Views
  • 0 replies
  • 0 kudos
whleeman
by • New Contributor III
  • 650 Views
  • 0 replies
  • 0 kudos

Does Databricks get cached result for a subquery?

If I run a query as "SELECT fare_amount FROM nyctaxi.trips where fare_amount > 1.5".  The query results will be cached for 24 hours.I then compose a second query using the previous query as a subquery "SELECT * FROM nyctaxi.trips WHERE fare_amount IN...

Data Engineering
Reply
  • 650 Views
  • 0 replies
  • 0 kudos
Tidaldata
by • New Contributor
  • 762 Views
  • 0 replies
  • 0 kudos

Loveing Databricks Summit

Loving the summit so far, awesome keynote speakers, great trainers and paid courses. Finished certification #databrickslearning

Data Engineering
Reply
  • 762 Views
  • 0 replies
  • 0 kudos

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now
Labels