cancel
Turn on suggestions
Showing results for 
Search instead for 
Did you mean: 
Help
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Turn on suggestions
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Start a conversation
Phani1
by • Valued Contributor II
  • 418 Views
  • 1 replies
  • 0 kudos

CDC for Unstructured data

Hi All,how we can handle CDC for unstructured data in Databricks. What are some best practices we should follow to make this work effectively?Regards,Phani

Get Started Discussions
Reply
  • 418 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
filipniziol
Esteemed Contributor
  • 0 kudos

Hi @Phani1 ,Handling CDC for unstructured data—such as audio, images, or video files—in Databricks involves efficiently detecting and processing changes to these files as they occur.Here's how you can approach this:Use Databricks Autoloader: Autoload...

  • 0 kudos
Phani1
by • Valued Contributor II
  • 616 Views
  • 1 replies
  • 0 kudos

Job Cluster best practices for production workloads

 Hi All,Can you please share the best practices for job clusters configurations for production workloadsand which is good when compared to serverless and job cluster in production in terms of cost and performance?Regards,Phani 

Get Started Discussions
Reply
  • 616 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
Retired_mod
Esteemed Contributor III
  • 0 kudos

Hi @Phani1, For configuring job clusters for production workloads in Databricks, follow these best practices: match cluster size to workload needs, enable autoscaling for dynamic adjustment of worker nodes, use spot instances with a fallback to on-de...

  • 0 kudos
Labels
li.common.scroll-to.top