cancel
Showing results for 
Search instead for 
Did you mean: 
Warehousing & Analytics
Engage in discussions on data warehousing, analytics, and BI solutions within the Databricks Community. Share insights, tips, and best practices for leveraging data for informed decision-making.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

brickster_2018
by Databricks Employee
  • 11917 Views
  • 3 replies
  • 1 kudos

Resolved! Dynamic Allocation vs Cluster Auto-scaling

How is Cluster auto-scaling in Databricks different from Dynamic Allocation in Yarn

  • 11917 Views
  • 3 replies
  • 1 kudos
Latest Reply
shan_chandra
Databricks Employee
  • 1 kudos

Additional reads on the same topic:https://databricks.com/blog/2018/05/02/introducing-databricks-optimized-auto-scaling.htmlhttps://spark.apache.org/docs/latest/job-scheduling.html#dynamic-resource-allocation

  • 1 kudos
2 More Replies
jwilliam
by Contributor
  • 9739 Views
  • 5 replies
  • 10 kudos
  • 9739 Views
  • 5 replies
  • 10 kudos
Latest Reply
BilalAslamDbrx
Databricks Employee
  • 10 kudos

Great question! There are similarities and differences:SimilaritiesPhoton is enabled on bothYou have Databricks Runtime on bothDifferencesDatabricks Runtime (DBR) version is managed and auto-upgraded in Databricks SQL. Because SQL is a narrower workl...

  • 10 kudos
4 More Replies
Labels