by
JPKC
• New Contributor
- 924 Views
- 3 replies
- 1 kudos
As per this thread Databricks now integrates with EC2 CreateFleet API that allows customers to create Databricks pools and get EC2 instances from multiple AZs and multiple instance families & sizes. However, in the Databricks UI you can not select mo...
- 924 Views
- 3 replies
- 1 kudos
Latest Reply
Fleet instances on Databricks is now GA and available in all AWS workspaces - you can find more details here: https://docs.databricks.com/compute/aws-fleet-instances.html
2 More Replies
- 3106 Views
- 8 replies
- 16 kudos
What will happen if a driver node will fail?What will happen if one of the worker node fails?Is it same in Spark and Databricks or Databricks provide additional features to overcome these situations?
- 3106 Views
- 8 replies
- 16 kudos
Latest Reply
Hi @Abdullah Durrani​, I'm glad to see that the suggestions provided here helped you. Well, in that case, would you please help us select the best answer for the community?
7 More Replies
- 1105 Views
- 3 replies
- 0 kudos
I have a security requirement to encrypt all data when it is in transit. I am wondering if there is a setting I can use to enable encryption of the data during shuffles between the worker nodes.
- 1105 Views
- 3 replies
- 0 kudos
Latest Reply
Inter-node encryption is a requirement for HIPPA compliance, reach out to your account management team and ask them for HIPPA compliant shards.
2 More Replies
- 1602 Views
- 1 replies
- 0 kudos
I am new to using Databricks and want to create a cluster, but there are many different worker types to choose from. How do I know which worker type is the right type for my use case?
- 1602 Views
- 1 replies
- 0 kudos
Latest Reply
For delta workloads, where you could benefit from caching it is recommended to use storage optimized instances that come with NVMe SSDs. For other workloads, it would be a good idea to check Ganglia metrics to see whether your workload is Cpu/Memory ...
