- 3949 Views
- 5 replies
- 3 kudos
How do I install a non python/R/maven/jar library into a cluster?
I'm trying to install a non standard package into the cluster using the init scripts. The package I'm trying to install needs to be downloaded using wget, and uncompressed using tar. Then added to the PATH, or at least I need to know where the downlo...
- 3949 Views
- 5 replies
- 3 kudos
- 3 kudos
Thank you for the support. Yes, I was able to find a working solution.I placed the files into the distributed file system, dbfs. For others, this can be done manually using the databricks cli, or using the init scripts. In this case I found it easier...
- 3 kudos
- 5437 Views
- 6 replies
- 5 kudos
How to mount s3 bucket in community edition cluster?
I'm using Databricks Community Edition for testing purposes on a OSS project.I'm spinning up the cluster automatically through Databricks Clusters API.The automated tests rely on AWS S3 infrastructure, reason why I need to mount the S3 bucket on the ...
- 5437 Views
- 6 replies
- 5 kudos
- 5 kudos
I haven't found any solution.I'm assuming that currently my only option is the usage of Databricks Enterprise to model scenarios involving the mounting of object storage buckets.
- 5 kudos
- 2464 Views
- 1 replies
- 0 kudos
Resolved! Cluster terminated in Databricks Community Edition
I've tried to start a single cluster 4 times on Databricks Community Edition today (13 March 2022). It's failed every time. Here's the first part of the output summary.```Time2022-03-13 13:59:14 EDTMessageCluster terminated.Reason:Unexpected launch f...
- 2464 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Noel Jameson​ We have some internal service interruptions due to which we had this issue. Our engineering has applied the fix and the cluster startup works as expected. Sincerely apologies for the inconvenience caused here.Regards,Darshan
- 0 kudos
- 3416 Views
- 1 replies
- 32 kudos
Databricks Roadmap Azure There are a lot of excitement new features coming in 2022. I tried to put them all on one list: Unity catalog (seems that it ...
Databricks Roadmap AzureThere are a lot of excitement new features coming in 2022. I tried to put them all on one list:Unity catalog (seems that it will exists next to hive metastore and it will be possible to migrate)Control metastore, unity creatio...
- 3416 Views
- 1 replies
- 32 kudos
- 32 kudos
Databricks Roadmap AzureThere are a lot of excitement new features coming in 2022. I tried to put them all on one list:Unity catalog (seems that it will exists next to hive metastore and it will be possible to migrate)Control metastore, unity creatio...
- 32 kudos
- 1449 Views
- 0 replies
- 2 kudos
2021-08-Best-Practices-for-Your-Data-Architecture-v3-OG-1200x628
Thanks to everyone who joined the Best Practices for Your Data Architecture session on Optimizing Data Performance. You can access the on-demand session recording here and the pre-run performance benchmarks using the Spark UI Simulator. Proper cluste...
- 1449 Views
- 0 replies
- 2 kudos