cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Bradley
by New Contributor III
  • 2285 Views
  • 7 replies
  • 3 kudos

How do I install a non python/R/maven/jar library into a cluster?

I'm trying to install a non standard package into the cluster using the init scripts. The package I'm trying to install needs to be downloaded using wget, and uncompressed using tar. Then added to the PATH, or at least I need to know where the downlo...

  • 2285 Views
  • 7 replies
  • 3 kudos
Latest Reply
Bradley
New Contributor III
  • 3 kudos

Thank you for the support. Yes, I was able to find a working solution.I placed the files into the distributed file system, dbfs. For others, this can be done manually using the databricks cli, or using the init scripts. In this case I found it easier...

  • 3 kudos
6 More Replies
findinpath
by Contributor
  • 3131 Views
  • 9 replies
  • 5 kudos

How to mount s3 bucket in community edition cluster?

I'm using Databricks Community Edition for testing purposes on a OSS project.I'm spinning up the cluster automatically through Databricks Clusters API.The automated tests rely on AWS S3 infrastructure, reason why I need to mount the S3 bucket on the ...

  • 3131 Views
  • 9 replies
  • 5 kudos
Latest Reply
findinpath
Contributor
  • 5 kudos

I haven't found any solution.I'm assuming that currently my only option is the usage of Databricks Enterprise to model scenarios involving the mounting of object storage buckets.

  • 5 kudos
8 More Replies
njjameson
by New Contributor
  • 1614 Views
  • 1 replies
  • 0 kudos

Resolved! Cluster terminated in Databricks Community Edition

I've tried to start a single cluster 4 times on Databricks Community Edition today (13 March 2022). It's failed every time. Here's the first part of the output summary.```Time2022-03-13 13:59:14 EDTMessageCluster terminated.Reason:Unexpected launch f...

  • 1614 Views
  • 1 replies
  • 0 kudos
Latest Reply
User16753724663
Valued Contributor
  • 0 kudos

Hi @Noel Jameson​ We have some internal service interruptions due to which we had this issue. Our engineering has applied the fix and the cluster startup works as expected. Sincerely apologies for the inconvenience caused here.Regards,Darshan

  • 0 kudos
Hubert-Dudek
by Esteemed Contributor III
  • 2584 Views
  • 2 replies
  • 32 kudos

Databricks Roadmap Azure There are a lot of excitement new features coming in 2022. I tried to put them all on one list: Unity catalog (seems that it ...

Databricks Roadmap AzureThere are a lot of excitement new features coming in 2022. I tried to put them all on one list:Unity catalog (seems that it will exists next to hive metastore and it will be possible to migrate)Control metastore, unity creatio...

  • 2584 Views
  • 2 replies
  • 32 kudos
Latest Reply
Kaniz
Community Manager
  • 32 kudos

Hi @Hubert Dudek​ , We know the world is full of choices. Thank you for choosing us! We would like to thank excellent customers like you for your support. We couldn’t do it without you! 

  • 32 kudos
1 More Replies
MadelynM
by New Contributor III
  • 1107 Views
  • 0 replies
  • 2 kudos

2021-08-Best-Practices-for-Your-Data-Architecture-v3-OG-1200x628

Thanks to everyone who joined the Best Practices for Your Data Architecture session on Optimizing Data Performance. You can access the on-demand session recording here and the pre-run performance benchmarks using the Spark UI Simulator. Proper cluste...

  • 1107 Views
  • 0 replies
  • 2 kudos
Labels