cancel
Showing results for 
Search instead for 
Did you mean: 
Knowledge Sharing Hub
Dive into a collaborative space where members like YOU can exchange knowledge, tips, and best practices. Join the conversation today and unlock a wealth of collective wisdom to enhance your experience and drive success.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

legobricks
by New Contributor
  • 109 Views
  • 2 replies
  • 0 kudos

Unable to mount GCS bucket with underscores in the name

I have two buckets with the same configurations and labels.One is named my-bucket and the other is my_bucket. I am able to mount my-bucket but get an opaque error message when trying to mount my_bucket. Is this known/expected behavior? Are underscore...

  • 109 Views
  • 2 replies
  • 0 kudos
Latest Reply
Walter_C
Valued Contributor II
  • 0 kudos

Hello it seems this is a known issue which is being worked by our engineering team. This is because when handling the mount point information we are using java.net.URI which does not accept _ in the hostname. 

  • 0 kudos
1 More Replies
MichTalebzadeh
by Contributor
  • 110 Views
  • 0 replies
  • 0 kudos

Financial Crime detection with the help of Apache Spark, Data Mesh and Data Lake

For those interested in Data Mesh and Data Lakes for FinCrime detection:Data mesh is a relatively new architectural concept for data management that emphasizes domain-driven data ownership and self-service data availability. It promotes the decentral...

Knowledge Sharing Hub
data lakes
Data Mesh
financial crime
spark
  • 110 Views
  • 0 replies
  • 0 kudos
Ajay-Pandey
by Esteemed Contributor III
  • 353 Views
  • 1 replies
  • 2 kudos

Databricks Notebook Workflow

Exciting news for Databricks users! The ability to view job details within the notebook workflow section, particularly for multithreaded jobs, is available now. Instead of manually inspecting each job for failures, this feature enables us to swiftly ...

AjayPandey_1-1713513883239.jpeg
Knowledge Sharing Hub
Databricks
databrickscommunity
Knowledge Sharing Hub
newfeatures
workflow
  • 353 Views
  • 1 replies
  • 2 kudos
Latest Reply
Lakshay
Esteemed Contributor
  • 2 kudos

Thank you for sharing

  • 2 kudos
Sujitha
by Community Manager
  • 953 Views
  • 3 replies
  • 5 kudos

🌟 Welcome to the Knowledge Sharing Hub! 🌟

Are you passionate about sharing your discoveries and insights with the world? Look no further! Our Knowledge Sharing Hub is the perfect space for you to showcase your research and connect with like-minded individuals across the globe. Here's why you...

  • 953 Views
  • 3 replies
  • 5 kudos
Latest Reply
Ajay-Pandey
Esteemed Contributor III
  • 5 kudos

Great place to knowledge sharing and collaboration. 

  • 5 kudos
2 More Replies
Hubert-Dudek
by Esteemed Contributor III
  • 360 Views
  • 1 replies
  • 0 kudos

Spot databricks VMs - eviction rates

Before using Spot machines in #databricks, it's a good idea to check their eviction rates in your region. Azure Resource Graph Explorer and that simple query will help. SpotResources | where type =~ 'microsoft.compute/skuspotevictionrate/location' ...

spots.png
  • 360 Views
  • 1 replies
  • 0 kudos
Latest Reply
jose_gonzalez
Moderator
  • 0 kudos

Thank you for sharing this @Hubert-Dudek 

  • 0 kudos
Danny_Lee
by Contributor
  • 924 Views
  • 1 replies
  • 1 kudos

Jonathan Frankel at Sigma talk

Hi @Sujitha Just to follow up on your suggestion to share my takeaways from Jonathan Frankel's talk at Sigma in NYC.  The key ideas I came away with is:Building in-house custom models is more than just possible, there's advantages to itThere's danger...

  • 924 Views
  • 1 replies
  • 1 kudos
Latest Reply
Sujitha
Community Manager
  • 1 kudos

@Danny_Lee This is super insightful! Really appreciate your time to share your key takeaways with us. 

  • 1 kudos
Danny_Lee
by Contributor
  • 516 Views
  • 0 replies
  • 0 kudos

Databricks AI Security Framework

Today Databricks announced the release of the Databricks AI Security Framework (LinkedIn Post)You can download the paper (PDF) from blog post. Anyone else download this and have thoughts?   My first thought is its a great start and has an excellent G...

  • 516 Views
  • 0 replies
  • 0 kudos
Hubert-Dudek
by Esteemed Contributor III
  • 724 Views
  • 1 replies
  • 0 kudos

Predictive optimization log

After you enable predictive optimization, it is good to look at the system table and see what is going on with your tables #databricks

pl.png
  • 724 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz
Community Manager
  • 0 kudos

Hi @Hubert-Dudek , Thank you for sharing your valuable insights on the Knowledge Sharing Hub. Your expertise is greatly appreciated and contributes significantly to our community's knowledge base.

  • 0 kudos
avrm91
by New Contributor II
  • 668 Views
  • 0 replies
  • 0 kudos

GCP - Initial External Location to GCP Bucket is wrong

When creating a new Workspace in GCP the default GCP External Location is wrong.Its easily fixed by Catalog (on the left) > External Data (on the bottom) > External Locations > choose the connection and edit the URL by deleting the second BucketId af...

avrm91_1-1711447524318.png avrm91_0-1711447511611.png
  • 668 Views
  • 0 replies
  • 0 kudos
Emil_Kaminski
by Contributor
  • 2041 Views
  • 3 replies
  • 2 kudos

Materials to pass Databricks Data Engineering Associate Exam

Hi Guys, I have passed it already some time ago, but just recently have summarized all the materials which helped me to do it. Pay special attention to GitHub repository, which contains many great exercises prepared by Databricks teamhttps://youtu.be...

  • 2041 Views
  • 3 replies
  • 2 kudos
Latest Reply
PurtiSharma
New Contributor II
  • 2 kudos

Thanks for sharing. It is indeed very useful.

  • 2 kudos
2 More Replies
Hubert-Dudek
by Esteemed Contributor III
  • 668 Views
  • 0 replies
  • 0 kudos

Debug stream

One of the easiest ways to debug a stream is to stream it to memory and query it with SQL #databricks

debug.png
  • 668 Views
  • 0 replies
  • 0 kudos
MichTalebzadeh
by Contributor
  • 414 Views
  • 0 replies
  • 0 kudos

Feature article: Leveraging Generative AI with Apache Spark: Transforming Data Engineering

I created this article in Linkedlin to allow both this community and Apache Spark user community to have access to it.It is particularly useful for data engineers who want to have a basic understanding of what  Generative AI with Spark can do.Leverag...

Knowledge Sharing Hub
Generative AI
spark
  • 414 Views
  • 0 replies
  • 0 kudos
Hubert-Dudek
by Esteemed Contributor III
  • 874 Views
  • 1 replies
  • 3 kudos

DBR 15.0 beta

databricks runtime 15 is out there!Some breaking changes. More info here https://docs.databricks.com/en/release-notes/runtime/15.0.html

15.png
  • 874 Views
  • 1 replies
  • 3 kudos
Latest Reply
jose_gonzalez
Moderator
  • 3 kudos

Thanks for sharing this information @Hubert-Dudek!!!

  • 3 kudos
Hubert-Dudek
by Esteemed Contributor III
  • 1414 Views
  • 1 replies
  • 1 kudos

Notebook IDE

This is an excellent step for #databricks notebooks. Integrated debugger and CLI in notebook terminal is a big step towards a fully functional cloud IDE.

ide.png
  • 1414 Views
  • 1 replies
  • 1 kudos
Latest Reply
jose_gonzalez
Moderator
  • 1 kudos

Thank you for sharing this @Hubert-Dudek!!!

  • 1 kudos