cancel
Showing results forĀ 
Search instead forĀ 
Did you mean:Ā 
Resources
cancel
Showing results forĀ 
Search instead forĀ 
Did you mean:Ā 

Browse the Community

Databricks TV

Discover a treasure trove of video content where experts share insights, tutorials, and real-world c...

3 Posts

Knowledge Sharing Hub

Dive into a collaborative space where members like YOU can exchange knowledge, tips, and best practi...

21 Posts

Activity in Resources

MichTalebzadeh
by Contributor
  • 12 Views
  • 0 replies
  • 0 kudos

Financial Crime detection with the help of Apache Spark, Data Mesh and Data Lakes.

For those interested in Data Mesh and Data Lakes for FinCrime detection:Data mesh is a relatively new architectural concept for data management that emphasizes domain-driven data ownership and self-service data availability. It promotes the decentral...

Knowledge Sharing Hub
data lakes
Data Mesh
financial crime
spark
  • 12 Views
  • 0 replies
  • 0 kudos
legobricks
by Visitor
  • 44 Views
  • 0 replies
  • 0 kudos

Unable to mount GCS bucket with underscores in the name

I have two buckets with the same configurations and labels.One is named my-bucket and the other is my_bucket. I am able to mount my-bucket but get an opaque error message when trying to mount my_bucket. Is this known/expected behavior? Are underscore...

  • 44 Views
  • 0 replies
  • 0 kudos
Sujitha
by Community Manager
  • 206 Views
  • 1 replies
  • 1 kudos

Unity Catalog Lakeguard: Industry-first and only data governance for multi-user Apacheā„¢ Spark cluste

Run Scala, Python and SQL workloads on shared, cost-efficient multi-user compute. We are thrilled to announce Unity Catalog Lakeguard, which allows you to run Apache Sparkā„¢ workloads in SQL, Python, and Scala with full data governance on the Databric...

Screenshot 2024-04-25 at 8.28.10ā€ÆPM.png
  • 206 Views
  • 1 replies
  • 1 kudos
Latest Reply
ani-khadkikar
New Contributor
  • 1 kudos

Hello Sujitha - Will this be extended to R? And by when? R continues to be used quite heavily in the industry. Would be good to know when the limitations of R and shared cluster usage will be taken away.

  • 1 kudos
Sujitha
by Community Manager
  • 3013 Views
  • 4 replies
  • 5 kudos

Resolved! Submit your feedback and win a $25 gift card!

The first 25 people to submit a completed survey response will receive a $25 gift card as an expression of our gratitude. Treat yourself on Databricks! Your feedback is crucial to us and directly influences how we innovate and improve our customer ex...

Screenshot 2024-04-03 at 11.27.02ā€ÆAM.png
  • 3013 Views
  • 4 replies
  • 5 kudos
Latest Reply
janelleglover
New Contributor II
  • 5 kudos

Hi everyone!  Thank you all so much for the amazing response to this post! We are so grateful to hear your feedback.  This post is now closed, but stay tuned for similar opportunities in the future.  Thanks again! 

  • 5 kudos
3 More Replies
Sujitha
by Community Manager
  • 729 Views
  • 0 replies
  • 2 kudos

Announcing the General Availability of Databricks Asset Bundles

Get started with Databricks Asset Bundles (DABs) today! Simplify project management, versioning, testing, and deployment for your data and AI projects on the Databricks Platform. Embrace software engineering best practices with DABsā€”source control, c...

Screenshot 2024-04-25 at 8.09.57ā€ÆAM.png
  • 729 Views
  • 0 replies
  • 2 kudos
Ajay-Pandey
by Esteemed Contributor III
  • 344 Views
  • 1 replies
  • 2 kudos

Databricks Notebook Workflow

Exciting news for Databricks users! The ability to view job details within the notebook workflow section, particularly for multithreaded jobs, is available now. Instead of manually inspecting each job for failures, this feature enables us to swiftly ...

AjayPandey_1-1713513883239.jpeg
Knowledge Sharing Hub
Databricks
databrickscommunity
Knowledge Sharing Hub
newfeatures
workflow
  • 344 Views
  • 1 replies
  • 2 kudos
Latest Reply
Lakshay
Esteemed Contributor
  • 2 kudos

Thank you for sharing

  • 2 kudos
Sujitha
by Community Manager
  • 929 Views
  • 3 replies
  • 5 kudos

šŸŒŸ Welcome to the Knowledge Sharing Hub! šŸŒŸ

Are you passionate about sharing your discoveries and insights with the world? Look no further! Our Knowledge Sharing Hub is the perfect space for you to showcase your research and connect with like-minded individuals across the globe. Here's why you...

  • 929 Views
  • 3 replies
  • 5 kudos
Latest Reply
Ajay-Pandey
Esteemed Contributor III
  • 5 kudos

Great place to knowledge sharing and collaboration. 

  • 5 kudos
2 More Replies
Hubert-Dudek
by Esteemed Contributor III
  • 348 Views
  • 1 replies
  • 0 kudos

Spot databricks VMs - eviction rates

Before using Spot machines in #databricks, it's a good idea to check their eviction rates in your region. Azure Resource Graph Explorer and that simple query will help. SpotResources | where type =~ 'microsoft.compute/skuspotevictionrate/location' ...

spots.png
  • 348 Views
  • 1 replies
  • 0 kudos
Latest Reply
jose_gonzalez
Moderator
  • 0 kudos

Thank you for sharing this @Hubert-Dudek 

  • 0 kudos
mm_soc
by New Contributor
  • 332 Views
  • 0 replies
  • 0 kudos

Installing CrowdStrike Falcon Sensor on Databricks Workers

Greetings,Does anyone here have experience deploying the CrowdStrike Falcon sensor on Databricks worker instances? For context, the cluster is deployed in AWS and we use a Databricks Ubuntu 20.04 AMI. Databricks allows adding a bootstrap/startup scri...

  • 332 Views
  • 0 replies
  • 0 kudos
Danny_Lee
by Contributor
  • 912 Views
  • 1 replies
  • 1 kudos

Jonathan Frankel at Sigma talk

Hi @Sujitha Just to follow up on your suggestion to share my takeaways from Jonathan Frankel's talk at Sigma in NYC.  The key ideas I came away with is:Building in-house custom models is more than just possible, there's advantages to itThere's danger...

  • 912 Views
  • 1 replies
  • 1 kudos
Latest Reply
Sujitha
Community Manager
  • 1 kudos

@Danny_Lee This is super insightful! Really appreciate your time to share your key takeaways with us. 

  • 1 kudos
Sujitha
by Community Manager
  • 4490 Views
  • 3 replies
  • 3 kudos

Data Warehousing in the Era of AI

AI has the power to address the data warehouseā€™s biggest challenges ā€” performance, governance and usability ā€” thanks to its deeper understanding of your data and how itā€™s used. This is data intelligence and itā€™s revolutionizing the way you query, man...

2024-02-VE-data-warehousing-in-the-era-of-ai-community-LP-460x460-2x.png
  • 4490 Views
  • 3 replies
  • 3 kudos
Latest Reply
Ajay-Pandey
Esteemed Contributor III
  • 3 kudos

Thanks for sharing!Must register and attend sessions

  • 3 kudos
2 More Replies
Sujitha
by Community Manager
  • 3477 Views
  • 3 replies
  • 7 kudos

Meet DBRX, the New Standard for High-Quality LLMs

Get your first look at DBRX April 25, 2024 | 8 AM PT If youā€™re using off-the-shelf LLMs to build GenAI applications, youā€™re probably struggling with quality, privacy and governance issues. What you need is a way to cost-effectively build a custom LLM...

Screenshot 2024-04-02 at 10.25.27ā€ÆPM.png
  • 3477 Views
  • 3 replies
  • 7 kudos
Latest Reply
Ajay-Pandey
Esteemed Contributor III
  • 7 kudos

Thanks for sharing!

  • 7 kudos
2 More Replies
Sujitha
by Community Manager
  • 1996 Views
  • 1 replies
  • 1 kudos

Announcing DBRX: A new standard for efficient open source LLMs

Are you ready to elevate your AI applications? Experience the power of DBRX, our cutting-edge open-source foundation model. Outperforming established open models in quality benchmarks, DBRX empowers you to swiftly craft bespoke LLMs tailored to your ...

Screenshot 2024-04-02 at 5.01.50ā€ÆPM.png
  • 1996 Views
  • 1 replies
  • 1 kudos
Latest Reply
Ajay-Pandey
Esteemed Contributor III
  • 1 kudos

Thanks for sharing !

  • 1 kudos
Danny_Lee
by Contributor
  • 454 Views
  • 0 replies
  • 0 kudos

Databricks AI Security Framework

Today Databricks announced the release of the Databricks AI Security Framework (LinkedIn Post)You can download the paper (PDF) from blog post. Anyone else download this and have thoughts?   My first thought is its a great start and has an excellent G...

  • 454 Views
  • 0 replies
  • 0 kudos
Sujitha
by Community Manager
  • 779 Views
  • 0 replies
  • 1 kudos

šŸ“¢ NEWS: Databricks Unveils An AI Model That Helps Businesses Build Their Own Models! šŸš€

CEO Ali Ghodsi emphasized the importance of open-source collaboration, stating, "Companies don't want to get locked into different proprietary standards. So it's actually also a competitive advantage for us business-wise." Databricks' revenue primari...

Screenshot 2024-03-27 at 7.09.30ā€ÆPM.png
  • 779 Views
  • 0 replies
  • 1 kudos