cancel
Showing results for 
Search instead for 
Did you mean: 
Resources
Explore a comprehensive repository of resources on the Databricks Community. Access tutorials, guides, webinars, and more to enhance your skills in data analytics and machine learning.
cancel
Showing results for 
Search instead for 
Did you mean: 

Browse the Community

Get Started Resources

Explore essential resources to kickstart your journey with Databricks. Access tutorials, guides, and...

0 Posts

Events

Stay updated on Databricks events, including webinars, conferences, and workshops. Discover opportun...

93 Posts

Support FAQs

Find answers to common questions and troubleshoot issues with Databricks support FAQs. Access helpfu...

19 Posts

Technical Blog

Explore in-depth articles, tutorials, and insights on data analytics and machine learning in the Dat...

168 Posts

Knowledge Sharing Hub

Dive into a collaborative space where members like YOU can exchange knowledge, tips, and best practi...

119 Posts

Announcements

Stay up-to-date with the latest announcements from Databricks. Learn about product updates, new feat...

87 Posts

DatabricksTV

Community-produced videos to help you leverage Databricks in your Data & AI journey. Tune in to expl...

118 Posts

Activity in Resources

MuraliTalluri
by Databricks Employee
  • 108 Views
  • 0 replies
  • 1 kudos

Deep Dive - Streaming Deduplication

In this article we will cover in depth about streaming deduplication using watermarking with dropDuplicates and dropDuplicatesWithinWatermark, how they are different. This blog expects you to have a good understanding on how watermarking works in Spa...

MuraliTalluri_0-1736447301690.png MuraliTalluri_1-1736447301693.png MuraliTalluri_2-1736447301693.png MuraliTalluri_3-1736447301693.png
  • 108 Views
  • 0 replies
  • 1 kudos
hari-prasad
by > Valued Contributor
  • 23 Views
  • 0 replies
  • 0 kudos

Mapping Compliance Standards to Industries: A Comprehensive Guide

Brief Guideline: Mapping Compliance Standards to IndustriesThis guide provides a detailed mapping of various compliance standards to their respective industries, highlighting the specific sectors and descriptions for each standard. Understanding thes...

hariprasad_0-1736536895255.png
  • 23 Views
  • 0 replies
  • 0 kudos
holly
by > Databricks Employee
  • 1373 Views
  • 1 replies
  • 4 kudos

Data Engineering SQL Holiday Specials

December is the most celebrated time of year in the Data Engineering calendar as we embrace the important holiday: change freeze season.  As we come back to the office to start our new projects, I wanted to make you aware of some quietly released fea...

holly_0-1736421009114.png holly_1-1736421024246.png holly_2-1736421037458.png holly_3-1736421071673.png
  • 1373 Views
  • 1 replies
  • 4 kudos
Latest Reply
BamBam
New Contributor III
  • 4 kudos

Great insight about the latest DBRS features. Thanks for sharing the information!

  • 4 kudos
Rjt_de
by Databricks Employee
  • 41219 Views
  • 8 replies
  • 21 kudos

Metadata-Driven ETL Framework in Databricks (Part-1)

In modern data-driven enterprises, data flows like lifeblood through complex systems and repositories to drive decision-making and innovation. Each dataset, whether structured or unstructured, holds the potential to unlock insights and drive innovati...

ETL_Framework - E2EDesign (1).png ETL_Framework_ER.jpeg bronze.jpg silver.jpg
  • 41219 Views
  • 8 replies
  • 21 kudos
Latest Reply
ptambe
New Contributor III
  • 21 kudos

Nice article, we have built simlar frameworks. Waiting for the next part.

  • 21 kudos
7 More Replies
Sujitha
by Databricks Employee
  • 336 Views
  • 0 replies
  • 3 kudos

Submit your feedback and win a $50 gift card!

Be among the first 20 people to share your experience with Databricks on G2 and receive a $50 gift card as our way of saying thanks. Why participate? Your feedback is invaluableIt helps us innovate and improve and takes less than 10 minutes to comple...

Screenshot 2024-06-28 at 10.12.40 AM.png
  • 336 Views
  • 0 replies
  • 3 kudos
zach_goehring
by Databricks Employee
  • 8296 Views
  • 7 replies
  • 7 kudos

Unity Catalog Functions: Tools for Users and Agents

Everyone wants to use Generative AI to solve business problems, but developers have realized that simply deploying a large language model isn’t going to be enough to cross the finish line. Business problems are complex and require a solution capable ...

blogimage.png chat1.png blogimage.png blogimage.png
  • 8296 Views
  • 7 replies
  • 7 kudos
Latest Reply
pawaris
New Contributor
  • 7 kudos

@Alberto_Umana The function is embedded in Unity Catalog. When we try to run this function, the Databricks backend uses SQL Serverless, which cannot execute Python functions.This works normally when we use general compute.  

  • 7 kudos
6 More Replies
Sujitha
by Databricks Employee
  • 453 Views
  • 0 replies
  • 0 kudos

Share Your Feedback in Our Community Survey

Your opinion matters! Take a few minutes to complete our Customer Experience Survey to help us improve the Databricks Community. Your input is crucial in shaping the future of our community and ensuring it meets your needs. Take the Survey Now Why p...

Screenshot 2024-04-03 at 11.27.02 AM.png
  • 453 Views
  • 0 replies
  • 0 kudos
Adyasha
by > Databricks Employee
  • 96 Views
  • 0 replies
  • 1 kudos

Finding your way with MapInPandas() - 08.09.2023

How to more efficiently parallelize any #Python function and process and file type with MapInPandas(). #pandas #databricks #apachespark

Finding your way with MapInPandas.png
  • 96 Views
  • 0 replies
  • 1 kudos
navalyemul
by > Databricks Employee
  • 174 Views
  • 1 replies
  • 1 kudos

Master Model Serving with Databricks

We’re thrilled to announce the launch of Model Serving with Databricks, a unified service for deploying, governing, querying, and monitoring AI models.In this video, we’ll explore how Databricks enables seamless integration with foundational models ...

Model serving thumbnail.jpg
  • 174 Views
  • 1 replies
  • 1 kudos
Latest Reply
Alberto_Umana
Databricks Employee
  • 1 kudos

@navalyemul Thanks for sharing, it was a great content I saw your video!

  • 1 kudos
Adyasha
by > Databricks Employee
  • 84 Views
  • 0 replies
  • 0 kudos

Unlock the Power of Data in Energy: Databricks Data Intelligence Platform Walkthrough

Join us for a tour of the Databricks Data Intelligence Platform, specifically designed for the energy sector. This video will show how different teams and stakeholders can collaborate seamlessly within the platform to drive business value. Whether y...

Unlock the Power of Data in Energy- Databricks Data Intelligence Platform Walkthrough.png
  • 84 Views
  • 0 replies
  • 0 kudos
Adyasha
by > Databricks Employee
  • 77 Views
  • 0 replies
  • 0 kudos

Unlock the Power of Unity Catalog Mini-Series - Part 2: Storage Credentials and External Locations

A Step-by-Step Mini-Series to a Secure, Intelligent, and Connected Data Ecosystem: Get ready to revolutionize your data governance! Join us on an epic journey as we take you through the entire process of implementing Unity Catalog from start to fini...

Unlock the Power of Unity Catalog Mini-Series -P3- Storage Catalogs, Schemas, and managing your data.png
  • 77 Views
  • 0 replies
  • 0 kudos
nk25
by > New Contributor II
  • 233 Views
  • 3 replies
  • 0 kudos

Getting data from Databricks into Excel using Databricks Jobs API

If you have your data in Databricks, but like to analyse it in Excel, you can use Web API on Power Query. It allows you to not just query an existing table, but also trigger the execution of a PySpark notebook using Databricks Jobs API, and get the d...

  • 233 Views
  • 3 replies
  • 0 kudos
Latest Reply
NandiniN
Databricks Employee
  • 0 kudos

Got it, yes you have specified the same in your message. Thanks for sharing.

  • 0 kudos
2 More Replies
Adyasha
by > Databricks Employee
  • 92 Views
  • 0 replies
  • 0 kudos

Desbloquea el Poder de Unity Catalog: Una Mini Serie de Migración Paso a Paso - Parte 1

¡Prepárate para revolucionar la gobernanza de tus datos! Únete a nosotros en un viaje donde te guiaremos a lo largo de todo el proceso de implementación de Unity Catalog, de principio a fin. Ya seas un principiante en gobernanza de datos o un profes...

Desbloquea el Poder de Unity Catalog- Parte 2- Storage Credentials y External Locations.png
  • 92 Views
  • 0 replies
  • 0 kudos
TakuyaOmi
by > Valued Contributor
  • 126 Views
  • 1 replies
  • 3 kudos

How to Grant Workspace Admin Permissions to an ID Using Parent Groups

Hello,There are several ways to grant Workspace Admin permissions in Databricks. While this may seem straightforward, I found it a bit confusing when I started using Databricks, so I’d like to share my experience. This guide is aimed at beginners.How...

TakuyaOmi_4-1735401774100.png TakuyaOmi_2-1735401216903.png TakuyaOmi_5-1735401862717.png TakuyaOmi_6-1735402496967.png
  • 126 Views
  • 1 replies
  • 3 kudos
Latest Reply
Alberto_Umana
Databricks Employee
  • 3 kudos

Thanks for sharing this is great!

  • 3 kudos
Adyasha
by > Databricks Employee
  • 279 Views
  • 0 replies
  • 1 kudos

Quick Intro to Lakeview Dashboards (under 10 minutes!) - 2023.10.16

Are you interested in creating visualizations on Databricks? You’ve come to the right place! In this video, Olivia Zhang, a Solutions Architect at Databricks, goes over the process of creating dashboards using Lakeview Dashboards in just 5 min (yep,...

Quick Intro to Lakeview Dashboards (under 10 minutes!).png
  • 279 Views
  • 0 replies
  • 1 kudos
Top Kudoed Authors