Databricks Community

Awesome Data AI Summit

Data AI Summit 2024 - Women in DE

Hoping to meet people at the data Ai summit!

Vector Search

Do you guys think vector search will be cheaper and perform better than Azure AI Search?

Connecting to SAP ECC

I'm looking to meet with others who have successfully connected databricks to SAP ECC.

can't login back to databricks community

Hello,I'm experiencing difficulty logging into the Databricks community despite using the correct username and password. Additionally, when attempting to reset my password, I haven't received any email notifications.

Vancouver user group

Add Vancouver group here 

DataAi summit

Enjoying at the Databricks Summit

Has anyone implemented an Azure Databricks Lakehouse in a hybrid environment recently?

Would be great to hear about any challenges, solutions, or tips. Thank you!

Help needed on Cluster Configuration since I'm confused AF ( Worker + Driver )

Supposedly there are 4 major types of cluster in Datbricks that are- General Purpose, Storage Optimized, Memory Optimized and Compute Optimized Clusters but I'm not able to find detailed information as on which cluster to choose specifically in which...

Azure Databricks Metrics to Prometheus?

What is the best method to expose Azure Databricks metrics to Prometheus specifically? And is it possible to get the underlying Spark metrics also? All I can see clearly defined in the documentation is the serving endpoint metrics:https://learn.micro...

RLS and CLS with delta sharing

RLS and CLS is possible to apply in tables that are shared using unity catalog?

Streaming data with kafka

What is the Best way for implement streaming data flow dron kafka to databricks (delta tables)

How to write data to Confluent Kafka with SchemaRegistry format on sparkstructured?

Hi There!I am to trying write a batch data to kafka topic with schema registry in databricks using pyspark, i serialize the data with pyspark to_avro function and write it to the topic, but the consumers can’t read the schema id. If they do not separ...

Collect Spark UI statistics to analyze the performance for several Spark Applications

To identify the reasons for a data process poor performance, we need to navigate and analyze the metrics in the Spark UI manually... However, replicating those steps for a giant group of spark applications would be very expensive in times...Given thi...

I’m at summit!