cancel
Showing results for 
Search instead for 
Did you mean: 
Community Articles
Dive into a collaborative space where members like YOU can exchange knowledge, tips, and best practices. Join the conversation today and unlock a wealth of collective wisdom to enhance your experience and drive success.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

MichTalebzadeh
by Valued Contributor
  • 6839 Views
  • 1 replies
  • 1 kudos

Building Event-Driven Real-Time Data Processor with Spark Structured Streaming and API Integration

 I recently saw an article from Databricks titled "Scalable Spark Structured Streaming for REST API Destinations". A great article focusing on continuous Spark Structured Streaming (SSS). About a year old. I then decided, given customer demands to wo...

Community Articles
Event-driven architecture
Flask
spark
Spark Structure Streaming
Spark Structured Streaming
  • 6839 Views
  • 1 replies
  • 1 kudos
Hubert-Dudek
by Databricks MVP
  • 2587 Views
  • 0 replies
  • 0 kudos

stored procedures

The plan for stored procedures in databricks spark has been announced in a few places. How can stored procedures look in Spark SQL?

stored.png
  • 2587 Views
  • 0 replies
  • 0 kudos
hanlinsun
by Databricks Employee
  • 1046 Views
  • 0 replies
  • 0 kudos

Redesigned Move File & Clone File Experiences

Hi everyone! We are redesigning the Move File and Clone File experiences. We want to make it as seamless as possible to organize your files, and would love your feedback on the designs!   Move File: Move Option 1   Move Option 2:     Clone File: Cl...

hanlinsun_0-1707354147837.png hanlinsun_1-1707354172264.png hanlinsun_2-1707354211904.png hanlinsun_3-1707354282734.png
  • 1046 Views
  • 0 replies
  • 0 kudos
Hubert-Dudek
by Databricks MVP
  • 2755 Views
  • 1 replies
  • 2 kudos

liquid partitioning

Based on my experience with data partitioning, it often diminishes performance rather than enhancing it. There are exceptions, like when handling tables over 1TB, or when EVERY single query utilizes partition in the WHERE clause - for instance, a Pow...

ezgif-1-900d8d6a4e.gif
Community Articles
optimize
Partitions
  • 2755 Views
  • 1 replies
  • 2 kudos
Latest Reply
jose_gonzalez
Databricks Employee
  • 2 kudos

Thank you for sharing this @Hubert-Dudek !!

  • 2 kudos
Taha_Hussain
by Databricks Employee
  • 3647 Views
  • 0 replies
  • 2 kudos

Your updated resource guide to the Databricks Data Intelligence Platform

Want to increase your Databricks knowledge? Look no further!Here’s a guide filled with key resources you’ll need while working on the Databricks Data Inteligence Platform. Bookmark these pages for future reference, or apply these learnings during the...

Screenshot 2023-11-22 at 2.06.35 PM.png
  • 3647 Views
  • 0 replies
  • 2 kudos
Taha_Hussain
by Databricks Employee
  • 5046 Views
  • 0 replies
  • 0 kudos

✨New in Notebooks: AI-powered Databricks Assistant, improved visualizations, web terminal and more!

We are excited to share some of the latest updates in Databricks Notebooks. From AI-powered Databricks Assistant that automates code development to new charts with better performance, these features help you build faster. See the latest features live...

generatecode.gif explain_code.gif fix_code (3).gif Screenshot 2023-10-20 at 10.11.24 AM.png
  • 5046 Views
  • 0 replies
  • 0 kudos
Sujitha
by Databricks Employee
  • 12061 Views
  • 1 replies
  • 1 kudos

Simplify complex workflows with modular jobs

Thousands of Databricks customers use Databricks Workflows every day to orchestrate business-critical workloads on the Databricks Lakehouse Platform. A great way to simplify those critical workloads is through modular orchestration. This is now possi...

Sujitha_0-1694069414336.png Sujitha_1-1694069414523.png
Community Articles
jobs
Modular Orchestration
run jobs
Workflows
  • 12061 Views
  • 1 replies
  • 1 kudos
Latest Reply
UiliamVenerio
New Contributor II
  • 1 kudos

Hello, is the "if/else condition" task type available for testing?

  • 1 kudos
Sujitha
by Databricks Employee
  • 9457 Views
  • 0 replies
  • 0 kudos

Set up AI-driven optimizations in Databricks SQL

With Predictive I/O for reads (GA) and updates (Public Preview), Databricks SQL can now analyze historical read and write patterns to intelligently build indexes and optimize DELETE, MERGE, and UPDATE operations. What is Predictive I/O? Predictive I/...

Community Articles
Databricks SQL
DELETE
MERGE
Predictive IO
Update
  • 9457 Views
  • 0 replies
  • 0 kudos
Sujitha
by Databricks Employee
  • 11769 Views
  • 0 replies
  • 0 kudos

Share views and schemas with your team

Delta Sharing is a great way to securely share data across different Unity Catalog metastores in your own Databricks account. This now includes using Delta Sharing to share views and schemas directly with other Databricks recipients from within the D...

Screenshot 2023-09-14 at 12.10.53 AM.png
Community Articles
DATA SHARING
DELTA SHARING
SCHEMAS
views
  • 11769 Views
  • 0 replies
  • 0 kudos
Krause
by New Contributor
  • 2346 Views
  • 0 replies
  • 0 kudos

Power BI with Databricks

Connecting Power BI to Databricks is very easy. There's an extension you can use within Power BI that allows you to insert data and create charts based on the databricks data.

  • 2346 Views
  • 0 replies
  • 0 kudos
Labels