cancel
Showing results for 
Search instead for 
Did you mean: 
Community Articles
Dive into a collaborative space where members like YOU can exchange knowledge, tips, and best practices. Join the conversation today and unlock a wealth of collective wisdom to enhance your experience and drive success.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

AbhaySingh
by Databricks Employee
  • 4143 Views
  • 0 replies
  • 1 kudos

Delta Lake 4.0 in the Real World

Delta Lake 4.0 is the next major open-source release aligned with Spark 4.x, adding first-class Variant for semi-structured data, safer Type Widening, improved DROP FEATURE, better transaction log handling, and a new multi-engine story via Delta Kern...

  • 4143 Views
  • 0 replies
  • 1 kudos
venkat-raghavan
by New Contributor III
  • 1041 Views
  • 1 replies
  • 3 kudos

PDFs to Production

Databricks just solved a huge problem - unlocking the value from unstructured data. One of the biggest challenges enterprises face when scaling agents is access to unstructured data. Nearly 80% of enterprise knowledge is trapped in PDFs, reports, and...

  • 1041 Views
  • 1 replies
  • 3 kudos
Latest Reply
Advika
Community Manager
  • 3 kudos

Thanks for sharing, @venkat-raghavan! ai_parse_document turns documents into governed, queryable assets, it's definitely the puzzle piece all needed. 

  • 3 kudos
venkat-raghavan
by New Contributor III
  • 1479 Views
  • 0 replies
  • 2 kudos

Databricks Managed MCP Servers

This is super amazing and super powerful -https://docs.databricks.com/aws/en/generative-ai/mcp/managed-mcpEssentially we you can use Databricks managed MCP servers to seamlessly integrate  Databricks features into any AI Agent. That's the multiplier ...

  • 1479 Views
  • 0 replies
  • 2 kudos
AbhaySingh
by Databricks Employee
  • 1740 Views
  • 1 replies
  • 5 kudos

Python Data Source API

  If you’ve ever hacked together a one-off script to pull data from some random API into Spark, you’re exactly who the new Python Data Source API is for. Databricks has made this API generally available on Apache Sparkâ„¢ 4.0 with Databricks Runtime 1...

  • 1740 Views
  • 1 replies
  • 5 kudos
Latest Reply
Raman_Unifeye
Honored Contributor III
  • 5 kudos

I have seen multiple glue jobs pulling data from such systems. This is certainly a solution to simplify and bring governance to it. will look forward to implement it.#Apache-4

  • 5 kudos
bianca_unifeye
by Databricks MVP
  • 1385 Views
  • 1 replies
  • 3 kudos

Databricks + Power BI

Last night I delivered my final session on Databricks + Power BI integration and it felt like the right moment to close this chapter on a high note. Because it was the last time I was presenting this topic, I rebuilt the flow completely. Instead of ...

  • 1385 Views
  • 1 replies
  • 3 kudos
Latest Reply
Raman_Unifeye
Honored Contributor III
  • 3 kudos

Well done Bianca. Look forward to Fabric session.

  • 3 kudos
Commitchell
by Databricks Employee
  • 2077 Views
  • 1 replies
  • 8 kudos

Recap: Data & AI World Tour - Chicago, Nov 19, 2025

Yesterday in Chicago, I attended one of the final stops of the Databricks DAIWT (Data & AI World Tour).  This tour brings the excitement and passion of our annual Data + AI Summit to over a dozen cities worldwide, in a condensed format.  Packed into ...

1763651229606.jpeg
  • 2077 Views
  • 1 replies
  • 8 kudos
Latest Reply
venkat-raghavan
New Contributor III
  • 8 kudos

These are great events. I had the opportunity to attend the Toronto event. 

  • 8 kudos
Yogesh_Verma_
by Contributor II
  • 2151 Views
  • 1 replies
  • 2 kudos

Databricks Architecture Center

 Databricks Architecture Center — Your Blueprint for Building Modern Data & AI PlatformsThe Databricks Architecture Center is a centralized knowledge hub that provides:End-to-end reference architecturesIndustry-specific patternsArchitecture decision ...

Yogesh_Verma__0-1763628453509.png
  • 2151 Views
  • 1 replies
  • 2 kudos
Latest Reply
Raman_Unifeye
Honored Contributor III
  • 2 kudos

Its very useful. I suppose you missed to provide the link. Here is the link for easy accesshttps://www.databricks.com/resources/architectures 

  • 2 kudos
Rohan_Samariya
by Databricks Partner
  • 3793 Views
  • 1 replies
  • 2 kudos

Resolved! Building an End-to-End ETL Pipeline with Data from S3 in Databricks

Hey everyone I’m excited to share the progress of my Databricks learning journey! Recently, I worked on building an end-to-end ETL pipeline in Databricks, starting from data extraction from AWS S3 to creating a dynamic dashboard for insights.Here’s h...

  • 3793 Views
  • 1 replies
  • 2 kudos
Latest Reply
bianca_unifeye
Databricks MVP
  • 2 kudos

@Rohan_Samariya  this is fantastic work! I’m genuinely impressed with how you’ve taken the Databricks stack end-to-end: S3 ingestion → PySpark transformations → Delta optimisation → interactive SQL dashboards. This is exactly the type of hands-on, fu...

  • 2 kudos
alcole
by New Contributor II
  • 1492 Views
  • 2 replies
  • 5 kudos

Databricks Release Hub

I launched a new app this week to help keep track of Databricks releases.you can view and filter the latest releases in the timeline view, or go to the resources page and go to a product area and see the latest releases alongside useful links for blo...

  • 1492 Views
  • 2 replies
  • 5 kudos
Latest Reply
Raman_Unifeye
Honored Contributor III
  • 5 kudos

@alcole - thanks for sharing it. I already bookmarked it last week when saw it on social.

  • 5 kudos
1 More Replies
hasnat_unifeye
by Databricks Partner
  • 1710 Views
  • 1 replies
  • 4 kudos

Hackathon Project: Recipe Recommendation Engine with Traditional ML + Genie on Databricks Free Edit

Hi everyone, For the Databricks Free Edition Hackathon, I wanted to show that traditional ML still has a big role today, and how it can work hand-in-hand with Databricks’ newer AI tooling. As a concrete use case, I created a recipe recommendation eng...

  • 1710 Views
  • 1 replies
  • 4 kudos
Latest Reply
Raman_Unifeye
Honored Contributor III
  • 4 kudos

This is amazing @hasnat_unifeye. Well done and good luck for the hackathon.

  • 4 kudos
rathorer
by Databricks Partner
  • 11405 Views
  • 5 replies
  • 8 kudos

API Consumption on Databricks

In this blog, I will be talking about the building the architecture to serve the API consumption on Databricks Platform. I will be using Lakebase approach for this. It will be useful for this kind of API requirement.API Requirement: Performance:Curre...

rathorer_0-1759990971452.png rathorer_0-1760078458113.png rathorer_1-1760078513459.png
  • 11405 Views
  • 5 replies
  • 8 kudos
Latest Reply
Brahmareddy
Esteemed Contributor II
  • 8 kudos

Insightful and informative!

  • 8 kudos
4 More Replies
Labels