- 1938 Views
- 2 replies
- 5 kudos
Databricks Release Hub
I launched a new app this week to help keep track of Databricks releases.you can view and filter the latest releases in the timeline view, or go to the resources page and go to a product area and see the latest releases alongside useful links for blo...
- 1938 Views
- 2 replies
- 5 kudos
- 5 kudos
@alcole - thanks for sharing it. I already bookmarked it last week when saw it on social.
- 5 kudos
- 2100 Views
- 1 replies
- 4 kudos
Hackathon Project: Recipe Recommendation Engine with Traditional ML + Genie on Databricks Free Edit
Hi everyone, For the Databricks Free Edition Hackathon, I wanted to show that traditional ML still has a big role today, and how it can work hand-in-hand with Databricks’ newer AI tooling. As a concrete use case, I created a recipe recommendation eng...
- 2100 Views
- 1 replies
- 4 kudos
- 4 kudos
This is amazing @hasnat_unifeye. Well done and good luck for the hackathon.
- 4 kudos
- 12589 Views
- 5 replies
- 8 kudos
API Consumption on Databricks
In this blog, I will be talking about the building the architecture to serve the API consumption on Databricks Platform. I will be using Lakebase approach for this. It will be useful for this kind of API requirement.API Requirement: Performance:Curre...
- 12589 Views
- 5 replies
- 8 kudos
- 2652 Views
- 2 replies
- 2 kudos
Resolved! My First Month Learning Databricks - Key Takeaways So Far.
Hey everyone I recently started my Databricks learning journey about a month ago, and I wanted to share what I’ve learned so far from one beginner to another.Here are a few highlights:1️⃣ Understanding the Lakehouse Concept - Realized how Databricks ...
- 2652 Views
- 2 replies
- 2 kudos
- 2 kudos
I was planning to build an ETL pipeline, but I hadn’t considered using MLflow to predict sales and ratings. Thanks for the suggestion, I’ll work on creating this demo soon to test and enhance my skills.
- 2 kudos
- 1753 Views
- 2 replies
- 5 kudos
I Tried Teaching Databricks About Itself — Here’s What Happened
Hi All, How are you doing today?I wanted to share something interesting from my recent Databricks work — I’ve been playing around with an idea I call “Real-Time Metadata Intelligence.” Most of us focus on optimizing data pipelines, query performance,...
- 1753 Views
- 2 replies
- 5 kudos
- 5 kudos
I like the core idea. You are mining signals the platform already emits.I would start rules first, track small files ratio and average file size trend, watch skew per partition and shuffle bytes per input gigabyte. Compare job time to input size to c...
- 5 kudos
- 425 Views
- 0 replies
- 1 kudos
Last chance to register for our LIVE Lakebase BrickTalks session!
Join us tomorrow, Thursday, Nov 13 at 9 am PT for the latest BrickTalks! We'll talk about bringing data intelligence from your Lakehouse into every app. Register now. What you’ll learn: Use Lakebase (PostgreSQL-compatible, serverless OLTP) to serve...
- 425 Views
- 0 replies
- 1 kudos
- 1069 Views
- 0 replies
- 1 kudos
How Upgrading to Databricks Runtime 16.4 sped up our Python script by 10x
Wanted to share something that might save others time and money. We had a complex Databricks script that ran over 1.5 hours, when the target was under 20 minutes. Initially tried scaling up the cluster, but real progress came from simply upgrading th...
- 1069 Views
- 0 replies
- 1 kudos
- 2138 Views
- 0 replies
- 1 kudos
Control Databricks Costs with AI & BI Dashboards - Video Summary
In this video, I try to showcase in a very simplified way how to enable and setup AI & BI dashboards to control costs and take actions. I hope this could be useful. I think it is a superb feature to get insights on costs while straightforward to setu...
- 2138 Views
- 0 replies
- 1 kudos
- 4671 Views
- 2 replies
- 10 kudos
Optimizing Delta Table Writes for Massive Datasets in Databricks
Problem StatementIn one of my recent projects, I faced a significant challenge: Writing a huge dataset of 11,582,763,212 rows and 2,068 columns to a Databricks managed Delta table.The initial write operation took 22.4 hours using the following setup:...
- 4671 Views
- 2 replies
- 10 kudos
- 10 kudos
Hey @Louis_Frolio ,Thank you for the thoughtful feedback and great suggestions!A few clarifications:AQE is already enabled in my setup, and it definitely helped reduce shuffle overhead during the write.Regarding Column Pruning, in this case, the fina...
- 10 kudos
- 1548 Views
- 0 replies
- 2 kudos
Another BrickTalks! Let's talk about bringing data intelligence from your Lakehouse into every app!
You asked, we delivered! Another BrickTalk is scheduled for Thursday, Nov 13 @ 9 AM PT with Pranav Aurora on how to bring data intelligence from your Lakehouse into every app and user, seamlessly and in real time. What you’ll learn: Use Lakebase (Po...
- 1548 Views
- 0 replies
- 2 kudos
- 1641 Views
- 3 replies
- 11 kudos
Community Fellows: Shout Out to our Bricksters!
At Databricks, our Community members deserve to get a great experience in our forums, with quality answers from the experts. Who better to help out our customers than Databricks employees aka Bricksters! To work towards this goal, we created the Comm...
- 1641 Views
- 3 replies
- 11 kudos
- 11 kudos
Kudos to the DB team for keeping up with the community, but can you please work on your product as well?We are experiencing a lot of issues with your paid product: failures, crashes, slow starts and slow performance and the list goes on. Community wo...
- 11 kudos
- 1211 Views
- 1 replies
- 1 kudos
Cómo crear clusters en Databricks paso a paso | All-Purpose, Jobs Compute, SQL Warehouses y Pools
Recently having some fun with Databricks, I created a series of videos in Spanish that I'd like to share here. I hope some of them could be interesting for Spanish or LATAM community Not sure if this is the most proper board to share or there is ano...
- 1211 Views
- 1 replies
- 1 kudos
- 1 kudos
Añadido nuevo vídeo para crear clusters de tipo serverless para notebooks, jobs y DLTs https://youtu.be/RQvkssryjyQ?si=BkYI831mUK1vBE20
- 1 kudos
- 9507 Views
- 17 replies
- 29 kudos
(Episode 1: Getting Data In) - Learning Databricks one brick at a time, using the Free Edition
Episode 1: Getting Data InLearning Databricks one brick at a time, using the Free Edition.Project IntroWelcome to everyone reading. My name’s Ben, a.k.a BS_THE_ANALYST, and I’m going to share my experiences as I learn the world of Databricks. My obje...
- 9507 Views
- 17 replies
- 29 kudos
- 29 kudos
Really interesting post @BS_THE_ANALYST Caching up with Databricks stuff again
- 29 kudos
- 1260 Views
- 0 replies
- 1 kudos
SQL Scripting in Apache Spark™ 4.0
The Apache Spark™ 4.0 introduces a new feature for SQL developers and data engineers: SQL Scripting. As such, this feature enhances the power and extends the flexibility of Spark SQL, enabling users to write procedural code within SQL queries, with t...
- 1260 Views
- 0 replies
- 1 kudos
- 5532 Views
- 6 replies
- 15 kudos
(Episode 3: Hands-on API Project) - Learning Databricks one brick at a time, using the Free Edition
Episode 3: APIsLearning Databricks one brick at a time, using the Free Edition.Project IntroWelcome to everyone reading. My name’s Ben, a.k.a BS_THE_ANALYST, and I’m going to share my experiences as I learn the world of Databricks. My objective is to...
- 5532 Views
- 6 replies
- 15 kudos
- 15 kudos
This is great, thanks for sharing Ben, will share with my data community.
- 15 kudos
-
Access Data
1 -
Access Delta Tables
1 -
ADB
1 -
ADF Linked Service
1 -
ADF Pipeline
1 -
Advanced Data Engineering
7 -
Agent Architecture
2 -
Agent Bricks
2 -
Agent Skills
2 -
Agentic AI
8 -
agents
1 -
AI
5 -
AI Agents
12 -
AI BI Dashboards
1 -
ai gateway
2 -
AI Governance
1 -
AI Readiness
1 -
ai_query
1 -
AIAgents
1 -
AIBI
3 -
AIGovernance
1 -
Alerts
1 -
Analytics
2 -
Analytics Engineering
1 -
Apache Iceberg
2 -
Apache spark
3 -
Apache Spark 3.0
2 -
ApacheSpark
1 -
Aqe
1 -
Architecture
7 -
asset bundle
1 -
Asset Bundles
4 -
Associate Certification
2 -
Audit
1 -
Audit Logs
1 -
AUTO CDC
1 -
Auto-loader
1 -
Autoloader
1 -
Automation
3 -
Automl
1 -
AutoML Experiment
1 -
AWS
1 -
AWSDatabricksCluster
2 -
Azure
5 -
Azure databricks
6 -
Azure Databricks Delta Table
3 -
Azure Databricks Job
2 -
Azure Delta Lake
4 -
Azure devops integration
2 -
Azure Unity Catalog
3 -
AzureDatabricks
2 -
Banking
1 -
best practices
3 -
BI Integrations
1 -
Big data
1 -
Billing and Cost Management
2 -
Blog
1 -
BroadcastJoin
1 -
Bronze Layer
1 -
Bronze Table
1 -
Build a Databricks App on Free Edition with a Genie Agent at its core.
1 -
Caching
2 -
Cash Flow
1 -
CDC
5 -
CDF
1 -
Certification
1 -
Certification Badge
1 -
Certification Exam
1 -
Change data capture
1 -
CICD
5 -
CICDForDatabricksWorkflows
2 -
Cluster
1 -
Cluster Policies
1 -
Cluster Pools
1 -
Collect
1 -
Community Champion
1 -
Community Contest
1 -
Community Event
1 -
CommunityArticle
3 -
Concurrency
1 -
Cost Optimization Effort
2 -
CostOptimization
3 -
Creative Thinking
1 -
Credential Vending
1 -
Credit Risk
1 -
custom compute policy
1 -
Customer Record
1 -
CustomLibrary
1 -
DABs
3 -
DAIS 0206
3 -
DAIS 2026
2 -
Dashboards
2 -
Data
1 -
Data Agents
1 -
Data Analysis with Databricks
1 -
Data Architecture
2 -
Data Driven AI Roadmap
1 -
Data Engineering
29 -
Data Governance
10 -
Data Ingestion
2 -
Data Ingestion & connectivity
1 -
data layout
1 -
Data Mesh
1 -
data optimization
1 -
Data Processing
1 -
Data Quality
7 -
Data Quality Checks
2 -
Data warehouse
1 -
Data Warehousing
1 -
Databricks
6 -
Databricks App
2 -
Databricks Apps
16 -
Databricks Assistant
2 -
Databricks Blog
1 -
Databricks Certified
1 -
Databricks Clusters
1 -
Databricks Community
1 -
Databricks Dashboard
2 -
Databricks Delta Table
3 -
Databricks Demo Center
1 -
Databricks Free Edition
2 -
Databricks genAI associate
1 -
databricks genie
4 -
Databricks Job
2 -
Databricks Lakeflow
4 -
Databricks Lakehouse
4 -
Databricks Migration
4 -
Databricks Mlflow
1 -
Databricks News
1 -
Databricks Notebooks
1 -
Databricks Partner
1 -
Databricks Platform
1 -
Databricks Pyspark
3 -
Databricks Serverless
4 -
Databricks SQL
3 -
Databricks Support
1 -
Databricks Training
1 -
Databricks Unity Catalog
4 -
Databricks Workflows
3 -
DatabricksAutomation
2 -
DatabricksML
1 -
DatabricksOptimization
2 -
DataEngineering
2 -
DataGovernance
1 -
DateChange
1 -
DBR Versions
1 -
Dbt
1 -
Declartive Pipelines
2 -
DeepLearning
1 -
Deletion Vectors
1 -
Delta Lake
25 -
Delta Lake Files
1 -
Delta Live Table
4 -
Delta Live Tables
1 -
Delta Tables
1 -
Delta Time Travel
1 -
Delta-lake
1 -
DeltaLake
2 -
Developer
1 -
Development
1 -
DevOps
2 -
DimensionTables
1 -
DLT
3 -
DLT Pipeline
2 -
DLT Pipelines
3 -
DLT-Meta
1 -
Dns
1 -
DQX
3 -
Drift
1 -
Dynamic
1 -
Dynamic Partition
1 -
Engineering With Databricks
1 -
ETL
1 -
ETL Pipelines
2 -
fastapi
1 -
Feature Store
1 -
Financial Services
1 -
Fine Grained Access
1 -
FinOps
1 -
Forecasting
1 -
Fraud Detection
1 -
Free Databricks
3 -
Free Edition
1 -
GenAI
3 -
GenAI agent
2 -
GenAI and LLMs
5 -
GenAIGeneration AI
2 -
Generation AI
1 -
Generative AI
12 -
Generative AI Engineer
1 -
genie
18 -
Genie Agent
2 -
Genie Agents
12 -
Genie Code
1 -
Genie Ontology
1 -
Genie-Powered App Challenge - 2026
3 -
GenieCode
1 -
GenieOntology
2 -
Git
1 -
Github
1 -
Github actions
1 -
Gold Layer
1 -
GoldLayer
1 -
Google Bigquery
1 -
Google cloud
1 -
Governance
4 -
Governed Tag
1 -
Graph
1 -
Graphframes
1 -
hackathon
2 -
Hive metastore
1 -
Hubert Dudek
42 -
Hybrid Lakehouse
1 -
Incremental Load
1 -
infrastructure as code
1 -
Ingestion
1 -
Insurance · Reinsurance · Banking · Telecom · Retail · Agriculture — Per-Object API Calls to Per-Cell Scoring with H3 and Native Spatial SQL
1 -
Interoperability
1 -
IoT
1 -
Kafka streaming
3 -
Keyvault
1 -
Lakebase
6 -
Lakeflow
4 -
Lakeflow Declarative Pipelines
2 -
Lakeflow Pipelines
3 -
LakeflowDesigner
2 -
LakeflowJobs
1 -
Lakehouse
5 -
Lakehouse federation
1 -
Lakehouse Migration
2 -
Langchain
1 -
LangGraph
2 -
Lazy Evaluation
1 -
Learning
2 -
Library Installation
1 -
LightGBM
1 -
Lineage
2 -
Liquid Clustering
1 -
LiquidClustering
2 -
Live Tables CDC
3 -
Llama
1 -
LLM
1 -
LLM Evaluation
1 -
LLM-as-a-Judge
1 -
LLMs
1 -
Machine Learning
3 -
Materialized Views
1 -
mcp
5 -
Medallion Architecture
9 -
MERGE
2 -
MERGE Performance
3 -
Metadata
2 -
Metric Views
4 -
Migration
1 -
Migrations
1 -
ML Model
1 -
MlFlow
5 -
MLOps
1 -
Model Governance
1 -
Model Serving
2 -
mosic ai search
1 -
MSExcel
3 -
Multi-Table Transactions
1 -
Multiagent
4 -
Networking
2 -
New Features
1 -
NotMvpArticle
1 -
Ontology
1 -
Operations Analytics
2 -
Optimization
6 -
Optimize Command
1 -
Partitioning
4 -
Partner
2 -
Performance
3 -
Performance Tuning
5 -
Photon Engine
1 -
PII
1 -
Power BI
1 -
Power BI XLMA EndPoint
1 -
Powerbi
1 -
PredictiveOptimization
2 -
Private Link
1 -
Prompt Tuning
1 -
Pyspark
8 -
Pyspark Code
1 -
Pyspark Databricks
1 -
Pytest
1 -
Python
1 -
Query Plan
1 -
QueryProfile
1 -
RBAC
1 -
Reading-excel
2 -
Reliability
1 -
RescuedData
1 -
Rest APIs
1 -
Retail Forecasting
1 -
Retries
1 -
Row Level Security
2 -
SAP
4 -
SAP BW
1 -
Sap Hana Driver
1 -
Scala Code
1 -
Scd Type 2
1 -
Scheduled Tasks
1 -
SchemaEvolution
1 -
Scripting
1 -
SDK
1 -
Secrets
1 -
Security
1 -
Semantic Layer
1 -
serverless
2 -
Service Principals
1 -
Small Business
1 -
SmallFiles
1 -
Smart Routing
1 -
Snowflake
1 -
Spanish
2 -
Spark
9 -
Spark Caching
1 -
Spark Internals
1 -
Spark Performance
1 -
SparkSQL
1 -
SQL
4 -
Sql Scripts
2 -
SQL Serverless
1 -
SQLPerformance
1 -
SQLWarehouse
1 -
Stream
1 -
streaming
2 -
Streaming Tables
1 -
streamlit
3 -
Structured streaming
2 -
Students
2 -
Supervisor Agent
1 -
Supply Chain
1 -
Support Ticket
1 -
Sync
1 -
SystemTables
1 -
Sytem Tags
1 -
Table Formats
1 -
Tags
1 -
terraform
1 -
Timeouts
1 -
Training
1 -
Tutorial
4 -
UCSD
1 -
Unit Test
1 -
Unit testing
1 -
Unity Catalog
36 -
Unity Cataloge
1 -
Unity Catalogue
1 -
Unity Catlog
2 -
Unity Gateway
1 -
UnityCatalog
2 -
UnityGateway
1 -
University Alliance
1 -
VACUUM Command
1 -
Variant
1 -
VisualDataPrep
1 -
Vnet Injection
1 -
Vnet peering
1 -
volumes
1 -
Warehousing
1 -
Web
1 -
Workflow Jobs
1 -
Workflows
10 -
Zerobus
4 -
Zorder
1 -
Zordering
2
- « Previous
- Next »
| User | Count |
|---|---|
| 85 | |
| 77 | |
| 73 | |
| 60 | |
| 43 |