- 317 Views
- 7 replies
- 11 kudos
(Episode 1: Getting Data In) - Learning Databricks one brick at a time, using the Free Edition
Episode 1: Getting Data InLearning Databricks one brick at a time, using the Free Edition.Project IntroWelcome to everyone reading. My name’s Ben, a.k.a BS_THE_ANALYST, and I’m going to share my experiences as I learn the world of Databricks. My obje...
- 317 Views
- 7 replies
- 11 kudos
- 11 kudos
Awesome post! I love your step by step, friendly approach. Great work!
- 11 kudos
- 4004 Views
- 4 replies
- 6 kudos
From Pilots to Production: Unlocking Enterprise AI Agents with Agent Bricks
Many enterprises today launch AI agents with high hopes but more often than not, those pilots never reach production. The culprit? Complexity, poor evaluations, ballooning costs, and governance gaps.Why do so many AI agent pilots never make it to pro...
- 4004 Views
- 4 replies
- 6 kudos
- 6 kudos
Agent Bricks looks solid for scaling AI, and I’ve seen platforms like Agentra.io also tackle the enterprise workflow side of this challenge.
- 6 kudos
- 9238 Views
- 4 replies
- 1 kudos
Databricks Academy Labs Coupon Instructions
To see all Databricks training and enablement offerings, please visit our Learning Library and Certifications Catalog. To use your Databricks Academy Labs coupons, please - Head to Databricks Academy Across the top navigation, select Subscriptions C...
- 9238 Views
- 4 replies
- 1 kudos
- 1 kudos
is this coupon still valid, not able to use it ?
- 1 kudos
- 204 Views
- 1 replies
- 4 kudos
Accelerating Data Migration and Data Engineering with AI: The Future of Databricks Adoption
In today’s fast-evolving digital landscape, organizations are under immense pressure to modernize their data infrastructure for better scalability, agility, and advanced analytics. One of the most powerful shifts in recent times has been the migratio...
- 204 Views
- 1 replies
- 4 kudos
- 4 kudos
Great summary, @JatinArora! Clear and highlights the tangible benefits perfectly.
- 4 kudos
- 105 Views
- 0 replies
- 0 kudos
9 Powerful 🚀 Spark Optimization Techniques in Databricks (With Real Examples)
IntroductionOne of our ETL pipelines used to take 10 hours to complete. After tuning and scaling in Databricks, it finished in just about 1 hour — a 90% reduction in runtime.That’s the power of Spark tuning.Databricks, built on Apache Spark, is a po...
- 105 Views
- 0 replies
- 0 kudos
- 10740 Views
- 13 replies
- 31 kudos
Zero to Hero - Data Analysis Certification
Hey everyone, Today I passed my Data Analyst Associate exam! 拾I'd like to say thanks to the Databricks community. The questions that people ask and interactions I've been a part of have been invaluable. Starting tomorrow, I'll be moving onto my data ...
- 10740 Views
- 13 replies
- 31 kudos
- 31 kudos
Thanks @BS_THE_ANALYST !Hoping to pick up Databricks blogging again - I love sharing my knowledge with the wider Community.
- 31 kudos
- 233 Views
- 2 replies
- 4 kudos
What Does “Full Stack Development” Mean in the World of Databricks
Hi All, Many teams using Databricks today are referring to their work as “full stack development,” which can be a bit confusing at first. In the Databricks context, this doesn't mean a new framework — it simply means handling everything from raw data...
- 233 Views
- 2 replies
- 4 kudos
- 4 kudos
Absolutely agree — what’s called “full stack” in Databricks truly means managing the complete data lifecycle on a unified platform,. Teams today aren’t just doing ETL; they’re orchestrating everything from real-time ingestion (Autoloader), scalable s...
- 4 kudos
- 195 Views
- 1 replies
- 3 kudos
corrupted delta logs
ERROR: DeltaVersionsNotContiguousException: Versions (0, 2) are not contiguous. This can happen when files have been manually removed from the Delta log. Please contact Databricks support to repair the table.Cause of the error: You are getting this e...
- 195 Views
- 1 replies
- 3 kudos
- 2013 Views
- 4 replies
- 2 kudos
Demo Deploy a Databricks Asset Bundle with Azure DevOps Pipelines
I recently wrote a blog post showing how to deploy a minimal Databricks job with notebook task using Databricks Asset Bundles and Azure DevOps pipelines. The code is available in my public GitHub repo. Thought I'd share it here!ObjectivesIn this post...
- 2013 Views
- 4 replies
- 2 kudos
- 2 kudos
HiGreat article.2 questionsHow does the deploy bundle script in the pipleine know where to pick up the bundel. Should there be a path. Mine is on my local machine becaust that where I first run it from the cli. Also can a bundle deploy resources that...
- 2 kudos
- 2395 Views
- 1 replies
- 1 kudos
Installing CrowdStrike Falcon Sensor on Databricks Workers
Greetings,Does anyone here have experience deploying the CrowdStrike Falcon sensor on Databricks worker instances? For context, the cluster is deployed in AWS and we use a Databricks Ubuntu 20.04 AMI. Databricks allows adding a bootstrap/startup scri...
- 2395 Views
- 1 replies
- 1 kudos
- 2260 Views
- 6 replies
- 1 kudos
Databricks App Availability
Hi there,I recently came across this post about databricks apps that says it available for public previewhttps://www.databricks.com/blog/introducing-databricks-appsHowever, when I go to previews in the workspace, I don't see an option to enable it, i...
- 2260 Views
- 6 replies
- 1 kudos
- 1 kudos
Yea same...I got the same warning "Requested region australiasoutheast in cloud azure is not supported."Has there been any further updates?
- 1 kudos
- 380 Views
- 3 replies
- 1 kudos
Databricks Apps Crashes Unexpectedly Without Showing any Logs
Hi All,I coded up a Databricks app using fastapi which seems to be crashing on deployment. Databricks throws the error that "app crashed at startup" but the logging page is empty. So I do not know what went wrong. Any ideas on how to debug the proble...
- 380 Views
- 3 replies
- 1 kudos
- 1 kudos
I want to update that I have been able to solve the problem and get the app running. The problem was related to trying to import from anoter folder instead of downloading the package using its wheel file. Just for the record, had already tried the l...
- 1 kudos
- 2087 Views
- 1 replies
- 6 kudos
Connecting VS Code and GitHub Copilot to the Databricks Managed MCP Server
Recently, Databricks released a preview version of the Managed MCP Server. Upon seeing this, I immediately wanted to integrate Databricks Genie with VS Code and GitHub Copilot agent mode. Below, I will briefly share the setup process:Step 1: Prepare ...
- 2087 Views
- 1 replies
- 6 kudos
- 6 kudos
Thanks for the example this is something I am looking for
- 6 kudos
- 314 Views
- 2 replies
- 3 kudos
Getting Started with Notebooks in Databricks
Databricks notebooks are a powerful tool for data scientists and engineers to collaborate, explore data, and build machine learning models. This guide will help you get started with creating and using notebooks in Databricks.Why Use Databricks Notebo...
- 314 Views
- 2 replies
- 3 kudos
- 3 kudos
Thanks for sharing @bhanu_gautam. This will surely help beginners get started with Databricks Notebooks.
- 3 kudos
- 503 Views
- 4 replies
- 4 kudos
Resolved! Unity Catalog Migration Strategy
Zero-Downtime Unity Catalog Migration for 500TB Data LakeJust completed migrating 500TB to Unity Catalog without a single minute of downtime. Here's how:The Challenge500 TB across 12,000 tables200+ concurrent usersZero tolerance for downtimeMixed Hiv...
- 503 Views
- 4 replies
- 4 kudos
- 4 kudos
Thanks, @Khaja_Zaffer and @BS_THE_ANALYST!@Khaja_Zaffer:The toolkit has 5 main components:Pre-migration analyzer Compatibility scoringDrift monitor Real time consistency checksPermission migrator: Automated ACL copyingQuery rewriter: Hive→UC SQL con...
- 4 kudos
Join Us as a Local Community Builder!
Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!
Sign Up Now-
Access Data
1 -
ADF Linked Service
1 -
ADF Pipeline
1 -
Advanced Data Engineering
3 -
AI Agents
1 -
AI Readiness
1 -
ApacheSpark
1 -
Associate Certification
1 -
Automation
1 -
AWS
1 -
AWSDatabricksCluster
1 -
Azure
1 -
Azure databricks
3 -
Azure devops integration
1 -
AzureDatabricks
2 -
Big data
1 -
Caching
2 -
CICDForDatabricksWorkflows
1 -
Cluster
1 -
Cluster Policies
1 -
Cluster Pools
1 -
Cost Optimization Effort
1 -
custom compute policy
1 -
CustomLibrary
1 -
Data
1 -
Data Analysis with Databricks
1 -
Data Engineering
3 -
Data Governance
1 -
Data Mesh
1 -
Data Processing
1 -
Databricks Assistant
1 -
Databricks Community
1 -
Databricks Delta Table
1 -
Databricks Demo Center
1 -
Databricks Job
1 -
Databricks Migration
2 -
Databricks Mlflow
1 -
Databricks Notebooks
1 -
Databricks Support
1 -
Databricks Unity Catalog
2 -
Databricks Workflows
1 -
DatabricksML
1 -
DBR Versions
1 -
Declartive Pipelines
1 -
DeepLearning
1 -
Delta Lake
5 -
Delta Live Table
1 -
Delta Live Tables
1 -
Delta Time Travel
1 -
Devops
1 -
DimensionTables
1 -
DLT
2 -
DLT Pipelines
3 -
DLT-Meta
1 -
Dns
1 -
Dynamic
1 -
Free Databricks
2 -
GenAI agent
1 -
GenAI and LLMs
2 -
Generative AI
1 -
Genie
1 -
Governance
1 -
Hive metastore
1 -
Lakeflow Pipelines
1 -
Lakehouse
1 -
Lakehouse Migration
1 -
Lazy Evaluation
1 -
Learning
1 -
Library Installation
1 -
Llama
1 -
Medallion Architecture
1 -
Migrations
1 -
MSExcel
1 -
Multiagent
1 -
Networking
2 -
Performance
1 -
Performance Tuning
1 -
Private Link
1 -
Pyspark Code
1 -
Pyspark Databricks
1 -
Pytest
1 -
Python
1 -
Scala Code
1 -
SDK
1 -
Serverless
2 -
Spark
6 -
Spark Caching
1 -
SparkSQL
1 -
SQL Serverless
1 -
Support Ticket
1 -
Sync
1 -
Tutorial
1 -
Unit Test
1 -
Unity Catalog
4 -
Unity Catlog
1 -
Warehousing
1 -
Workflow Jobs
1 -
Workflows
3
- « Previous
- Next »
User | Count |
---|---|
43 | |
42 | |
34 | |
23 | |
22 |