Get Started Resources
Explore essential resources to kickstart your journey with Databricks. Access tutorials, guides, and...
0 Posts
Activity in Resources
- 334 Views
- 4 replies
- 7 kudos
🚀 Databricks Custom Apps! 🚀
Whether you're a data scientist or a sales executive, Databricks is making it easier than ever to build, host, and share secure data applications. With our platform, you can now run any Python code on serverless compute, share it with non-technical c...
- 334 Views
- 4 replies
- 7 kudos
Latest Reply
- 7 kudos
I do consider that as a good direction - HOWEVER I had a lot of challenges while integrating with Delta Lake on low-code, no-code platforms such as PowerApps on Azure - this is why - I would love to see something like this on Databricks
- 7 kudos
- 184 Views
- 1 replies
- 0 kudos
Standardized Framework to update Databricks job definition using CI/CD
Hi Databricks support, I am looking for a standardized Databricks framework to update job definition using DevOps from non-production till it get productionized. Our current process of updating the Databricks job definition is as follows:In our sourc...
- 184 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi, I think this is what DABS is for (databricks asset bundles) and more recently pyDABS which is a pythonic method of implementing DABS.What are Databricks Asset Bundles? | Databricks on AWS
- 0 kudos
- 340 Views
- 0 replies
- 0 kudos
Submit your feedback and win a $25 gift card!
Your feedback is crucial to us and directly influences how we innovate and improve our customer experience. To share your success and feedback with Databricks, please visit this link. The first 20 people to submit a completed survey response will ...
- 340 Views
- 0 replies
- 0 kudos
- 1052 Views
- 5 replies
- 4 kudos
Library Management via Custom Compute Policies and ADF Job Triggering
This guide is intended for those looking to install libraries on a cluster using a Custom Compute Policy and trigger Databricks jobs from an Azure Data Factory (ADF) linked service. While many users rely on init scripts for library installation, it i...
- 1052 Views
- 5 replies
- 4 kudos
Latest Reply
- 4 kudos
Thanks, @SashankKotta for pointing this out. I was able to resolve the instance pool ID issue but spot_bid_max_price is still failing I am getting the following error Cluster validation error: Validation failed for azure_attributes.spot_bid_max_pric...
- 4 kudos
- 535 Views
- 1 replies
- 2 kudos
🚀 Boost Your Data Pipelines with Dynamic, Data-Driven Databricks Workflows (For Each Task)! 💡
Unlock the power of the For Each task in Databricks to seamlessly iterate over collections—whether it's a list of table names or any value—and dynamically run tasks with specific parameter values. This powerful feature lets you automate repetitive pr...
- 535 Views
- 1 replies
- 2 kudos
Latest Reply
- 2 kudos
Thanks for sharing @Ajay-Pandey
- 2 kudos
- 241 Views
- 0 replies
- 2 kudos
Onboarding your new Databricks AI/BI Genie
The integration of AI and BI into the modern data stack has been a game-changer for businesses seeking to leverage data-driven insights. Databricks, a leader in this innovative frontier, has introduced the AI/BI Genie, a tool designed to democratize ...
- 241 Views
- 0 replies
- 2 kudos
- 1201 Views
- 0 replies
- 2 kudos
Upskill on Databricks in just an hour
Explore data and AI in 4 short videos In just one hour, you can get the free training you need to start using AI throughout your data processes. Find out how the Databricks Data Intelligence Platform democratizes data and AI for everyone in your orga...
- 1201 Views
- 0 replies
- 2 kudos
- 231 Views
- 0 replies
- 2 kudos
Databricks August Update
August 2024 | Databricks on AWS
- 231 Views
- 0 replies
- 2 kudos
- 216 Views
- 0 replies
- 2 kudos
Code patterns / best practices in SparkSQL, pyspark and Scala
Hi all,I am looking for collections of Code patterns for:SparkSQLpySparkScalaI'm sure there are at least a few repos in Github with snippets and will share them as I find them in this thread. If you come across any good collections, please post your...
- 216 Views
- 0 replies
- 2 kudos
- 1224 Views
- 0 replies
- 4 kudos
Supernovas, Black Holes and Streaming Data
A Journey in Space With Apache Kafka and the Databricks Data Intelligence Platform This blog post is a follow-up to the session From Supernovas to LLMs at Data + AI Summit 2024, where I demonstrated how anyone can consume and process publicly availab...
- 1224 Views
- 0 replies
- 4 kudos
- 290 Views
- 0 replies
- 0 kudos
State of Data + AI | Databricks
Data intelligence and the race to customize LLMs With AI dominating conversations everywhere, technical practitioners and executives are seeking answers: How are leading companies succeeding with GenAI? How does my ML strategy and execution compare t...
- 290 Views
- 0 replies
- 0 kudos
- 426 Views
- 0 replies
- 4 kudos
Announcing the Generative AI World Cup 2024: A Global Hackathon by Databricks
Welcome to the Generative AI World Cup 2024, a global hackathon inviting participants to develop innovative Generative AI applications that solve real-world problems. Participants will compete for a pool of over 50,000 USD in total cash prizes, troph...
- 426 Views
- 0 replies
- 4 kudos
- 190 Views
- 0 replies
- 2 kudos
Cross-filtering for AI/BI dashboards
AI/BI dashboards now support cross-filtering, which allows you to click on an element in one chart to filter and update related data in other charts.Cross-filtering allows users to interactively explore relationships and patterns across multiple visu...
- 190 Views
- 0 replies
- 2 kudos
- 140 Views
- 0 replies
- 2 kudos
SHOW CREATE TABLE for materialized views and streaming tables
Added support for SHOW CREATE TABLE for materialized views and streaming tables. This will show the complete CREATE command used at creation time, including properties and schedulesCatalog Explorer "Overview" tab now shows the full CREATE command for...
- 140 Views
- 0 replies
- 2 kudos
- 260 Views
- 0 replies
- 1 kudos
My Journey with Schema Management in Databricks
When I first started handling schema management in Databricks, I realized that a little bit of planning could save me a lot of headaches down the road. Here’s what I’ve learned and some simple tips that helped me manage schema changes effectively. On...
- 260 Views
- 0 replies
- 1 kudos
