- 1532 Views
- 3 replies
- 1 kudos
runtime CI/CD
Not only is code CI/CD possible, but runtime CI/CD is now possible thanks to #databricks docker. more about it: https://databrickster.medium.com/databricks-docker-from-runtime-ci-cd-to-compliance-1479cf6cdf8d https://www.sunnydata.ai/blog/databricks-...
- 1532 Views
- 3 replies
- 1 kudos
- 1 kudos
Why would we want to use docker?Wouldn't that just add unnecessary complexity?
- 1 kudos
- 341 Views
- 0 replies
- 0 kudos
not everything is in the cloud
It’s great to see that we have ZeroBus, which can push events from on-premise to the cloud. Now it’s joined by on-premises OpenSharing. This is optimal for organizations that can’t move everything to the cloud or simply don’t want to. #databricks htt...
- 341 Views
- 0 replies
- 0 kudos
- 348 Views
- 0 replies
- 0 kudos
A wave of new Lakeflow Connect connectors
There are so many new connectors that I stopped counting them and mentioned it in the news. Every week, there is something new. If you just need to ingest data into Databricks from a cloud source, always check the release page, as not everything is e...
- 348 Views
- 0 replies
- 0 kudos
- 921 Views
- 0 replies
- 0 kudos
Resilience, cross-region, and cross-cloud
None of the new features matters if your platform goes down when a region or cloud has an outage. Cross-region and cross-cloud recovery is non-negotiable. This is key for any platform hosting applications, as it enables the components mentioned above...
- 921 Views
- 0 replies
- 0 kudos
- 546 Views
- 0 replies
- 0 kudos
Reverse ETL
As the Lakehouse becomes your primary data and application platform and everything is consolidated there, you will occasionally need to push that data outwards. For example, to run a marketing campaign in Google Ads. #databricks #DataAISummit https:/...
- 546 Views
- 0 replies
- 0 kudos
- 1494 Views
- 0 replies
- 2 kudos
Ontology
Once you have that single platform holding all your company data, you need a knowledge graph, ideally created automatically, to build a context layer on top of it. Genie Ontology. #databricks #DataAISummit https://databrickster.medium.com/my-favorite...
- 1494 Views
- 0 replies
- 2 kudos
- 355 Views
- 0 replies
- 0 kudos
Databricks AI Search
Heads up! Databricks AI Search has replaced Vector Search. The rebranding reflects a shift in focus from embeddings to a more flexible and versatile search solution that supports hybrid keyword-similarity search and full-text keyword search. This cha...
- 355 Views
- 0 replies
- 0 kudos
- 412 Views
- 0 replies
- 0 kudos
Customer data lake
Once your apps are hosted in Databricks, you need one more element... Customer data lake If you need to run campaigns and maintain master records, a customer data lake becomes essential as it allows you to build your own solution (the premise: SaaS i...
- 412 Views
- 0 replies
- 0 kudos
- 814 Views
- 0 replies
- 2 kudos
Databricks Visual Data Prep with Star Schema Data Modelling Technique
In this video, you'll learn how to use Databricks Visual Data Prep to clean, transform, and enrich data using a no-code, AI-assisted visual interface for building production-ready data pipelines. Whether you're a data engineer, data analyst, or just...
- 814 Views
- 0 replies
- 2 kudos
- 1281 Views
- 0 replies
- 2 kudos
Databricks goes full-stack
Fast reads and fast writes, thanks to Lakebase, including writes to open formats. It creates a unified platform both for analytics and operational use cases. #databricks #DataAISummit https://databrickster.medium.com/my-favorite-announcements-from-th...
- 1281 Views
- 0 replies
- 2 kudos
- 498 Views
- 0 replies
- 1 kudos
Why Every Databricks Data Engineer Should Audit Their Query History
As data engineering teams scale out lakehouses and cloud data warehouses, a silent platform killer inevitably creeps in: runaway query costs.In a distributed environment like Databricks, a single unoptimized query whether it’s an accidental Cartesian...
- 498 Views
- 0 replies
- 1 kudos
- 357 Views
- 0 replies
- 1 kudos
Databricks Genie Code Gets a Full Page Command Centre
As someone who spends hours every day building notebooks, debugging pipelines, and experimenting with AI agents in Databricks, there was always one thought in the back of my mind.“Why can’t Genie Code have a full-screen workspace where I can manage e...
- 357 Views
- 0 replies
- 1 kudos
- 1265 Views
- 2 replies
- 3 kudos
Catalog Managed Tables
Managed Tables, External Tables, Foreign Tables and... .. Catalog Managed Tables. If you are databricks user, you need to know why they are the best of all! https://databrickster.medium.com/catalog-commits-make-your-managed-delta-layer-safer-and-more...
- 1265 Views
- 2 replies
- 3 kudos
- 3 kudos
This is included with the Databricks managed table; there is no separate catalog managed table.
- 3 kudos
- 4711 Views
- 0 replies
- 1 kudos
Databricks Introduces Omnigent: A New Meta-Harness for Building and Managing AI Agents
The rapid evolution of AI agents has transformed how organizations automate tasks, generate insights, and accelerate software development. However, as teams adopt multiple AI models, frameworks, and agent orchestration tools, managing these systems e...
- 4711 Views
- 0 replies
- 1 kudos
- 940 Views
- 0 replies
- 0 kudos
Why Databricks Catalog Commits is a Game-Changer for Lakehouse Governance and Transactions
As organizations continue to scale their data platforms, managing consistency, governance, and transactional integrity across multiple datasets has become increasingly challenging. While Delta Lake has long provided robust ACID transactions at the ta...
- 940 Views
- 0 replies
- 0 kudos
