Lakebase Articles
A structured knowledge hub for Lakebase. Find in-depth technical content, how-to guides, and referen...
A structured knowledge hub for Lakebase. Find in-depth technical content, how-to guides, and referen...
Discover curated blogs from the community and experts. Learn through practical guides, use cases, an...
Ask questions, share challenges, and connect with others working on Lakebase. From troubleshooting t...
As coding agents work in parallel, shared development databases can become a bottleneck. Lakebase database branching gives each agent or pull request an isolated Postgres environment for schema changes, testing, and preview workflows, without affecti...
Lakebase Postgres uses the Lake Transactional/Analytical Processing (LTAP) architecture to offload heavy bulk operations from primary compute to distributed engines such as Spark. This helps teams load large lakehouse datasets into Lakebase while kee...
While Lakebase supports group-based authentication, this doesn't seem to have carried over to Lakebase Data API.Here, we must assign on the individual user or service principal,Create principalSetup authenticator accessSchema- and table grantsThis me...
Hi Malthe, you're right, the Data API doesn't support group roles yet. The reason is how it authenticates. Over a normal Postgres connection you can log in as a group role (created with `databricks_create_role('<group>', 'GROUP')`). The Data API work...
Lakebase Postgres now includes built-in full-text and vector search, generally available on AWS and Azure. With lakebase_vector for approximate nearest-neighbor search and lakebase_text for BM25 search, teams can run semantic, keyword, and hybrid ret...
Workspace on GCP us-central1, Lakebase Autoscaling (Beta). The Data API returns 400 {"message":"jwk not found"} for every request.Setup follows the docs: role created with databricks_create_role('<sp-uuid>', 'SERVICE_PRINCIPAL'), GRANT "<sp-uuid>" TO...
Update: resolved. Databricks confirmed this was a bug on their side in the Data API's JWKS resolution on GCP, and it has been fixed. The same requests that were failing with jwk not found now return 200 OK, with no changes to my configuration (same s...
Hi Everyone,I’m using the Databricks Lakebase Data API and have noticed that the first API call consistently times out after approximately 8 seconds when the Lakebase compute is offline.The first request triggers the compute to start, and the compute...
Update on this post: I have raised a support case with Databricks and requested that the timeout be increased. The timeout has been increased to 20 seconds.
Hi all,Running into what looks like a platform bug with Lakebase Postgres (Public Preview) and hoping a community engineer can help, since my Databricks support case (#01009170) was closed as out of entitlement (personal account, no support contract)...
I also faced the same error as @jeremiasInetum. So I applied the steps from @Gokul_Pillai1 and status.disabled became false. After that, I navigate to branches in Lakebase. In branch overview, click on Protect button under Disable archiving.Click Se...
Lakebase Postgres separates compute from durable storage, making efficient compute-side caching essential for high-throughput, low-latency workloads. In this update, we share how larger shared buffers and huge pages help keep more hot data in DRAM, w...
TL;DR — Production agents need more than conversation history. They must survive restarts, recall decisions from earlier sessions, and work with current business data. In our Supply Chain Planner Copilot, Lakebase handles all three. The key implement...
Thanks for the great walkthrough, @AlexMiller. If inventory changes while a recommendation is waiting for approval, is it checked again when the run resumes? How do you decide whether the change warrants a revised plan and another review?
Choosing a fixed database size before you know the workload is an old pattern. Lakebase Postgres removes that sizing exercise by continuously adjusting compute to match demand, while keeping PostgreSQL running and the data safely decoupled in the sto...
I successfully deployed my app and fixed the database permission issue.The main issue was with permissions in Overview → Roles & Database. I found a separate randomly generated role/number associated with the database, and after granting it the requi...
I am using Postgre for OLTP processing for POS application.Lag is reduced a lot, however when there is updation on Postgre table, I need to sync back to delta table. There is one way from delta table sync table (read only). Any design pattern sas to ...
As @balajij8 and @srini_ve @mentioned, Lakebase CDF is the way to do it. You’ll have the change data flowing to lake house as SCD2 so you have a record of all the transactions happening in lakebase stored in your lake house. I have a LinkedIn post wr...
I've been playing with Databricks Lakebase lately and I'm impressed by some of the features that come with it. I mean, you can sync data from a Lakehouse to Lakebase (OLAP to OLTP) and vice versa using Lakebase CDF. But most importantly, I'm impresse...
Moving Beyond Manual Changes: A Guide to Shipping Lakebase Schema with Bundles Lakebase is a Databricks fully managed PostgreSQL database for online transaction processing (OLTP). Declarative Automation Bundles (formerly Databricks Asset Bundles) are...
IntroductionMotivationWhat is Databricks Lakebase?Key FeaturesWorking with Lakebase1. Prerequisites:2. Enabling Lakebase:3.Creating a Lakebase Database:4. Authentication:5. Authorisation:6. Using Lakebase data in Analytical load (No ETL):7. Sending L...
Nice writeup! This unified OLTP+OLAP approach solves a lot of headaches we deal with when data is scattered across different systems. The database branching thing caught my eye - having dev environments that work like git branches is a game changer. ...
| User | Count |
|---|---|
| 14 | |
| 11 | |
| 11 | |
| 10 | |
| 6 |