Lakebase Discussions
Ask questions, share challenges, and connect with others working on Lakebase. From troubleshooting t...
Ask questions, share challenges, and connect with others working on Lakebase. From troubleshooting t...
Discover curated blogs from the community and experts. Learn through practical guides, use cases, an...
A structured knowledge hub for Lakebase. Find in-depth technical content, how-to guides, and referen...
Developers want to write code, not provision databases. Learn how to create and deploy apps directly on the Databricks Platform. Join us on May 5-7. In this webinar, code comes first. Watch experts from Databricks and Cursor demonstrate how to get ...
Today we have an web frontend and custom API that we call from the frontend. I can see Lakebase projects support an API and SQL over REST. And we are considering whether skipping the custom API and calling the Lakebase API directly. However I see som...
Hi @Sega2, I don't there are many patterns or approaches published widely yet. In general, though, for production web apps, you may want to consider something like frontend --> thin backend --> Lakebase rather than calling Lakebase Data API directly ...
Our admin created a project for lakebase branching. My user has "Can manage" permissions. I can create branches etc, however when I run something in the SQL editor i get following error:"ERROR: permission denied for schema public (SQLSTATE 42501)CREA...
Greetings @Sega2 , I did some digging and here is what I found. Your screenshot (thanks for sharing, it was helpful) is showing a user running a Postgres CREATE TABLE statement in the Lakebase SQL Editor and hitting this error: In Lakebase, there ar...
I am playing with branches in lakebase. I have created a dev under prod, applied som changes. How do you merge/promote the dev into prod? Have not found any things in the UI?Thanks, Thomas
Hi @Sega2, I can help with this. Welcome to Lakebase branching. As the earlier reply mentioned, Lakebase branches use copy-on-write technology rather than Git-style merging, so the workflow for promoting changes is a bit different from what you might...
Lakebase Branching Meets Docker: The Migration Safety Net I Wish I Had Years Ago Before I became a Solutions Architect at Databricks, I was a backend software engineer and for a few years of my past life, I found myself BFF's with our BFF(backend-for...
Hi DB Community ,Is there any way to access/write to delta table in UC from lakebase postgres ? There's a way using "Sync Table" - but it is recommended only to read data from Sync Table . Databricks recommends against writing to sync table . Or else...
Hi @gokkul, There are a few different patterns here depending on which direction you need data to flow. Let me break them down. READING DELTA/UC DATA FROM LAKEBASE (UC to Postgres) Synced tables are the primary mechanism for this. They automatically ...
We have a VNET Injected workspace in Azure. There are multiple SQL Warehouse which are easily accessible from Private Network - both directly from VM and via VPN on client's machine. We deployed Lakebase. Inside the Workspace, connectivity is working...
Summary Lakebase operates in the Databricks Serverless compute plane, meaning it does not reside inside your injected VNET. Connection timeouts from external tools are typically caused by blocked outbound ports or missing front-end Private Link confi...
Anyone know where to see any logs related to Lakebase/Postgres? I have a Tableau Prep flow that is failing but the error is not clear and I'm trying to find out what the database is capturing.
There are multiple ways of monitoring Lakebase errors and warnings. This will let you see what Tableau is actually sending and how it behaves (e.g., repeated failing INSERT). 3. Control‑plane / audit logs for Lakebase Databricks audit logs include...
I'm developing a FastAPI middleware app (Databricks App) that connects to both a SQL Warehouse (Unity Catalog) and a Lakebase PostgreSQL instance using async SQLAlchemy. The app works perfectly when deployed to Databricks, but I'm trying to set up lo...
Summary You should be able to test your FastAPI endpoints locally. Lakebase supports direct external connections via the standard PostgreSQL wire protocol, meaning your local SQLAlchemy setup can directly query the Lakebase instance without needing t...
One of the most interesting shifts in the Databricks ecosystem is Lakebase.For years, data architectures have enforced clear boundaries:OLTP → Operational databasesOLAP → Analytical platformsETL → Bridging the gapWhile familiar, this model often crea...
Exactly. As I'm sure you are aware there is already a great "sync" from Delta -> Postgres but coming soon is gonna be a seamless way to do the opposite (Yes, even simpler than the version of this that was in private preview). If I had a moving visual...
Hello Databricks Support Team,we would like to understand whether it is possible to disable specific Databricks product capabilities in our environment, both at Account level and at Workspace level.1) LakebaseWe would like to confirm if Databricks L...
Got it . Since Lakebase went GA recently its enabled by default now . You will need to open a support ticket to disable it . https://docs.databricks.com/aws/en/resources/support
Hi,Im trying to test some stuff out with the Databricks Lakebase, i want to connect the Lakebase to our custom frontend application. Using lakebase, since it is postgres based should result in faster query performance. I created a synced table to syn...
Hi @Jeffrey- Short answer: you’re not doing anything wrong—this is expected with Lakebase synced tables. UC row filters/masks don’t apply to Lakebase synced tables yet; RLS must be defined on the Postgres side separately. Synced tables are owned in ...
Can dashboards be powered by Lakebase Postgres?I noticed I can select it in the 'Queries' editor, but it doesn't seem to be an option for dashboards, which currently only shows SQL Warehouse and Serverless.Any way around this?Our aim is to support a ...
You can register Lakebase as read-only foreign catalog. In this case both computes will be used ( Sql end point and Lakebase). Doing lots of entitlement filtering via ABAC policies when dashboard being used can be tricky. Pre aggravated MV can be a c...
Delivering Lakehouse insights into external operational applications has been a headache for low latency cases. This often required complex & brittle integrations. With Databricks Lakebase Synced Tables, a native solution for Reverse ETL bridges the ...
SummaryWe are encountering a PERMISSION_DENIED error when deploying a Databricks Agent that uses Lakebase for agent memory, even though the endpoint creator has all documented permissions.The failure happens during serving endpoint creation, which is...
Can you check the MLFlow version you are using . https://docs.databricks.com/aws/en/generative-ai/agent-framework/agent-authentication#supported-resources-for-automatic-authentication-passthrough