We are testing Azure Databricks Lakebase Autoscaling with Public Network Access disabled and standard inbound Private Link enabled.The workspace UI works privately through VPN, but the Lakebase Data API hostname still resolves to a public IP and retu...
We are using Lakebase Data API (HTTP Endpoint) to execute queries and need to verify the audit log capabilities for compliance. Could you please clarify:Query Text Logging: Does Databricks capture the full SQL statement text and the actual user ident...
Hi @POCUSER, I’m not aware of any public documentation that explicitly confirms that every request sent through the Lakebase Data API is captured in system.query.history or exposed through a dedicated per-request audit log. A practical way to validat...
I am building an agentic workflow. This is a multi agent workflow - Plan, Reason, Act and Synthesize. Each agent has its own access to tools to take ACTIONS on data. Some of these agents are READ only, some can WRITE/UPDATEAll data is resident withi...
Hi @smithsonian, The general best-practice pattern is to separate what the agent plans... from...what the platform will actually allow it to do. If the data already lives in Unity Catalog, a good approach is to use Unity Catalog as the system of reco...
Hi DB Community ,Is there any way to access/write to delta table in UC from lakebase postgres ? There's a way using "Sync Table" - but it is recommended only to read data from Sync Table . Databricks recommends against writing to sync table . Or else...
Currently, direct write-back from Lakebase PostgreSQL to Unity Catalog Delta tables is not the recommended pattern.A few points that may help:• “Sync Tables” are mainly designed for replication/read access scenarios. Databricks currently recommends a...
Hi databricks community, I want to create a lakebase table that is synced with the delta table . So whenever the delta table is updated the changes should be available in lakebase table. Now I want to create a databricks streamlit application and ma...
You can use Lake base Autoscaling with Synced Tables.Synced tables empower you to export high quality & governed data from Lakehouse into Lake base. Its specifically designed for downstream applications requiring extreme responsiveness (sub 10ms resp...
It doesn’t appear that the Lakebase OLTP instances function like Sql warehouses in the following ways:• automatically starting when initiating a connection• automatically stopping after no usage in x minutesI am wondering if others have use cases for...
Lake base supports Autoscaling & Scale to Zero with Automatic Suspension & Reactivation capabilitiesAutomatic Suspension - Lake base compute automatically suspends after a period of inactivity (default is 5 minutes).Reactivation - The compute automat...
Hi all,I’m trying to set up REST-based communication between my Lakebase and a REST-client.I’m following the documentation “Connecting to Lakebase via REST using a service principal” to obtain a workspace-level token. After that, I use the Lakebase D...
I created a new Lakebase project to retrace all my steps. 0- I reused my service principal on the workspace1- installed databricks authentication extension: CREATE EXTENSION IF NOT EXISTS databricks_auth;2-Added the lakehouse service principal to the...
Greetings,I am following course " Get Started with Lakebase Course". I got access to "Databricks Academy Labs" but I could not find documentation related to "Get Started with Lakebase Course". I appreciate any help. Thanks,Sri
@Sumit_7 , Thank you for sharing the course URL. I have been working through the same course. Please refer to the 4th lesson, “Demo: Creating and Exploring a Lakebase Project.”I was not able to find any related documentation—specifically the tables d...
I can't view my lakebase postgres autoscaling project's table tab.The error id is: 3760588e08b843c5a4aebac770f8e967
Hi @ctgchris,I'm experiencing the same issue — unable to view the table tab on Lakebase Postgres Autoscaling. Has there been any update or resolution on this? Any workaround would be appreciated as well.Thanks!
Hi,Has anyone managed to get the new Lakebase autoscaling fully working in an enterprise Azure setup?We are currently facing issues when setting up Lakebase autoscaling in a Databricks environment without a public IP, where all traffic is routed priv...
Hi, so I think what is happening as different types of tools get routed to lakebase via different paths and I believe you need to open up an additional private link. The docs here explain it pretty well. https://learn.microsoft.com/en-us/azure/datab...
Hello! I am experiencing a confusing issue with LakeBase. I created a new project and I tried to run the example query provided in the SQL Editor to create a first table. Unfortunately, the query failed with "Unknown Error" and not further explanatio...
Hi @Sbolo ,Which Lakebase are you using? Provisioned or Autoscaling? And since you also got following error:"Public access is not allowed for workspace: <id here>"I think it can be a networking issue. Try to create private endpoints and check if this...
Today we have an web frontend and custom API that we call from the frontend. I can see Lakebase projects support an API and SQL over REST. And we are considering whether skipping the custom API and calling the Lakebase API directly. However I see som...
Hi @Sega2, I don't there are many patterns or approaches published widely yet. In general, though, for production web apps, you may want to consider something like frontend --> thin backend --> Lakebase rather than calling Lakebase Data API directly ...
Our admin created a project for lakebase branching. My user has "Can manage" permissions. I can create branches etc, however when I run something in the SQL editor i get following error:"ERROR: permission denied for schema public (SQLSTATE 42501)CREA...
Greetings @Sega2 , I did some digging and here is what I found. Your screenshot (thanks for sharing, it was helpful) is showing a user running a Postgres CREATE TABLE statement in the Lakebase SQL Editor and hitting this error: In Lakebase, there ar...
I am playing with branches in lakebase. I have created a dev under prod, applied som changes. How do you merge/promote the dev into prod? Have not found any things in the UI?Thanks, Thomas
Hi @Sega2, I can help with this. Welcome to Lakebase branching. As the earlier reply mentioned, Lakebase branches use copy-on-write technology rather than Git-style merging, so the workflow for promoting changes is a bit different from what you might...
We have a VNET Injected workspace in Azure. There are multiple SQL Warehouse which are easily accessible from Private Network - both directly from VM and via VPN on client's machine. We deployed Lakebase. Inside the Workspace, connectivity is working...
Summary Lakebase operates in the Databricks Serverless compute plane, meaning it does not reside inside your injected VNET. Connection timeouts from external tools are typically caused by blocked outbound ports or missing front-end Private Link confi...
