- 2000 Views
- 3 replies
- 1 kudos
Lakebase not accessible in Private Network
We have a VNET Injected workspace in Azure. There are multiple SQL Warehouse which are easily accessible from Private Network - both directly from VM and via VPN on client's machine. We deployed Lakebase. Inside the Workspace, connectivity is working...
- 2000 Views
- 3 replies
- 1 kudos
- 1 kudos
Summary Lakebase operates in the Databricks Serverless compute plane, meaning it does not reside inside your injected VNET. Connection timeouts from external tools are typically caused by blocked outbound ports or missing front-end Private Link confi...
- 1 kudos
- 1545 Views
- 3 replies
- 1 kudos
Resolved! Lakebase error logs
Anyone know where to see any logs related to Lakebase/Postgres? I have a Tableau Prep flow that is failing but the error is not clear and I'm trying to find out what the database is capturing.
- 1545 Views
- 3 replies
- 1 kudos
- 1 kudos
There are multiple ways of monitoring Lakebase errors and warnings. This will let you see what Tableau is actually sending and how it behaves (e.g., repeated failing INSERT). 3. Control‑plane / audit logs for Lakebase Databricks audit logs include...
- 1 kudos
- 1962 Views
- 1 replies
- 1 kudos
Resolved! Databricks App how to setup lakebase postgres connection locally
I'm developing a FastAPI middleware app (Databricks App) that connects to both a SQL Warehouse (Unity Catalog) and a Lakebase PostgreSQL instance using async SQLAlchemy. The app works perfectly when deployed to Databricks, but I'm trying to set up lo...
- 1962 Views
- 1 replies
- 1 kudos
- 1 kudos
Summary You should be able to test your FastAPI endpoints locally. Lakebase supports direct external connections via the standard PostgreSQL wire protocol, meaning your local SQLAlchemy setup can directly query the Lakebase instance without needing t...
- 1 kudos
- 1754 Views
- 5 replies
- 1 kudos
Resolved! Disable Lakebase and Model Serving (Foundation Models) at Account and/or Workspace level
Hello Databricks Support Team,we would like to understand whether it is possible to disable specific Databricks product capabilities in our environment, both at Account level and at Workspace level.1) LakebaseWe would like to confirm if Databricks L...
- 1754 Views
- 5 replies
- 1 kudos
- 1 kudos
Got it . Since Lakebase went GA recently its enabled by default now . You will need to open a support ticket to disable it . https://docs.databricks.com/aws/en/resources/support
- 1 kudos
- 3547 Views
- 6 replies
- 7 kudos
Resolved! How to use Row Level Security on a Sync table in Lakebase
Hi,Im trying to test some stuff out with the Databricks Lakebase, i want to connect the Lakebase to our custom frontend application. Using lakebase, since it is postgres based should result in faster query performance. I created a synced table to syn...
- 3547 Views
- 6 replies
- 7 kudos
- 7 kudos
Hi @Jeffrey- Short answer: you’re not doing anything wrong—this is expected with Lakebase synced tables. UC row filters/masks don’t apply to Lakebase synced tables yet; RLS must be defined on the Postgres side separately. Synced tables are owned in ...
- 7 kudos
- 837 Views
- 2 replies
- 1 kudos
Resolved! Is it possible to have Lakebase Postgres as a compute option for an AI/BI Dashboard?
Can dashboards be powered by Lakebase Postgres?I noticed I can select it in the 'Queries' editor, but it doesn't seem to be an option for dashboards, which currently only shows SQL Warehouse and Serverless.Any way around this?Our aim is to support a ...
- 837 Views
- 2 replies
- 1 kudos
- 1 kudos
You can register Lakebase as read-only foreign catalog. In this case both computes will be used ( Sql end point and Lakebase). Doing lots of entitlement filtering via ABAC policies when dashboard being used can be tricky. Pre aggravated MV can be a c...
- 1 kudos
- 1441 Views
- 2 replies
- 4 kudos
Resolved! BUG: Agent deployment fails with PERMISSION_DENIED for Lakebase dependency when created via databric
SummaryWe are encountering a PERMISSION_DENIED error when deploying a Databricks Agent that uses Lakebase for agent memory, even though the endpoint creator has all documented permissions.The failure happens during serving endpoint creation, which is...
- 1441 Views
- 2 replies
- 4 kudos
- 4 kudos
Can you check the MLFlow version you are using . https://docs.databricks.com/aws/en/generative-ai/agent-framework/agent-authentication#supported-resources-for-automatic-authentication-passthrough
- 4 kudos
- 2841 Views
- 3 replies
- 3 kudos
Resolved! Lakebase -- Enable RLS in synced Table
Dear all,I am currently testing Lakebase for integration in our overall system. In particular I need to enable RLS on a Lakebase table, which is synced from a "Delta Streaming Table" in UC. Setting up the data sync was no trouble, in UC I am the owne...
- 2841 Views
- 3 replies
- 3 kudos
- 3 kudos
Hello @DaPo! Could you please confirm whether you are the owner of the table within the Lakebase Postgres (not just in Unity Catalog)?Also, can you try creating a view on the synced table and then configure RLS on that view?
- 3 kudos
- 871 Views
- 1 replies
- 2 kudos
Resolved! Lakebase query history / details
Is there somehwere in Databricks that I can see details about queries run againt one of my Lakebase databases (similar to query history system tables)?What I'm ultimately trying to figure out is where the time is being spent between when I issue the ...
- 871 Views
- 1 replies
- 2 kudos
- 2 kudos
Hi @pdiamond ,Currently in beta there's a feature that let's you monitor active queries:https://docs.databricks.com/aws/en/oltp/projects/active-queriesAlso in beta there's Lakebase SQL editor that will allow you to analyze queries:https://docs.databr...
- 2 kudos
- 5234 Views
- 2 replies
- 1 kudos
Resolved! Syncing lakebase table to delta table
I have been exploring Lakebase and I wanted to know if there is a way to sync CDC data from Lakebase tables to delta table in Lakehouse. I know the other way is possible and that's what was shown in the demo. Can you tell how I can I sync both the ta...
- 5234 Views
- 2 replies
- 1 kudos
- 1 kudos
Just wanted to mention that the ETL from Lakebase to Delta Tables preview is mentioned here:https://www.databricks.com/blog/how-use-lakebase-transactional-data-layer-databricks-apps
- 1 kudos
- 1297 Views
- 1 replies
- 1 kudos
Resolved! Lakebase / Feature Store error: “Failed to get identity details for username” (service principal)
Hello,I’m running into a Lakebase / Feature Store issue related to service principal authentication when trying to log or read from the Databricks Feature Store. Migrating from the legacy online tables. Here’s the exact error:psycopg2.OperationalErr...
- 1297 Views
- 1 replies
- 1 kudos
- 1 kudos
The error you’re encountering —psycopg2.OperationalError: FATAL: Failed to get identity details for username: "user_uuid" — typically arises from an OAuth identity mismatch or invalid token scope when a Databricks service principal is used to authent...
- 1 kudos
- 1988 Views
- 3 replies
- 4 kudos
Lakebase security
Hi team,We are using Databricks Enterprise and noticed that our Lakebase instances are exposed to the public internet. They can be reached through the JDBC endpoint with only basic username and password authentication. Is there a way to restrict acce...
- 1988 Views
- 3 replies
- 4 kudos
- 4 kudos
Postgres instance is covered by the private link you configure to your workspace.
- 4 kudos
- 2793 Views
- 1 replies
- 3 kudos
Resolved! Lakebase storage location
Hi,I'm a Solution Architect from a reputed insurance company looking for few key technical information about Lakebase architecture. Being fully managed serverless OLTP offering from Databricks, there is no clear documentation that talks about data st...
- 2793 Views
- 1 replies
- 3 kudos
- 3 kudos
Hi @YugandharG ,1. Lakebase data is stored in databricks-managed cloud object storage. There's no option to use customer storage as of now.2. File format: vanilla postgres pages. The storage format of postgres has nothing to do with parquet/delta. Wa...
- 3 kudos
- 2665 Views
- 3 replies
- 2 kudos
Resolved! Lakebase Scale-to-Zero Behavior: Automatic or Application-Controlled?
Hi all,Lakebase is currently advertised as a database system that can scale down to zero:https://www.databricks.com/blog/what-is-a-lakebaseDoes anyone know if this scale-to-zero behavior is handled automatically by Databricks when the database is idl...
- 2665 Views
- 3 replies
- 2 kudos
- 2 kudos
Hey @mrp ,Some features of Lakebase are still in public preview, so not all functionality is available yet. @ilorus is correct that “scale to zero” is not currently part of the product. However, it is on the roadmap and should be available early nex...
- 2 kudos
- 2194 Views
- 5 replies
- 4 kudos
Resolved! Start and stop lakebase instance
Hello there!I have been using the databricks-sdk for a while, and I have managed to create a system where I have controlled when the clusters and applications start and stop.However, now that we have adopted the new lakebase feature, we were wonderin...
- 2194 Views
- 5 replies
- 4 kudos
- 4 kudos
Sure, @juanjomendez96 . You just need to use following code from python SDK:from databricks.sdk import WorkspaceClientfrom databricks.sdk.service.database import DatabaseInstance# Initialize the Workspace clientw = WorkspaceClient()# Stop a database...
- 4 kudos
