cancel
Showing results for 
Search instead for 
Did you mean: 
Lakebase Discussions
Ask questions, share challenges, and connect with others working on Lakebase. From troubleshooting to best practices, this is where conversations happen.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

apindozzi
by New Contributor II
  • 1300 Views
  • 5 replies
  • 1 kudos

Resolved! Disable Lakebase and Model Serving (Foundation Models) at Account and/or Workspace level

 Hello Databricks Support Team,we would like to understand whether it is possible to disable specific Databricks product capabilities in our environment, both at Account level and at Workspace level.1) LakebaseWe would like to confirm if Databricks L...

  • 1300 Views
  • 5 replies
  • 1 kudos
Latest Reply
pradeep_singh
Contributor III
  • 1 kudos

Got it . Since Lakebase went GA recently its enabled by default now . You will need to open a support ticket to disable it . https://docs.databricks.com/aws/en/resources/support 

  • 1 kudos
4 More Replies
Jeffrey-
by New Contributor II
  • 2323 Views
  • 6 replies
  • 6 kudos

Resolved! How to use Row Level Security on a Sync table in Lakebase

Hi,Im trying to test some stuff out with the Databricks Lakebase, i want to connect the Lakebase to our custom frontend application. Using lakebase, since it is postgres based should result in faster query performance. I created a synced table to syn...

  • 2323 Views
  • 6 replies
  • 6 kudos
Latest Reply
sarahbhord
Databricks Employee
  • 6 kudos

Hi @Jeffrey-  Short answer: you’re not doing anything wrong—this is expected with Lakebase synced tables. UC row filters/masks don’t apply to Lakebase synced tables yet; RLS must be defined on the Postgres side separately. Synced tables are owned in ...

  • 6 kudos
5 More Replies
ttsaklanos
by New Contributor
  • 614 Views
  • 2 replies
  • 1 kudos

Resolved! Is it possible to have Lakebase Postgres as a compute option for an AI/BI Dashboard?

Can dashboards be powered by Lakebase Postgres?I noticed I can select it in the 'Queries' editor, but it doesn't seem to be an option for dashboards, which currently only shows SQL Warehouse and Serverless.Any way around this?Our aim is to support a ...

  • 614 Views
  • 2 replies
  • 1 kudos
Latest Reply
KartikBhatnagar
New Contributor III
  • 1 kudos

You can register Lakebase as read-only foreign catalog. In this case both computes will be used ( Sql end point and Lakebase). Doing lots of entitlement filtering via ABAC policies when dashboard being used can be tricky. Pre aggravated MV can be a c...

  • 1 kudos
1 More Replies
andres920310
by Databricks Partner
  • 1098 Views
  • 2 replies
  • 4 kudos

Resolved! BUG: Agent deployment fails with PERMISSION_DENIED for Lakebase dependency when created via databric

SummaryWe are encountering a PERMISSION_DENIED error when deploying a Databricks Agent that uses Lakebase for agent memory, even though the endpoint creator has all documented permissions.The failure happens during serving endpoint creation, which is...

  • 1098 Views
  • 2 replies
  • 4 kudos
Latest Reply
pradeep_singh
Contributor III
  • 4 kudos

Can you check the MLFlow version you are using .  https://docs.databricks.com/aws/en/generative-ai/agent-framework/agent-authentication#supported-resources-for-automatic-authentication-passthrough 

  • 4 kudos
1 More Replies
DaPo
by New Contributor III
  • 2331 Views
  • 3 replies
  • 3 kudos

Resolved! Lakebase -- Enable RLS in synced Table

Dear all,I am currently testing Lakebase for integration in our overall system. In particular I need to enable RLS on a Lakebase table, which is synced from a "Delta Streaming Table" in UC. Setting up the data sync was no trouble, in UC I am the owne...

  • 2331 Views
  • 3 replies
  • 3 kudos
Latest Reply
Advika
Community Manager
  • 3 kudos

Hello @DaPo! Could you please confirm whether you are the owner of the table within the Lakebase Postgres (not just in Unity Catalog)?Also, can you try creating a view on the synced table and then configure RLS on that view?

  • 3 kudos
2 More Replies
pdiamond
by Contributor
  • 701 Views
  • 1 replies
  • 2 kudos

Resolved! Lakebase query history / details

Is there somehwere in Databricks that I can see details about queries run againt one of my Lakebase databases (similar to query history system tables)?What I'm ultimately trying to figure out is where the time is being spent between when I issue the ...

  • 701 Views
  • 1 replies
  • 2 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 2 kudos

Hi @pdiamond ,Currently in beta there's a feature that let's you monitor active queries:https://docs.databricks.com/aws/en/oltp/projects/active-queriesAlso in beta there's Lakebase SQL editor that will allow you to analyze queries:https://docs.databr...

  • 2 kudos
AkhileshVB
by New Contributor
  • 4567 Views
  • 2 replies
  • 1 kudos

Resolved! Syncing lakebase table to delta table

I have been exploring Lakebase and I wanted to know if there is a way to sync CDC data from Lakebase tables to delta table in Lakehouse. I know the other way is possible and that's what was shown in the demo. Can you tell how I can I sync both the ta...

  • 4567 Views
  • 2 replies
  • 1 kudos
Latest Reply
Malthe
Valued Contributor II
  • 1 kudos

Just wanted to mention that the ETL from Lakebase to Delta Tables preview is mentioned here:https://www.databricks.com/blog/how-use-lakebase-transactional-data-layer-databricks-apps 

  • 1 kudos
1 More Replies
ticuss
by New Contributor
  • 978 Views
  • 1 replies
  • 1 kudos

Resolved! Lakebase / Feature Store error: “Failed to get identity details for username” (service principal)

Hello,I’m running into a Lakebase / Feature Store issue related to service principal authentication when trying to log or read from the Databricks Feature Store. Migrating from the legacy online tables.  Here’s the exact error:psycopg2.OperationalErr...

  • 978 Views
  • 1 replies
  • 1 kudos
Latest Reply
mark_ott
Databricks Employee
  • 1 kudos

The error you’re encountering —psycopg2.OperationalError: FATAL: Failed to get identity details for username: "user_uuid" — typically arises from an OAuth identity mismatch or invalid token scope when a Databricks service principal is used to authent...

  • 1 kudos
eoferreira
by New Contributor
  • 1746 Views
  • 3 replies
  • 4 kudos

Lakebase security

Hi team,We are using Databricks Enterprise and noticed that our Lakebase instances are exposed to the public internet. They can be reached through the JDBC endpoint with only basic username and password authentication. Is there a way to restrict acce...

  • 1746 Views
  • 3 replies
  • 4 kudos
Latest Reply
Sudheer-Reddy
New Contributor II
  • 4 kudos

Postgres instance is covered by the private link you configure to your workspace.

  • 4 kudos
2 More Replies
YugandharG
by New Contributor
  • 2179 Views
  • 1 replies
  • 3 kudos

Resolved! Lakebase storage location

Hi,I'm a Solution Architect from a reputed insurance company looking for few key technical information about Lakebase architecture. Being fully managed serverless OLTP offering from Databricks, there is no clear documentation that talks about data st...

  • 2179 Views
  • 1 replies
  • 3 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 3 kudos

Hi @YugandharG ,1. Lakebase data is stored in databricks-managed cloud object storage. There's no option to use customer storage as of now.2. File format: vanilla postgres pages. The storage format of postgres has nothing to do with parquet/delta. Wa...

  • 3 kudos
mrp
by New Contributor
  • 2266 Views
  • 3 replies
  • 2 kudos

Resolved! Lakebase Scale-to-Zero Behavior: Automatic or Application-Controlled?

Hi all,Lakebase is currently advertised as a database system that can scale down to zero:https://www.databricks.com/blog/what-is-a-lakebaseDoes anyone know if this scale-to-zero behavior is handled automatically by Databricks when the database is idl...

  • 2266 Views
  • 3 replies
  • 2 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 2 kudos

Hey @mrp ,Some features of Lakebase are still in public preview, so not all functionality is available yet. @ilorus  is correct that “scale to zero” is not currently part of the product. However, it is on the roadmap and should be available early nex...

  • 2 kudos
2 More Replies
juanjomendez96
by Contributor
  • 1810 Views
  • 5 replies
  • 4 kudos

Resolved! Start and stop lakebase instance

Hello there!I have been using the databricks-sdk for a while, and I have managed to create a system where I have controlled when the clusters and applications start and stop.However, now that we have adopted the new lakebase feature, we were wonderin...

  • 1810 Views
  • 5 replies
  • 4 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 4 kudos

 Sure, @juanjomendez96 . You just need to use following code from python SDK:from databricks.sdk import WorkspaceClientfrom databricks.sdk.service.database import DatabaseInstance# Initialize the Workspace clientw = WorkspaceClient()# Stop a database...

  • 4 kudos
4 More Replies
Sharanya13
by Contributor III
  • 4176 Views
  • 1 replies
  • 2 kudos

Resolved! Lakebase use cases

1. What are the use cases for Lakebase?  When should I use the Lakebase Postgres over delta tables?2. What are the differences between open-source Postgres and Lakebase?3. Should I utilize Lakebase for all OLTP requirements?

  • 4176 Views
  • 1 replies
  • 2 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 2 kudos

Hi @Sharanya13 ,1. Use Lakebase whenever you have application workload (OLTP) and you require low latency. For analytical workloads use Lakehouse. Here you have couple of example use cases from documentation:Serving data and/or features from the lake...

  • 2 kudos