cancel
Showing results for 
Search instead for 
Did you mean: 
Lakebase Discussions
Ask questions, share challenges, and connect with others working on Lakebase. From troubleshooting to best practices, this is where conversations happen.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Kirankumarbs
by • Honored Contributor
  • 218 Views
  • 2 replies
  • 3 kudos

Lakebase in production: what surprised you?

Hi all,I'm evaluating Lakebase for my company and writing up a recommendation. Most of what I can find is launch material and overview posts. Useful for understanding what it does, less useful for deciding whether to run it.So I'd rather hear from pe...

  • 218 Views
  • 2 replies
  • 3 kudos
Latest Reply
anuj_lathi
Databricks Employee
  • 3 kudos

Your cost list is the right instinct. In my experience Lakebase doesn't surprise people on the compute rate, it surprises them on the multipliers around it: retention window, branches, sync pipelines, and Always-On sizing. You can only settle most of...

  • 3 kudos
1 More Replies
SiddharthMadan
by • New Contributor
  • 371 Views
  • 3 replies
  • 0 kudos

Genie Space Token Limit & Metric View Description

Hi,I want to get clarity around 2 things related to Genie Agents/Spaces-1. Is their any token limit defined for each space?2. How much is the character limit for description section within any Metric View?

  • 371 Views
  • 3 replies
  • 0 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 0 kudos

Hello @SiddharthMadan, I took a look at both internal and external documentation and here is what I found. @ThomazNeto and @balajij8 have both questions right, so I'll confirm and add a few practical points. Token limit There is one, and Databricks d...

  • 0 kudos
2 More Replies
gokkul
by • Databricks Partner
  • 5575 Views
  • 5 replies
  • 1 kudos

How to access a delta table in UC from lakebase postgres ?

Hi DB Community ,Is there any way to access/write to delta table in UC from lakebase postgres ? There's a way using "Sync Table" - but it is recommended only to read data from Sync Table . Databricks recommends against writing to sync table . Or else...

  • 5575 Views
  • 5 replies
  • 1 kudos
Latest Reply
AbhilashNagilla
Databricks Employee
  • 1 kudos

For the Postgres-to-Delta direction, Lakebase Change Data Feed captures every insert, update, and delete on a Lakebase Postgres table and appends each change to a Unity Catalog managed Delta table named lb_<table_name>_history, flushed about every 15...

  • 1 kudos
4 More Replies
skarpeck
by • Databricks Partner
  • 3734 Views
  • 4 replies
  • 1 kudos

Lakebase not accessible in Private Network

We have a VNET Injected workspace in Azure. There are multiple SQL Warehouse which are easily accessible from Private Network - both directly from VM and via VPN on client's machine. We deployed Lakebase. Inside the Workspace, connectivity is working...

  • 3734 Views
  • 4 replies
  • 1 kudos
Latest Reply
AbhilashNagilla
Databricks Employee
  • 1 kudos

If your Lakebase connection string uses a regional host (*.database.<region>.azuredatabricks.net), Postgres clients connecting from outside the workspace need inbound Private Link for performance-intensive services on port 5432 alongside the workspac...

  • 1 kudos
3 More Replies
Pat
by • Esteemed Contributor
  • 330 Views
  • 2 replies
  • 1 kudos

Lakebase synced tables: how can a database owner/admin configure default SELECT privileges for the m

QuestionWe use Databricks Lakebase synced tables to sync Unity Catalog tables into Lakebase. We want a reader role to automatically receive SELECT access on newly created synced tables, without having to rerun grants whenever another table is added.G...

  • 330 Views
  • 2 replies
  • 1 kudos
Latest Reply
LingeshK
Databricks Employee
  • 1 kudos

Hello Pat, Following up on the answer above from @ThomazNeto. I did a test run, particularly on one option the thread has not covered yet. Thank you for posting the exact statements and both errors, which made the case easy to reproduce Short answer:...

  • 1 kudos
1 More Replies
Malthe
by • Valued Contributor II
  • 1408 Views
  • 1 replies
  • 1 kudos

Resolved! Group-based auth with Lakebase Data API

While Lakebase supports group-based authentication, this doesn't seem to have carried over to Lakebase Data API.Here, we must assign on the individual user or service principal,Create principalSetup authenticator accessSchema- and table grantsThis me...

  • 1408 Views
  • 1 replies
  • 1 kudos
Latest Reply
tom_n
Databricks Employee
  • 1 kudos

Hi Malthe, you're right, the Data API doesn't support group roles yet. The reason is how it authenticates. Over a normal Postgres connection you can log in as a group role (created with `databricks_create_role('<group>', 'GROUP')`). The Data API work...

  • 1 kudos
eduardostzouze
by • New Contributor III
  • 1406 Views
  • 5 replies
  • 5 kudos

Resolved! Lakebase Data API (GCP) returns jwk not found for valid service principal tokens

Workspace on GCP us-central1, Lakebase Autoscaling (Beta). The Data API returns 400 {"message":"jwk not found"} for every request.Setup follows the docs: role created with databricks_create_role('<sp-uuid>', 'SERVICE_PRINCIPAL'), GRANT "<sp-uuid>" TO...

Lakebase Discussions
Data API
GCP
lakebase
  • 1406 Views
  • 5 replies
  • 5 kudos
Latest Reply
eduardostzouze
New Contributor III
  • 5 kudos

Update: resolved. Databricks confirmed this was a bug on their side in the Data API's JWKS resolution on GCP, and it has been fixed. The same requests that were failing with jwk not found now return 200 OK, with no changes to my configuration (same s...

  • 5 kudos
4 More Replies
KeatOoi
by • New Contributor III
  • 1421 Views
  • 5 replies
  • 3 kudos

Resolved! Lakebase Data API – First Request Times Out After 8 Seconds When Compute Is Offline

Hi Everyone,I’m using the Databricks Lakebase Data API and have noticed that the first API call consistently times out after approximately 8 seconds when the Lakebase compute is offline.The first request triggers the compute to start, and the compute...

  • 1421 Views
  • 5 replies
  • 3 kudos
Latest Reply
KeatOoi
New Contributor III
  • 3 kudos

Update on this post: I have raised a support case with Databricks and requested that the timeout be increased. The timeout has been increased to 20 seconds.

  • 3 kudos
4 More Replies
jeremiasInetum
by • New Contributor II
  • 1351 Views
  • 4 replies
  • 4 kudos

Resolved! Lakebase Postgres branch stuck "disabled" after auto-archive → unarchive (Public Preview)

Hi all,Running into what looks like a platform bug with Lakebase Postgres (Public Preview) and hoping a community engineer can help, since my Databricks support case (#01009170) was closed as out of entitlement (personal account, no support contract)...

  • 1351 Views
  • 4 replies
  • 4 kudos
Latest Reply
Albert_PKW
New Contributor II
  • 4 kudos

I also faced the same error as @jeremiasInetum. So I applied the steps from @Gokul_Pillai1  and status.disabled became false. After that, I navigate to branches in Lakebase. In branch overview, click on Protect button under Disable archiving.Click Se...

  • 4 kudos
3 More Replies
rkhbo3003
by • New Contributor III
  • 820 Views
  • 3 replies
  • 1 kudos

Lakebase Postgre updating Delta Table.

I am using Postgre for OLTP processing for POS application.Lag is reduced a lot, however when there is updation on Postgre table, I need to sync back to delta table. There is one way from delta table sync table (read only). Any design pattern sas to ...

  • 820 Views
  • 3 replies
  • 1 kudos
Latest Reply
rijin-23
New Contributor III
  • 1 kudos

As @balajij8 and @srini_ve @mentioned, Lakebase CDF is the way to do it. You’ll have the change data flowing to lake house as SCD2 so you have a record of all the transactions happening in lakebase stored in your lake house. I have a LinkedIn post wr...

  • 1 kudos
2 More Replies
batch_bender
by • New Contributor III
  • 1333 Views
  • 1 replies
  • 2 kudos

Resolved! Lakebase synced table doesn’t recognize Auto CDF on a SDP materialized view

I’m trying to create a triggered Lakebase synced table from a SDP-created materialized view.The source MV uses Automatic CDF: row tracking is enabled and legacy CDF (delta.enableChangeDataFeed) is disabled. The Automatic CDF workspace preview is enab...

  • 1333 Views
  • 1 replies
  • 2 kudos
Latest Reply
GabFernandes
Contributor III
  • 2 kudos

Short answer: No — Lakebase synced tables in Triggered/Continuous mode do not currently support Automatic CDF from materialized views. This is a documented limitation, not a configuration issue.The synced tables documentation explicitly states:"Sourc...

  • 2 kudos
charl-p-botha
by • Databricks Partner
  • 1757 Views
  • 2 replies
  • 3 kudos

Resolved! How to prevent users from creating Lakebase compute?

Dear community,According to [1] and other sources, all workspace users are assigned `CAN_CREATE` on lakebase projects, and this permission "can't be revoked".The problem is that such a project comes with by default a 8 - 16 CU lakebase compute instan...

  • 1757 Views
  • 2 replies
  • 3 kudos
Latest Reply
charl-p-botha
Databricks Partner
  • 3 kudos

Thank you very much for also looking into this.I've submitted this as feedback via the new Lakebase Postgres web-ui. It doesn't look like I can link to that submitted feedback here. Let's hope for the best.

  • 3 kudos
1 More Replies
smithsonian
by • Contributor
  • 5415 Views
  • 4 replies
  • 0 kudos

Resolved! Controlling Agent access to Tools and Tool access to Data Operations

I am building an agentic workflow.  This is a multi agent workflow - Plan, Reason, Act and Synthesize. Each agent has its own access to tools to take ACTIONS on data. Some of these agents are READ only, some can WRITE/UPDATEAll data is resident withi...

  • 5415 Views
  • 4 replies
  • 0 kudos
Latest Reply
venkat-raghavan
Contributor
  • 0 kudos

Hi Ashwin I do want to contrast you stated really well from what is stated or implied in the Service Control policies documentation you shared.You said things1) For write or move actions, I would strongly recommend a controlled execution pattern... p...

  • 0 kudos
3 More Replies
POCUSER
by • New Contributor III
  • 2070 Views
  • 1 replies
  • 0 kudos

Resolved! Lakebase Data API private access with Public Network Access disabled

We are testing Azure Databricks Lakebase Autoscaling with Public Network Access disabled and standard inbound Private Link enabled.The workspace UI works privately through VPN, but the Lakebase Data API hostname still resolves to a public IP and retu...

  • 2070 Views
  • 1 replies
  • 0 kudos
Latest Reply
stbjelcevic
Databricks Employee
  • 0 kudos

Hi @POCUSER , Yes, the Lakebase Data API can be used privately with Public Network Access disabled. Because the Data API is a REST endpoint (Lakebase Data API), it goes through your workspace’s standard inbound (front-end) Private Link, the databrick...

  • 0 kudos
POCUSER
by • New Contributor III
  • 2350 Views
  • 2 replies
  • 0 kudos

Resolved! Inquiry regarding Query History and Audit Logs for Databricks Lakebase

We are using Lakebase Data API (HTTP Endpoint) to execute queries and need to verify the audit log capabilities for compliance. Could you please clarify:Query Text Logging: Does Databricks capture the full SQL statement text and the actual user ident...

  • 2350 Views
  • 2 replies
  • 0 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 0 kudos

Hi @POCUSER, I’m not aware of any public documentation that explicitly confirms that every request sent through the Lakebase Data API is captured in system.query.history or exposed through a dedicated per-request audit log. A practical way to validat...

  • 0 kudos
1 More Replies