Databricks Community

DaPo

Dear all,I am currently testing Lakebase for integration in our overall system. In particular I need to enable RLS on a Lakebase table, which is synced from a "Delta Streaming Table" in UC. Setting up the data sync was no trouble, in UC I am the owne...

DaPo · 05-07-2025

Hello all,I am tasked to evaluate a new LLM for some use-cases. In particular, I need to build a POC for a chat bot based on that model. To that end, I want to create a custom Serving Endpoint for an LLM pulled from huggingfaces. The model itself is...

DaPo · 03-20-2025

I have several DLT Pipeline, writing to some schema in a unity catalog. The storage location of the unity-catalog is managed by the databricks deployment (on AWS).The schema and the dlt-pipeline are managed via databricks asset bundles. I did not cha...

DaPo · 03-19-2025

Hi all,I have the following Problem: I have two streaming tables containing time-series measurements from different sensor data, each feed by multiple sensors. (Imagine: Multiple Temperature Sensors for the first table, and multiple humidity sensors ...

DaPo · 11-04-2024

Hi all,I have been using databricks-connect with serverless compute to develop and debug my databricks related code. It worked great so far. Now I started integrating ML-Flow in my workflow, and I am encountering an issue. When I run the following co...

DaPo

Hi @Advika,yes, I was only owner in UC, the Lakebase owner is some databricks_writer, and features like RLS seem to be restricted. Since Lakebase is quite new, I do not yet fully understand the interaction between UC concepts and Lakebase concepts. C...

DaPo · 05-15-2025

Hi @mani_22 , the issue was somewhere hidden in my code. (If I remember correctly, the issue was: I was using an internal library, which created a spark-dataframe "on the fly" using spark.createDataframe([some, data]). That dataframe was not backed b...

DaPo · 05-15-2025

Hi @sarahbhord ,thanks for the feedback. So far I was able to test a few of your suggestions. Unfortunately, no success yet.1. Thanks for the hints. I essentially used the default conda.yaml file generated by mlflow. Unfortunately, using your suggest...

Databricks Community

User Stats

User Activity

Lakebase -- Enable RLS in synced Table

Model Serving Endpoint: Cuda-OOM for Custom Model

DLT Fails with Exception: CANNOT_READ_STREAMING_STATE_FILE

DLT Streaming With Watermark fails, suggesting I should add watermarks

Using Datbricks Connect with serverless compute and MLflow

Re: Lakebase -- Enable RLS in synced Table

Re: DLT Fails with Exception: CANNOT_READ_STREAMING_STATE_FILE

Re: Model Serving Endpoint: Cuda-OOM for Custom Model