- 4221 Views
- 8 replies
- 6 kudos
Error at model serving for quantised models using bitsandbytes library
Hello,I've been trying to serve registered MLflow models at GPU Model Serving Endpoint, which works except for the models using bitsandbytes library. The library is used to quantise the LLM models into 4-bit/ 8-bit (e.g. Mistral-7B), however, it runs...
- 4221 Views
- 8 replies
- 6 kudos
- 6 kudos
@phi_alpacaWe have solved it by providing a conda_env.yaml when we log the model, all we needed was to add cudatoolkit=11.8 to the dependencies.
- 6 kudos
- 1918 Views
- 2 replies
- 0 kudos
Databricks Job cost(AWS)
Hi Databricks Community,I am looking for a formula/way to calculate the estimated cost for a job run, for which I have a few questions:1. Is there any formula to calculate the cost of any job like -> [(EC2 per hr cost) * (total time job ran)]and when...
- 1918 Views
- 2 replies
- 0 kudos
- 0 kudos
This looks a little bit confusing to me, I'm looking for a more straight forward answer, more like a simple formulaThanks though for your reply
- 0 kudos
- 1194 Views
- 0 replies
- 0 kudos
sparklyr::spark_read_csv forbidden 403 error
Hi,I am trying to read a csv file into a Spark DataFrame using sparklyr::spark_read_csv. I am receiving a 403 access denied error.I have stored my AWS credentials as environment variables, and can successfully read the file as an R dataframe using ar...
- 1194 Views
- 0 replies
- 0 kudos
- 1059 Views
- 0 replies
- 0 kudos
Left Outer Join returns an Inner Join in Delta Live Tables
In our Delta Live Table pipeline I am simply joining two streaming tables to a new streaming table.We use the following code: @Dlt.create_table() def fact_event_faults(): events = dlt.read_stream('event_list').withWatermark('TimeStamp', '4 hours'...
- 1059 Views
- 0 replies
- 0 kudos
- 4342 Views
- 0 replies
- 0 kudos
[Databricks][DatabricksJDBCDriver](500593) Communication link failure. Failed to connect to server.
I am using databricks jdbc driver to run a certain app. It runs fine for a few mins to hours and then I get the error [Databricks][DatabricksJDBCDriver](500593) Communication link failure. Failed to connect to server. Reason: HTTP Response code: 502,...
- 4342 Views
- 0 replies
- 0 kudos
- 900 Views
- 0 replies
- 0 kudos
Integrate databrick cluster with aws using cloudformation
Hello community, I am trying to launch databrick cluster using AWS cloudformation template. I have checked public extension option in cloudformation and databrick cluster extension is also available in third party extension however not getting how t...
- 900 Views
- 0 replies
- 0 kudos
- 1767 Views
- 1 replies
- 2 kudos
Hide widgets logic
Hello,We have recently created a notebook in order to allow users inserting/updating values in specific tables. The logic behind the update statements is included in a separate notebook where users don't have access. However we would like to know if ...
- 1767 Views
- 1 replies
- 2 kudos
- 2 kudos
When you want users to perform some write action (for example, change parameters, etc.), it is usually easiest to build a small app in Azure PowerApps, save those values, and extract them to the table in Delta Lake (so your notebooks will take values...
- 2 kudos
- 10615 Views
- 1 replies
- 1 kudos
Resolved! error loading databricks.proto
Hi,I'm using a DBR 13.3 LTS ML, and I want to set up a webhook trigger. I'm following the example notebook at https://learn.microsoft.com/en-us/azure/databricks/_extras/notebooks/source/mlflow/mlflow-model-registry-webhooks-python-client-example.html...
- 10615 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @FranPérez , The issue is that databricks-registry-webhooks has a databricks.proto file that collides with mlflow. Here is the fix: %pip install databricks-registry-webhooks mlflow==2.2.2 I also posted the fix on StackOverflow: https://stackoverfl...
- 1 kudos
- 3315 Views
- 1 replies
- 0 kudos
My Gamification
Hi all,I've been training at https://partner-academy.databricks.com/ and I see this tab for My Gamification, however, whenever I open it it always says 0 badges, 0 points. I have completed a number of courses, but there's no change. Is this feature...
- 3315 Views
- 1 replies
- 0 kudos
- 0 kudos
Haven't received anything back on this and don't see any others with this issue, maybe its something on my side.
- 0 kudos
- 722 Views
- 0 replies
- 0 kudos
Referencing a Technical Blog on LinkedIn - How to show the Blog Image instead of the Author Image?
When referencing a Technical Blog in a LinkedIn Post, the image of the author is displayed and not the image/picture of the blog itself - annoying.Example: Linkedin Post: https://www.linkedin.com/posts/axelschwanke_star-struct-the-secret-life-of-t...
- 722 Views
- 0 replies
- 0 kudos
- 1557 Views
- 0 replies
- 0 kudos
Transform a file into a bytes format without using BlobServiceClient.
Hello everyone,I would like to know if it was possible to transform, with PySpark, a flat file stored in a directory in Azure Blob storage into bytes format to be able to parse it, while using the connection already integrated into the cluster betwee...
- 1557 Views
- 0 replies
- 0 kudos
- 1020 Views
- 0 replies
- 0 kudos
Unity Catalog external table: Delta Lake table comment
Hi there,When creating an external table in Unity Catalog using an existing Delta Lake table with a comment on the table itself, the comment isn't imported to the `Comment` key's value in the Unity Catalog table.Could you explain why?
- 1020 Views
- 0 replies
- 0 kudos
- 1100 Views
- 0 replies
- 0 kudos
Read VCF files using latest runtime version
Hello everyone!I was reading VCF files using the glow library (Maven: io.projectglow:glow-spark3_2.12:1.2.1).The last version of this library only works with the spark's version 3.3.2 so if I need to use a newer runtime with a more recent spark versi...
- 1100 Views
- 0 replies
- 0 kudos
- 1614 Views
- 1 replies
- 0 kudos
How to add delay between databricks workflow job tasks.?
I want to add an explicit time delay between databricks workflow job tasks, any help would be greatly appreciated. Thanks
- 1614 Views
- 1 replies
- 0 kudos
- 0 kudos
@Milliman - you could add min_retry_interval_millis to add delay between start of the failed run and the subsequent retry run. Reference is here
- 0 kudos
- 1106 Views
- 0 replies
- 0 kudos
workspace level sso gives authentication failed error
We have enabled workspace level sso , and have V2.0 version of databricks using azure EntraID groups and azure applications.Values in both databricks and azure application matchStill we get sso auth failed error.How can this be resolved , SAML tracer...
- 1106 Views
- 0 replies
- 0 kudos
