Databricks

pablobd · 01-29-2024

Hi all,I've been able to create a model serving endpoint through the api, following the docs, but then when trying to update the version, I get the following error:'{"error_code":"RESOURCE_ALREADY_EXISTS","message":"Endpoint with name \'ml-project\' ...

pablobd · 01-24-2024

I need to run this kind of code: from pyspark.sql import SparkSession import pandas as pd # Create a Spark session spark = SparkSession.builder.appName("example").getOrCreate() # Sample data data = [("Alice", 1), ("Bob", 2), ("Charlie", 3), ("David...

pablobd · 01-09-2024

Hello,I am trying to create a model serving endpoint via the API as explained here: https://docs.databricks.com/api/workspace/servingendpoints/createI created a trusted IAM role with access to DynamoDB for the feature store. I try to use this field,"...

pablobd · 01-04-2024

Using `mlflow.pyfunc.log_model` to save a model in the model registry fails with the following error: `PicklingError: Can't pickle <built-in function input>: it's not the same object as builtins.input`I've reproduced it locally and got to the conclus...

pablobd · 12-18-2023

As part of my MLOps stack, I have developed a few packages which are the published to a private AWS CodeArtifact repo. How can I connect the AWS CodeArtifact repo to databricks? I want to be able to add these packages to the requirements.txt of a mod...

pablobd · 01-29-2024

I found a good solution that works both locally and in the cloud. Copy pasting the code in case it helps someone.This is the higher level function in charge of partitioning the data and sending the data and the function fn to each node. def decrypt_d...

pablobd · 01-24-2024

Sorry, again updating about the problem. Using RDDs is among the listed limitations of Databricks Connect for Python: https://docs.databricks.com/en/dev-tools/databricks-connect/python/limitations.htmlDo you know if there is any workaround? Or any wa...

pablobd · 01-24-2024

I tried to edit the previous one but I can't. Just wanted to remove some lines of code that may be misleading. At the beginning this block should be out,from pyspark.sql import SparkSession import pandas as pd # Create a Spark session spark = SparkS...

pablobd · 01-23-2024

Thanks @Debayan - this article helped

pablobd · 12-19-2023

Got it! Thanks @Kaniz . That's actually the same I do to configure the repo in my local computer. However, I need to do this in the Model Registry so that when deploying a model in the UC to model serving, it installs the requirements from my privat...

Databricks

User Stats

User Activity

Update model serving endpoint

Error when accessing rdd of DataFrame

Model Serving Endpoint Creation through API

Save ML model in the registry fails

Install python package from private repo [CodeArtifact]

Re: Error when accessing rdd of DataFrame

Re: Error when accessing rdd of DataFrame

Re: Error when accessing rdd of DataFrame

Re: Model Serving Endpoint Creation through API

Re: Install python package from private repo [CodeArtifact]