cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results for 
Search instead for 
Did you mean: 
Data + AI Summit 2024 - Data Science & Machine Learning

Forum Posts

kishanmaladkar
by New Contributor
  • 72 Views
  • 2 replies
  • 0 kudos

Not able to edit_mode UI_LOCKED to EDITABLE in bundle deployment for development mode

The edit_mode for Databricks jobs cannot be overridden using the bundle. Based on the jobs REST API docs, there is a functionality to set this parameter but in the bundle docs, it's not available. How can I use this in the bundle to override the para...

  • 72 Views
  • 2 replies
  • 0 kudos
Latest Reply
Walter_C
Honored Contributor
  • 0 kudos

When you refer you cannot edit it, do you refer to this specific field for the edit mode, it keeps blocked as UI_LOCKED or the option is just not available?

  • 0 kudos
1 More Replies
RobinK
by Contributor
  • 27 Views
  • 0 replies
  • 0 kudos

Vectorsearch ConnectionResetError Max retries exceeded

Hi,we are serving a unity catalog langchain model with databricks model serving. When I run the predict() function on the model in a notebook, I get the expected output. But when I query the served model, errors occur in the service logs:Error messag...

  • 27 Views
  • 0 replies
  • 0 kudos
NaeemS
by New Contributor III
  • 854 Views
  • 8 replies
  • 0 kudos

Feature Store Model Serving endpoint

Hi,I am trying to deploy my model which was logged by featureStoreEngineering client as a serving endpoint in Databricks. But I am facing following error:   The Databricks Lookup client from databricks-feature-lookup and Databricks Feature Store clie...

  • 854 Views
  • 8 replies
  • 0 kudos
Latest Reply
damselfly20
  • 0 kudos

Hi @robbe, I'm facing the same error like @NaeemS. I've deployed an endpoint for a RAG chain in Azure Databricks and at first, it worked well. I've set scale_to_zero_enabled=True. The problem is: Sometimes, scaling up from zero works fine and sometim...

  • 0 kudos
7 More Replies
Doremone03
by New Contributor
  • 197 Views
  • 0 replies
  • 0 kudos

Image TIFF Jpeg Text to PDF Converter Crack

Image TIFF Jpeg Text to Pdf Converter 5.8 Crack, we are providing you with the full version of AnyPic JPG to PDF converter. It is a converter that can work fine offline and it also possesses the ability to convert another file extension including; BM...

  • 197 Views
  • 0 replies
  • 0 kudos
argl1995dbks
by New Contributor
  • 56 Views
  • 1 replies
  • 1 kudos

Passing parameters in Databricks workflows

Hi Databricks, we have created several Databricks workflows and the `json-definition.json` for the same is stored inside version control i.e. GitHub. There are several parameters which are referred from params.json inside this job definition but the ...

  • 56 Views
  • 1 replies
  • 1 kudos
Latest Reply
jacovangelder
Contributor III
  • 1 kudos

Have you considered using Databricks Asset Bundles? Very easy to parameterize! 

  • 1 kudos
ecram
by New Contributor
  • 91 Views
  • 1 replies
  • 0 kudos

Creating an Input Schema for Multiple DataFrames in MLflow

Hi everyone,I am working with MLflow version 2.5.0 and need to create an input_schema for my model. My data schema is divided into several DataFrames, for example:{"dataframe_split": {     "columns": ["ClientGuid", "Instance", "TypeScore", ...],     ...

  • 91 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hi @ecram, To create an input schema for multiple DataFrames in MLflow, you can use the mlflow.types.schema module to define the schema for each DataFrame and then combine them. 

  • 0 kudos
Edna
by New Contributor II
  • 745 Views
  • 4 replies
  • 1 kudos

Resolved! Model flavour using feature store model training log_model()

Hi I'm have succesfully registered my model using the feature engineering client with the following codes:with mlflow.start_run(): # Calculate the ratio of negative class samples to positive class samples ratio = (len(y_train) - y_train.sum()...

  • 745 Views
  • 4 replies
  • 1 kudos
Latest Reply
Edna
New Contributor II
  • 1 kudos

Thanks for your reply @robbe - yes I have created a custom pyfunc model which I can now use fe.score_batch() to return probabilities. Here is the code:# Calculate the ratio of negative class samples to positive class samples ratio = (len(y_train) - y...

  • 1 kudos
3 More Replies
migq2
by New Contributor III
  • 98 Views
  • 2 replies
  • 0 kudos

Can't load model from UC due to DBFS issue

I want to load a model I have registered in Unity Catalog using a Shared cluster, but it seems to be trying to use dbfs under the hood and it gives me an error.I am using DBR 13.3 LTS and mlflow-skinny[databricks]==2.14.3My code import mlflow mlflow...

  • 98 Views
  • 2 replies
  • 0 kudos
Latest Reply
jacovangelder
Contributor III
  • 0 kudos

Have you tried to tell MLFlow to look for models in UC? mlflow.set_registry_uri("databricks-uc") Edit: never mind I see you have already. It shouldn't do/search for anything on DBFS anymore when setting this option so it is a bit strange. Shared clus...

  • 0 kudos
1 More Replies
johnp
by New Contributor III
  • 199 Views
  • 4 replies
  • 1 kudos

cluster sharing between different notebooks

I have two structured streaming notebooks running continuously for anomaly detection. Both notebooks import the same python module to mount the Azure blob storage, but each has its own container.  Each notebook runs well when it has its own cluster. ...

  • 199 Views
  • 4 replies
  • 1 kudos
Latest Reply
Rishabh_Tiwari
Community Manager
  • 1 kudos

Hi @johnp , Thank you for reaching out to our community! We're here to help you.  To ensure we provide you with the best support, could you please take a moment to review the response and choose the one that best answers your question? Your feedback ...

  • 1 kudos
3 More Replies
Sandhya1
by New Contributor
  • 1470 Views
  • 3 replies
  • 0 kudos

Attribute based access control in Unity catalog

Can I start using Attribute based access control ? Is it available now?

  • 1470 Views
  • 3 replies
  • 0 kudos
Latest Reply
Patricckk
New Contributor
  • 0 kudos

Hi, I want to use Attributed-Based Access Control, but I cannot find the option to create rules in my catalog. Is it already available in public preview?

  • 0 kudos
2 More Replies
skelchtermans
by New Contributor II
  • 2043 Views
  • 4 replies
  • 0 kudos

Resolved! databricks-cli

Hello! I am trying to use the databricks asset bundles through the webui on a databricks compute cluster. However to use this I need the databricks-cli library. I tried to install it on a cluster like described in the documentation using the curl com...

  • 2043 Views
  • 4 replies
  • 0 kudos
Latest Reply
skelchtermans
New Contributor II
  • 0 kudos

Thank you for your help! I read over the part of the runtime of your cluster which has to be 15.0 or more in the documentation you linked. I checked and my compute was still on a LTS 14.3 runtime version, which was the cause.

  • 0 kudos
3 More Replies
migq2
by New Contributor III
  • 142 Views
  • 2 replies
  • 0 kudos

Cannot log SparkML model to Unity Catalog due to missing output signature

I am training Spark ML model (concretely a SynapseML LightGBM ) in Databricks using mlflow and autologWhen I try to register my model in Unity catalog I get the following error:  MlflowException: Model passed for registration contained a signature th...

  • 142 Views
  • 2 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hi @migq2, Could you check if you are using the latest version of the MLflow Python client by running pip install --upgrade mlflow in your Databricks Notebook?

  • 0 kudos
1 More Replies
Rexe
by New Contributor
  • 180 Views
  • 1 replies
  • 0 kudos

TypeError: float() argument must be a string or a number, not 'StepArtifact'?

How to get the content of a returned variable in zenml without having this error:TypeError: float() argument must be a string or a number, not 'StepArtifact'?

  • 180 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hi @Rexe, First, verify the data type of the variable you’re trying to convert. If it’s a StepArtifact.You’ll need to extract relevant information before converting it into a float.

  • 0 kudos
rahuja
by New Contributor III
  • 313 Views
  • 3 replies
  • 0 kudos

Accessing Unity Catalog's MLFlow model registry from outside Databricks

Hello EveryoneWe are integrating Unity Catalog in our Organisation's Databricks. In our case we are planning to move our inference from Databricks to Kubernetes. In order to make the inference code use the latest registered model we need to query the...

  • 313 Views
  • 3 replies
  • 0 kudos
Latest Reply
p4pratikjain
Contributor
  • 0 kudos

I have used glue in the past to score models that are registered in Databricks mlflow registry. You need to configure MLFlow on Kubernetes to access your model registry.You can use something like this - https://docs.databricks.com/en/mlflow/access-ho...

  • 0 kudos
2 More Replies
datastones
by New Contributor II
  • 228 Views
  • 2 replies
  • 0 kudos

Resolved! Deployment as code pattern with double training effort?

Hi everybody, I have a question re: the deployment as code pattern on databricks. I found and watched a great demo here: https://www.youtube.com/watch?v=JApPzAnbfPIMy question is, in the case where I can get read access to prod data in dev env, the d...

  • 228 Views
  • 2 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hi @datastones, There are a couple of ways to address the redundant model retraining when using the deployment as code pattern on Databricks: Use the "deploy models" paradigm instead of "deploy code" In this approach, you develop and train the model ...

  • 0 kudos
1 More Replies
Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!

Labels