- 2175 Views
- 2 replies
- 0 kudos
Update model serving endpoint
Hi all,I've been able to create a model serving endpoint through the api, following the docs, but then when trying to update the version, I get the following error:'{"error_code":"RESOURCE_ALREADY_EXISTS","message":"Endpoint with name \'ml-project\' ...
- 2175 Views
- 2 replies
- 0 kudos
- 0 kudos
Folks, Alternate way you can also deploy the models in serving layer with different versions. Though I am using mLflow. You may also refer to the below link if it its helpful How to Quickly Deploy, Test & Manage ML Models as REST Endpoints with Datab...
- 0 kudos
- 6447 Views
- 6 replies
- 0 kudos
TypeError: 'JavaPackage' object is not callable
Hi Team,I am facing issue with above error while I am trying to do BERT embeddings, by specifying the model path and it is giving error while downloading the model.spark version is 3.3.0Can any one of you help me on this?
- 6447 Views
- 6 replies
- 0 kudos
- 0 kudos
please give error detail.i think you need add some Maven package, like https://community.databricks.com/t5/machine-learning/synapse-ml-typeerror-javapackage-object-is-not-callable/td-p/58897
- 0 kudos
- 2092 Views
- 1 replies
- 0 kudos
Synapse ML - TypeError: 'JavaPackage' object is not callable
from synapse.ml.lightgbm import *LightGBMRegressor()gives me TypeError: 'JavaPackage' object is not callableDBR 8.2 (includes Apache Spark 3.1.1, Scala 2.12)
- 2092 Views
- 1 replies
- 0 kudos
- 0 kudos
You need install Maven package `com.microsoft.azure:synapseml_2.12:1.0.2`https://microsoft.github.io/SynapseML/docs/Get%20Started/Install%20SynapseML/#databricks
- 0 kudos
- 4279 Views
- 3 replies
- 0 kudos
org.apache.spark.SparkException: Job aborted due to stage failure during Model Training
org.apache.spark.SparkException: Job aborted due to stage failure: Could not recover from a failed barrier ResultStage. Most recent failure reason: Stage failed because barrier task ResultTask(160, 13) finished unsuccessfully.
- 4279 Views
- 3 replies
- 0 kudos
- 7861 Views
- 4 replies
- 2 kudos
Resolved! Error when accessing rdd of DataFrame
I need to run this kind of code: from pyspark.sql import SparkSession import pandas as pd # Create a Spark session spark = SparkSession.builder.appName("example").getOrCreate() # Sample data data = [("Alice", 1), ("Bob", 2), ("Charlie", 3), ("David...
- 7861 Views
- 4 replies
- 2 kudos
- 2 kudos
I found a good solution that works both locally and in the cloud. Copy pasting the code in case it helps someone.This is the higher level function in charge of partitioning the data and sending the data and the function fn to each node. def decrypt_d...
- 2 kudos
- 1446 Views
- 0 replies
- 0 kudos
How to use mlflow to log a composite estimator (multiple pipes) and then deploy it as rest endpoint
Hello,I am trying to deploy a composite estimator as single model, by logging the run with mlflow and registering the model.Can anyone help with how this can be done? This estimator contains different chains-text: data- tfidf- svm- svm.decision_funct...
- 1446 Views
- 0 replies
- 0 kudos
- 5380 Views
- 7 replies
- 1 kudos
Getting Permission Denied on model
while creating service endpoint , getting permission denied error. Need help how to provide the permission.
- 5380 Views
- 7 replies
- 1 kudos
- 1 kudos
@Debayan I managed to solve the issue using databricks sdk library. From UI it was failing with the same error as mentioned by @BalaRamesh
- 1 kudos
- 3233 Views
- 5 replies
- 0 kudos
Cant access path for Shared Access Mode Cluster
Hi! I was able to successfully download and run selenium on both single and no isolation mode clusters. But the shared cluster do not seem to have permission to access the path of drivers needed such as chrome and chromedriver.1) what is the general ...
- 3233 Views
- 5 replies
- 0 kudos
- 0 kudos
Hi, Is the cluster UC enabled? Also, what are the types of the drivers (chrome and chromedriver) ?
- 0 kudos
- 3722 Views
- 2 replies
- 0 kudos
Serving endpoints: model server failed to load the model: the file bash was not found: uknown
While trying to create a serving endpoint with my custom model, I get a "Failed" state:Model server failed to load the model. Please see service logs for more information.The service logs show the following:Container failed with: failed to create con...
- 3722 Views
- 2 replies
- 0 kudos
- 0 kudos
I have faced the similar issue. still didn't find the right solution. In my case, the below is the error trace i found from service logs. Not sure where the issue could be"An error occurred while loading the model. You haven't configured the CLI yet!...
- 0 kudos
- 2113 Views
- 1 replies
- 0 kudos
Databricks OpenAI Integration Issue
Facing challenges in leveraging Databricks for serving, logging, and monitoring OpenAI usage within an Azure environment. Specifically, encountering issues with Inference Tables not being enabled in the UI when creating serving endpoints with externa...
- 2113 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi, In addition to the previous message, you can refer to https://learn.microsoft.com/en-us/azure/databricks/large-language-models/ai-generate-text-example.
- 0 kudos
- 1986 Views
- 3 replies
- 1 kudos
Unable to distribute the workload to different worker
Hello Team, I am unable to distribute the workload to databricks different worker while using the hugging face GPT2 LLM model. Jobs always use the 1 node even though we have the min and max worker node setting with 2. Appreciate if anyone can share a...
- 1986 Views
- 3 replies
- 1 kudos
- 1 kudos
Hello, We have around between 5k to 10K transcript files available in the ADLS gen 2 and we are using hugging face gpt2 model to train and server the model and expecting to pass the workload to different cluster nodes while serving the LLM model and ...
- 1 kudos
- 2280 Views
- 0 replies
- 0 kudos
using openai Api in Databricks without iterating rows
Hi to everyone,I have a delta table with a column 'comment' I would like to add a new column 'sentiment', and I would like to calculate it using openai API.I already know how to create a databricks endpoint to an external model and how to use it (us...
- 2280 Views
- 0 replies
- 0 kudos
- 4328 Views
- 3 replies
- 6 kudos
Resolved! Vector Search Index not provisioning
I am trying to deploy a Vector Search Index using both the UI and the Python VectorSearchClient. In both cases the command is successful but in the Catalog Explorer the newly created index stalls with the status 'Provisioning Index' for hours. Previo...
- 4328 Views
- 3 replies
- 6 kudos
- 10257 Views
- 13 replies
- 6 kudos
Resolved! Can't Run an AutoML Experiment Because Button is Greyed Out
I am trying to run an AutoML experiment but the button stays greyed out no matter what I do. I've tried different cluster configurations, different datasets, even blew away the instance in Azure and re-created it across two different Azure accounts s...
- 10257 Views
- 13 replies
- 6 kudos
- 3164 Views
- 4 replies
- 0 kudos
How do I distribute machine learning process in my spark data frame
Hi,I'm trying to use around 5 numerical features on 3.5 million rows to train and test my model with a spark data frame.My cluster has 60 nodes available but is only using 2. How can I distribute the process or make it for efficient and faster.My cod...
- 3164 Views
- 4 replies
- 0 kudos
- 0 kudos
@mohaimen_syed - can you please try using pyspark.ml implementation of randomForestClassifier instead of sklearn and see if it works. Below is an example - https://github.com/apache/spark/blob/master/examples/src/main/python/ml/random_forest_classif...
- 0 kudos
