cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results for 
Search instead for 
Did you mean: 
Data + AI Summit 2024 - Data Science & Machine Learning

Forum Posts

tessaickx
by New Contributor III
  • 1945 Views
  • 2 replies
  • 0 kudos

Serving endpoints: model server failed to load the model: the file bash was not found: uknown

While trying to create a serving endpoint with my custom model, I get a "Failed" state:Model server failed to load the model. Please see service logs for more information.The service logs show the following:Container failed with: failed to create con...

  • 1945 Views
  • 2 replies
  • 0 kudos
Latest Reply
ravi-malipeddi
New Contributor II
  • 0 kudos

I have faced the similar issue. still didn't find the right solution. In my case, the below is the error trace i found from service logs. Not sure where the issue could be"An error occurred while loading the model. You haven't configured the CLI yet!...

  • 0 kudos
1 More Replies
pablobd
by Contributor
  • 1417 Views
  • 2 replies
  • 1 kudos

Resolved! Model Serving Endpoint Creation through API

Hello,I am trying to create a model serving endpoint via the API as explained here: https://docs.databricks.com/api/workspace/servingendpoints/createI created a trusted IAM role with access to DynamoDB for the feature store. I try to use this field,"...

  • 1417 Views
  • 2 replies
  • 1 kudos
Latest Reply
pablobd
Contributor
  • 1 kudos

Thanks @Debayan - this article helped

  • 1 kudos
1 More Replies
leelee3000
by New Contributor III
  • 1183 Views
  • 2 replies
  • 1 kudos

Databricks OpenAI Integration Issue

Facing challenges in leveraging Databricks for serving, logging, and monitoring OpenAI usage within an Azure environment. Specifically, encountering issues with Inference Tables not being enabled in the UI when creating serving endpoints with externa...

  • 1183 Views
  • 2 replies
  • 1 kudos
Latest Reply
Debayan
Esteemed Contributor III
  • 1 kudos

Hi, In addition to the previous message, you can refer to https://learn.microsoft.com/en-us/azure/databricks/large-language-models/ai-generate-text-example. 

  • 1 kudos
1 More Replies
BR_DatabricksAI
by Contributor
  • 1145 Views
  • 3 replies
  • 1 kudos

Unable to distribute the workload to different worker

Hello Team, I am unable to distribute the workload to databricks different worker while using the hugging face GPT2 LLM model. Jobs always use the 1 node even though we have the min and max worker node setting with 2. Appreciate if anyone can share a...

  • 1145 Views
  • 3 replies
  • 1 kudos
Latest Reply
BR_DatabricksAI
Contributor
  • 1 kudos

Hello, We have around between 5k to 10K transcript files available in the ADLS gen 2 and we are using hugging face gpt2 model to train and server the model and expecting to pass the workload to different cluster nodes while serving the LLM model and ...

  • 1 kudos
2 More Replies
YanivShani
by New Contributor
  • 872 Views
  • 2 replies
  • 0 kudos

inference table not working

Hi,I'm trying to enable inference table for my llama_2_7b_hf serving endpoint, however I'm getting the following error:"Inference tables are currently not available with accelerated inference." Anyone one have an idea on how to overcome this issue? C...

  • 872 Views
  • 2 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your question?This...

  • 0 kudos
1 More Replies
pablobd
by Contributor
  • 751 Views
  • 2 replies
  • 0 kudos

Save ML model in the registry fails

Using `mlflow.pyfunc.log_model` to save a model in the model registry fails with the following error: `PicklingError: Can't pickle <built-in function input>: it's not the same object as builtins.input`I've reproduced it locally and got to the conclus...

  • 751 Views
  • 2 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your question?This...

  • 0 kudos
1 More Replies
larsr
by New Contributor II
  • 1009 Views
  • 2 replies
  • 0 kudos

serving-endpoints: setting non secret environment variables

I want to set environment variables for serving-endpoints that are not being read as secrets by using the DB API. As an example I want to set the OPENAI_API_BASE for a LangChain model. Is this possible?

  • 1009 Views
  • 2 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your question?This...

  • 0 kudos
1 More Replies
G-M
by Contributor
  • 2379 Views
  • 3 replies
  • 6 kudos

Resolved! Vector Search Index not provisioning

I am trying to deploy a Vector Search Index using both the UI and the Python VectorSearchClient. In both cases the command is successful but in the Catalog Explorer the newly created index stalls with the status 'Provisioning Index' for hours. Previo...

  • 2379 Views
  • 3 replies
  • 6 kudos
Latest Reply
seba_kjal
New Contributor II
  • 6 kudos

Thanks, I didn't change anything either and now is working.

  • 6 kudos
2 More Replies
DanMaycock
by New Contributor III
  • 5362 Views
  • 14 replies
  • 6 kudos

Resolved! Can't Run an AutoML Experiment Because Button is Greyed Out

I am trying to run an AutoML experiment but the button stays greyed out no matter what I do. I've tried different cluster configurations, different datasets, even blew away the instance in Azure and re-created it across two different Azure accounts s...

Machine Learning
AutoML
Databricks
machine learning
  • 5362 Views
  • 14 replies
  • 6 kudos
Latest Reply
oleclercq
New Contributor II
  • 6 kudos

Thanks. AutoML is back on

  • 6 kudos
13 More Replies
mohaimen_syed
by New Contributor III
  • 1776 Views
  • 4 replies
  • 0 kudos

How do I distribute machine learning process in my spark data frame

Hi,I'm trying to use around 5 numerical features on 3.5 million rows to train and test my model with a spark data frame.My cluster has 60 nodes available but is only using 2. How can I distribute the process or make it for efficient and faster.My cod...

  • 1776 Views
  • 4 replies
  • 0 kudos
Latest Reply
shan_chandra
Esteemed Contributor
  • 0 kudos

@mohaimen_syed  - can you please try using pyspark.ml implementation of randomForestClassifier instead of sklearn and see if it works. Below is an example - https://github.com/apache/spark/blob/master/examples/src/main/python/ml/random_forest_classif...

  • 0 kudos
3 More Replies
Hypatia
by New Contributor
  • 620 Views
  • 1 replies
  • 0 kudos

AutoMl experiment not start

Hi!Last week I was able to perform some experiments in autoML. Today even after completing all the values in the form, the start button stay greyed. (I try train with the same dataset and parameters that last week train ok, with no luck) have any con...

  • 620 Views
  • 1 replies
  • 0 kudos
Latest Reply
shan_chandra
Esteemed Contributor
  • 0 kudos

@Hypatia - can you please detailed out the issue further? What was changed between previous good run and now when entering the details on AutoML experiment page?

  • 0 kudos
David_K93
by Contributor
  • 4567 Views
  • 5 replies
  • 3 kudos

Issues running Chroma function from Dolly Demo

Hello,I'm working through the Dolly demo that was released a few days ago. There are a few lines of code that I have had to alter in order to make it work in my environment. However, I've been trying to run similarity_search() on the generated Chroma...

image
  • 4567 Views
  • 5 replies
  • 3 kudos
Latest Reply
ClementBM
New Contributor II
  • 3 kudos

As written in the command output when pip installing the python packages, you should then run a `dbutils.library.restartPython()`. Please try the following commands:%pip install -U transformers langchain chromadb accelerate bitsandbytesdbutils.librar...

  • 3 kudos
4 More Replies
KWB_LaWe
by New Contributor II
  • 883 Views
  • 1 replies
  • 3 kudos

Resolved! Not possible to start AutoML experiment because start button not clickable

Hey everyone,we were trying to start a new AutoML experiment but the 'Start AutoML' button won't activate. We've also noticed that the number of selected trainingset columns does'nt change even if some columns are unselected.Has anybody encountered t...

  • 883 Views
  • 1 replies
  • 3 kudos
Latest Reply
AnaMedeiros
New Contributor III
  • 3 kudos

This seems to be a Databricks-wide problem. Please see related ticket on https://community.databricks.com/t5/machine-learning/can-t-run-an-automl-experiment-because-button-is-greyed-out/td-p/57388 

  • 3 kudos
zsucic1
by New Contributor III
  • 1774 Views
  • 2 replies
  • 0 kudos

Model Serving via Unity Catalog

Hi everyone! Has anyone successfully deployed a model saved on Unity Catalog to Model Serving? I get:Event Log: Served model creation failed for served model 'model', config version 15. Error message: Container creation failed. Please see build logs ...

  • 1774 Views
  • 2 replies
  • 0 kudos
Latest Reply
sachinw
New Contributor II
  • 0 kudos

We are facing the same issue.

  • 0 kudos
1 More Replies
Avi711
by New Contributor III
  • 3950 Views
  • 3 replies
  • 5 kudos

Resolved! Access denied error to S3 bucket while running Kinesis spark streaming.

I get this below error while trying to simulate kinesis streams as mentioned in Databricks documentation at https://docs.databricks.com/getting-started/streaming.htmlError:java.nio.file.AccessDeniedException:Amazon S3; Status Code: 403; Error Code: A...

  • 3950 Views
  • 3 replies
  • 5 kudos
Latest Reply
jsuarezg
New Contributor II
  • 5 kudos

If you do spark.sparkContext._jsc.hadoopConfiguration().set("fs.s3a.access.key", AWS_ACCESS_KEY_ID) + secret with any other secret that has less access than your default one this sometimes happens, so running those commands but with your normal secre...

  • 5 kudos
2 More Replies
Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!

Labels