- 9668 Views
- 7 replies
- 1 kudos
Getting Permission Denied on model
while creating service endpoint , getting permission denied error. Need help how to provide the permission.
- 9668 Views
- 7 replies
- 1 kudos
- 1 kudos
@Debayan I managed to solve the issue using databricks sdk library. From UI it was failing with the same error as mentioned by @BalaRamesh
- 1 kudos
- 5401 Views
- 5 replies
- 0 kudos
Cant access path for Shared Access Mode Cluster
Hi! I was able to successfully download and run selenium on both single and no isolation mode clusters. But the shared cluster do not seem to have permission to access the path of drivers needed such as chrome and chromedriver.1) what is the general ...
- 5401 Views
- 5 replies
- 0 kudos
- 0 kudos
Hi, Is the cluster UC enabled? Also, what are the types of the drivers (chrome and chromedriver) ?
- 0 kudos
- 5506 Views
- 2 replies
- 0 kudos
Serving endpoints: model server failed to load the model: the file bash was not found: uknown
While trying to create a serving endpoint with my custom model, I get a "Failed" state:Model server failed to load the model. Please see service logs for more information.The service logs show the following:Container failed with: failed to create con...
- 5506 Views
- 2 replies
- 0 kudos
- 0 kudos
I have faced the similar issue. still didn't find the right solution. In my case, the below is the error trace i found from service logs. Not sure where the issue could be"An error occurred while loading the model. You haven't configured the CLI yet!...
- 0 kudos
- 3131 Views
- 1 replies
- 0 kudos
Databricks OpenAI Integration Issue
Facing challenges in leveraging Databricks for serving, logging, and monitoring OpenAI usage within an Azure environment. Specifically, encountering issues with Inference Tables not being enabled in the UI when creating serving endpoints with externa...
- 3131 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi, In addition to the previous message, you can refer to https://learn.microsoft.com/en-us/azure/databricks/large-language-models/ai-generate-text-example.
- 0 kudos
- 3548 Views
- 3 replies
- 1 kudos
Unable to distribute the workload to different worker
Hello Team, I am unable to distribute the workload to databricks different worker while using the hugging face GPT2 LLM model. Jobs always use the 1 node even though we have the min and max worker node setting with 2. Appreciate if anyone can share a...
- 3548 Views
- 3 replies
- 1 kudos
- 1 kudos
Hello, We have around between 5k to 10K transcript files available in the ADLS gen 2 and we are using hugging face gpt2 model to train and server the model and expecting to pass the workload to different cluster nodes while serving the LLM model and ...
- 1 kudos
- 2936 Views
- 0 replies
- 0 kudos
using openai Api in Databricks without iterating rows
Hi to everyone,I have a delta table with a column 'comment' I would like to add a new column 'sentiment', and I would like to calculate it using openai API.I already know how to create a databricks endpoint to an external model and how to use it (us...
- 2936 Views
- 0 replies
- 0 kudos
- 7213 Views
- 3 replies
- 6 kudos
Resolved! Vector Search Index not provisioning
I am trying to deploy a Vector Search Index using both the UI and the Python VectorSearchClient. In both cases the command is successful but in the Catalog Explorer the newly created index stalls with the status 'Provisioning Index' for hours. Previo...
- 7213 Views
- 3 replies
- 6 kudos
- 18418 Views
- 13 replies
- 6 kudos
Resolved! Can't Run an AutoML Experiment Because Button is Greyed Out
I am trying to run an AutoML experiment but the button stays greyed out no matter what I do. I've tried different cluster configurations, different datasets, even blew away the instance in Azure and re-created it across two different Azure accounts s...
- 18418 Views
- 13 replies
- 6 kudos
- 5459 Views
- 4 replies
- 0 kudos
How do I distribute machine learning process in my spark data frame
Hi,I'm trying to use around 5 numerical features on 3.5 million rows to train and test my model with a spark data frame.My cluster has 60 nodes available but is only using 2. How can I distribute the process or make it for efficient and faster.My cod...
- 5459 Views
- 4 replies
- 0 kudos
- 0 kudos
@mohaimen_syed - can you please try using pyspark.ml implementation of randomForestClassifier instead of sklearn and see if it works. Below is an example - https://github.com/apache/spark/blob/master/examples/src/main/python/ml/random_forest_classif...
- 0 kudos
- 1745 Views
- 1 replies
- 0 kudos
AutoMl experiment not start
Hi!Last week I was able to perform some experiments in autoML. Today even after completing all the values in the form, the start button stay greyed. (I try train with the same dataset and parameters that last week train ok, with no luck) have any con...
- 1745 Views
- 1 replies
- 0 kudos
- 0 kudos
@Hypatia - can you please detailed out the issue further? What was changed between previous good run and now when entering the details on AutoML experiment page?
- 0 kudos
- 14866 Views
- 5 replies
- 3 kudos
Issues running Chroma function from Dolly Demo
Hello,I'm working through the Dolly demo that was released a few days ago. There are a few lines of code that I have had to alter in order to make it work in my environment. However, I've been trying to run similarity_search() on the generated Chroma...
- 14866 Views
- 5 replies
- 3 kudos
- 3 kudos
As written in the command output when pip installing the python packages, you should then run a `dbutils.library.restartPython()`. Please try the following commands:%pip install -U transformers langchain chromadb accelerate bitsandbytesdbutils.librar...
- 3 kudos
- 2910 Views
- 1 replies
- 3 kudos
Resolved! Not possible to start AutoML experiment because start button not clickable
Hey everyone,we were trying to start a new AutoML experiment but the 'Start AutoML' button won't activate. We've also noticed that the number of selected trainingset columns does'nt change even if some columns are unselected.Has anybody encountered t...
- 2910 Views
- 1 replies
- 3 kudos
- 3 kudos
This seems to be a Databricks-wide problem. Please see related ticket on https://community.databricks.com/t5/machine-learning/can-t-run-an-automl-experiment-because-button-is-greyed-out/td-p/57388
- 3 kudos
- 3964 Views
- 1 replies
- 0 kudos
inference table not working
Hi,I'm trying to enable inference table for my llama_2_7b_hf serving endpoint, however I'm getting the following error:"Inference tables are currently not available with accelerated inference." Anyone one have an idea on how to overcome this issue? C...
- 3964 Views
- 1 replies
- 0 kudos
- 0 kudos
From the information you provided, it seems like you are trying to enable inference tables for an existing endpoint. However, the error message suggests that this feature may not be supported with accelerated inference.If you have previously disabled...
- 0 kudos
- 3667 Views
- 1 replies
- 0 kudos
Model Serving via Unity Catalog
Hi everyone! Has anyone successfully deployed a model saved on Unity Catalog to Model Serving? I get:Event Log: Served model creation failed for served model 'model', config version 15. Error message: Container creation failed. Please see build logs ...
- 3667 Views
- 1 replies
- 0 kudos
- 0 kudos
We are facing the same issue.
- 0 kudos
- 7518 Views
- 3 replies
- 5 kudos
Resolved! Access denied error to S3 bucket while running Kinesis spark streaming.
I get this below error while trying to simulate kinesis streams as mentioned in Databricks documentation at https://docs.databricks.com/getting-started/streaming.htmlError:java.nio.file.AccessDeniedException:Amazon S3; Status Code: 403; Error Code: A...
- 7518 Views
- 3 replies
- 5 kudos
- 5 kudos
If you do spark.sparkContext._jsc.hadoopConfiguration().set("fs.s3a.access.key", AWS_ACCESS_KEY_ID) + secret with any other secret that has less access than your default one this sometimes happens, so running those commands but with your normal secre...
- 5 kudos
