- 1152 Views
- 1 replies
- 3 kudos
Resolved! Not possible to start AutoML experiment because start button not clickable
Hey everyone,we were trying to start a new AutoML experiment but the 'Start AutoML' button won't activate. We've also noticed that the number of selected trainingset columns does'nt change even if some columns are unselected.Has anybody encountered t...
- 1152 Views
- 1 replies
- 3 kudos
- 3 kudos
This seems to be a Databricks-wide problem. Please see related ticket on https://community.databricks.com/t5/machine-learning/can-t-run-an-automl-experiment-because-button-is-greyed-out/td-p/57388
- 3 kudos
- 2131 Views
- 2 replies
- 0 kudos
Model Serving via Unity Catalog
Hi everyone! Has anyone successfully deployed a model saved on Unity Catalog to Model Serving? I get:Event Log: Served model creation failed for served model 'model', config version 15. Error message: Container creation failed. Please see build logs ...
- 2131 Views
- 2 replies
- 0 kudos
- 4491 Views
- 3 replies
- 5 kudos
Resolved! Access denied error to S3 bucket while running Kinesis spark streaming.
I get this below error while trying to simulate kinesis streams as mentioned in Databricks documentation at https://docs.databricks.com/getting-started/streaming.htmlError:java.nio.file.AccessDeniedException:Amazon S3; Status Code: 403; Error Code: A...
- 4491 Views
- 3 replies
- 5 kudos
- 5 kudos
If you do spark.sparkContext._jsc.hadoopConfiguration().set("fs.s3a.access.key", AWS_ACCESS_KEY_ID) + secret with any other secret that has less access than your default one this sometimes happens, so running those commands but with your normal secre...
- 5 kudos
- 1469 Views
- 2 replies
- 2 kudos
DLT UC for ML use cases
Hi Team,we have use case to run ML use case using DLT UC, we are facing library issues Error: INVALID ARGUMENT: no module named ‘importlib_metadata’we installed them manually by passing import in notebooks, but we have lot of missing libraries and we...
- 1469 Views
- 2 replies
- 2 kudos
- 2 kudos
@Kaniz_Fatma do we have any support of shared cluster for ML in near roadmap please
- 2 kudos
- 769 Views
- 1 replies
- 0 kudos
Unable to create an endpoint serving for transformer model (hugginface)
Hello I am trying to create a text classification model based on this blog https://www.databricks.com/blog/rapid-nlp-development-databricks-delta-and-transformers and the notebook accelerator. I just changed the model to take a french bert but i cann...
- 769 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello Anasse, the LLM landscape has changed drastically since that blog was released in mid-2022. We have new, updated guidance which you can find here (make sure you check out the Next Steps section for the RAG Demo link as well). Additionally, if y...
- 0 kudos
- 1512 Views
- 2 replies
- 1 kudos
Custom deployment of LLM model in Databricks
Can we deploy our own Custom LLM model in Databricks? If anyone has any material or link, please share with me.
- 1512 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @BR_DatabricksAI, Yes, you can deploy your own custom Large Language Model (LLM) in Databricks. Here are some key points: Databricks Model Serving: Databricks Model Serving supports the deployment of open-source or your own custom AI models o...
- 1 kudos
- 1744 Views
- 3 replies
- 2 kudos
Databricks Observability - Sample / Pre-defined queries / notebooks for capturing the needed metrics from the Overwatch data model.
We are exploring Overwatch for data bricks environment monitoring. While we understand that different types of metrics (Audit and cluster) can be fetched from the overwatch data model at an high level. Are there any pre-defined queries / jump start n...
- 1744 Views
- 3 replies
- 2 kudos
- 2 kudos
Overwatch has 44+ prebuilt Dashboards you can get started just ask for it in https://github.com/databrickslabs/overwatch as an user question you will get an response.
- 2 kudos
- 993 Views
- 1 replies
- 0 kudos
how to use databricks foundation models outside databricks environment?
i want to use below code outside databricks environment without using cluster .getting issue while i am using chat_model.predict().how to authenticate this outside databricks or any other way to this? # Test Databricks Foundation LLM modelfrom langc...
- 993 Views
- 1 replies
- 0 kudos
- 0 kudos
Are you perhaps talking about Model Serving ?https://docs.databricks.com/en/machine-learning/model-serving/index.html#requirementsThis is how you configure it https://docs.databricks.com/en/machine-learning/model-serving/create-manage-serving-endpoin...
- 0 kudos
- 1746 Views
- 2 replies
- 1 kudos
Resolved! MLFlow Output Signature
I want to define the output of a MLFlow model to include a dictionary of string to float. I did this, but it doesn't work. Do you know if it's possible at all? from mlflow.types.schema import Schema, ColSpec output_schema = Schema([ ColSpec("diction...
- 1746 Views
- 2 replies
- 1 kudos
- 1 kudos
Solved with the json module that converts the dict into string, thanks! import jsonjson.dumps(...)
- 1 kudos
- 1395 Views
- 1 replies
- 0 kudos
Querying databricks vector search index outside databricks environment
I want to query my created vector search index from outside of databricks environment . Is there any way to do it?
- 1395 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Onkar01, There are a few ways to access your vector search index from outside of the Databricks environment. One way is to use the Direct Vector Access Index feature, which lets you provide your embedding vectors in a Delta table and create an...
- 0 kudos
- 7414 Views
- 1 replies
- 1 kudos
Resolved! Vector Search Indexes do not create
Hello,Am trying to create a Vector Search Index but never completes, stuck on "Provisioning pipeline compute". I am using Databricks on AWS Sydney.Looks like the DLT pipeline is failing and retrying and fails on "WAITING_FOR_RESOURCES."Has anyone ha...
- 7414 Views
- 1 replies
- 1 kudos
- 1 kudos
Ok, this is closed with the assistance of Gurpreet. My UC Metastore didn't have an S3 bucket associated which it turned out was required for the vector search index. Adding the S3 bucket to the Metastore and re-running the pipeline resolved.Thanks!
- 1 kudos
- 6469 Views
- 4 replies
- 1 kudos
Resolved! Shap Values for predictions from registered model
I have saved a model in the model registry using MLFlow. How can I find the shap values for this model once I have generated predictions in batch mode? Shap tree explainer does not support the mlflow pyfunc model type. When I use mlflow.shap.log_exp...
- 6469 Views
- 4 replies
- 1 kudos
- 1 kudos
Thank you so much for this kind of valuable post its amazing post it may helpful for each visitors. For more information go through my websites here:peacocktv.com/tv | peacocktv.com/tv/xbox
- 1 kudos
- 332 Views
- 0 replies
- 0 kudos
Streaming inference with Delta Live Tables for a model registered in Unity Catalog
Hi there, I'm trying to run a streaming inference with Delta Live Tables with tables and a model registered in Unity Catalog, but it fails for unclear reasons. The DLT pipeline is based on a notebook, the channel is set to 'Preview', presumably runni...
- 332 Views
- 0 replies
- 0 kudos
- 1452 Views
- 1 replies
- 0 kudos
Resolved! Visualizations not displaying
With a copy of notebook https://github.com/JohnSnowLabs/spark-nlp-workshop/blob/master/open-source-nlp/03.0.SparkNLP_Pretrained_Models.ipynb imported into Databricks, there's a lovely visualization created by the cell that you can locate by searching...
- 1452 Views
- 1 replies
- 0 kudos
- 0 kudos
Here's a solution: use a parameter (here, `return_html = True`) to get an HTML object back, and then call `displayHTML` to actually display the object.from sparknlp_display import NerVisualizer visualiser = NerVisualizer() for i in text_list: ...
- 0 kudos
- 2967 Views
- 1 replies
- 0 kudos
Resolved! Served model endpoint creation failed and not able to see build log
Dear Databricks Support Team,I am currently encountering an issue while attempting to serve a model using your platform. Whenever I initiate the model serving process, it fails, and I am unable to successfully deploy my model.Additionally, I am facin...
- 2967 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @hardik, I understand that you’re experiencing difficulties with model serving and deployment. Let’s troubleshoot this issue step by step. Model Serving with Databricks:Databricks offers Model Serving, which exposes MLflow machine learning models ...
- 0 kudos
