- 1100 Views
- 1 replies
- 2 kudos
Promote registered UC models using CLI
Hi,I am currently transitioning some of our MLops workflows to use models registered in Unity Catalog (UC) instead of the "normal" model registry. I am trying to follow the instructions on https://docs.gcp.databricks.com/en/machine-learning/manage-mo...
- 1100 Views
- 1 replies
- 2 kudos
- 2 kudos
@victorNilsson wrote:Hi,I am currently transitioning some of our MLops workflows to use models registered in Unity Catalog (UC) instead of the "normal" model registry. I am trying to follow the instructions on https://docs.gcp.databricks.com/en/machi...
- 2 kudos
- 7901 Views
- 2 replies
- 0 kudos
Lab for generative-ai-engineering-with-databricks.dbc doesn't work
It keeps on failing with this error:HTTPError: 503 Server Error: Service Unavailable for url: https://community.cloud.databricks.com/api/2.0/feature-store/feature-tables/search?max_results=200 Response from server: { 'error_code': 'TEMPORARILY_UNAVAI...
- 7901 Views
- 2 replies
- 0 kudos
- 0 kudos
Any update with this issue?@abhi-verma have you received some support?
- 0 kudos
- 607 Views
- 0 replies
- 1 kudos
Customizing class imbalance handling in databricks.automl
Hi Databricks! I'd like to make a feature request for end users to be able to customize class imbalance behavior in `databricks.automl`, specifically `databricks.automl.classify`. This public documentation describes the default procedure, but my team...
- 607 Views
- 0 replies
- 1 kudos
- 915 Views
- 1 replies
- 0 kudos
Bug: MLflow connection fails after 2d
Hi there, After exactly 2d of training, the following error is raised after an API call to MLflow: ValueError: Enum ErrorCode has no value defined for name '403' --------------------------------------------------------------------------- ValueError ...
- 915 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @Alex42 !The error message indicates that access is forbidden due to an expired access token. This occurs when a notebook or job runs for an extended period, exceeding the default 48-hour threshold set for security reasons. The Databricks acces...
- 0 kudos
- 2861 Views
- 2 replies
- 0 kudos
Deploy ML
How deploy a model using community account version?
- 2861 Views
- 2 replies
- 0 kudos
- 0 kudos
From your workspace page are you able to see the option to create Models?
- 0 kudos
- 1926 Views
- 4 replies
- 0 kudos
AssertionError Failed to create the catalog
getting this error when trying to setup the get-started-with-databricks-for-machine-learning LAB . Unity catalog is enabled. Validating the locally installed datasets: | listing local files...(0 seconds) | validation completed...(0 seconds total) C...
- 1926 Views
- 4 replies
- 0 kudos
- 0 kudos
EDIT: I found the issue in my Databricks metastore was that it did not have a default storage location set. The academy setup scripts don't explicitly set MANAGED LOCATION and therefore without a default location it fails.I tried to establish a defau...
- 0 kudos
- 1208 Views
- 1 replies
- 0 kudos
Does Databricks Container Services (DCS) support for GPU containers with Databricks Runtime 11.3 LTS and higher?
I have been trying to start a cluster using DCS with GPU containers (https://github.com/databricks/containers/tree/master/ubuntu/gpu), but was only successful with Databricks Runtime 10.4 LTS and lower. With Databricks Runtime 11.3 LTS and higher, I ...
- 1208 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @ppang ! Since you posted your question, the repository you shared has received an update, which includes the following warning: "Using conda in DCS images is no longer supported starting Databricks Runtime 9.0. We highly recommend users to ext...
- 0 kudos
- 1708 Views
- 1 replies
- 0 kudos
Generative AI
I am working on generative AI. Does Databricks offer databases for storing vector embeddings, if yes, how efficient are they.
- 1708 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @RA_DATA !Yes, Databricks provides the Databricks Vector Search solution, which is a vector database optimized for storing and retrieving embeddings. With Vector Search, you can create a vector search index from a Delta table, which includes em...
- 0 kudos
- 2337 Views
- 1 replies
- 0 kudos
RuntimeError: Expected to mark a variable ready only once error
I'm using a Single Node machine with g5-2x-large to fine tune a LLaMa-2 model. My Come Notebook runs very smoothly on Google Col but when I try to run it on `Databricks`, it throws me the exact error given below:RuntimeError: Expected to mark a varia...
- 2337 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @saleem_shady! Have you tried including the parameter ddp_find_unused_parameters=False in your TrainingArguments? Here's an example of how to include it: https://github.com/databricks/databricks-ml-examples/blob/master/llm-models/llamav2/llamav...
- 0 kudos
- 761 Views
- 1 replies
- 0 kudos
Specify extras of library in asset bundles yml file
Hello,I am using asset bundles to build, deploy, create a cluster and install a package in it. The package comes with some extra dependencies that I also want to include in the cluster. Do you know how to specify this extras in the databricks.yml fil...
- 761 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @pablobd! Have you tried declaring these additional dependencies of your wheel file before the wheel file itself? Here's an example snippet for clarification: resources: jobs: train: name: train-ml tasks: - task_key: train-ml ...
- 0 kudos
- 782 Views
- 3 replies
- 0 kudos
How to I select an 80/10/10 split when doing AutoML
Headline says it all. I am doing a regression and want to select a testvaltrain split that is not 60/20/20. Anyone know how to do this?
- 782 Views
- 3 replies
- 0 kudos
- 0 kudos
You'd need to put 80% of your data with the earliest timestamp, then 10% with another one and 10% with another.
- 0 kudos
- 887 Views
- 0 replies
- 1 kudos
Machine Learning Practitioner learning Plan Notebook demos
I am enrolled on the Machine Learning Practitioner learning Plan free version, I can't get the notebook demos to run on databricks community edition. How can I do the demo practices of these courses? Is there another alternative?
- 887 Views
- 0 replies
- 1 kudos
- 1254 Views
- 1 replies
- 0 kudos
Machine learning accuracy depends on execution plans
I'm using Databricks for a machine learning project -- a fairly standard text classification problem, where I want to use the description of an item (i.e. AXELTTNING KOLKERAMIK MM) to predict which of n product categories the item belongs to ('Bushin...
- 1254 Views
- 1 replies
- 0 kudos
- 0 kudos
that is weird.The regression algorithm should just do a prediction on a dataframe. Such a huge difference in accuracy seems very suspicious.I would test the algorithm on a reference dataset, for which you know the accuracy beforehand.Perhaps your tr...
- 0 kudos
- 2616 Views
- 3 replies
- 0 kudos
java.lang.ClassNotFoundException: com.johnsnowlabs.nlp.DocumentAssembler
I am trying to serve a pyspark model using an endpoint. I was able to load and register the model normally. I could also load that model and perform inference but while serving the model, I am getting the following error: [94fffqts54] ERROR StatusLog...
- 2616 Views
- 3 replies
- 0 kudos
- 0 kudos
I'm having the same problem and have tried various solutions with no luck. I found some potentially relevant information on the following link: https://www.johnsnowlabs.com/serving-spark-nlp-via-api-3-3-databricks-jobs-and-mlflow-serve-apis/ In the ...
- 0 kudos
- 1065 Views
- 1 replies
- 0 kudos
Notebook cell gets hung up but code completes
Have been running into an issue when running a pymc-marketing model in a Databricks notebook. The cell that fits the model gets hung up and the progress bar stops moving, however the code completes and dumps all needed output into a folder. After the...
- 1065 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Retired_mod , Thanks for the feedback here as well as on the other discussion forum. I've commented on your trouble shooting tips on that board. One thing to touch upon hereVerify that the output files are correct and contain the expected results...
- 0 kudos
