- 8392 Views
- 2 replies
- 0 kudos
Lab for generative-ai-engineering-with-databricks.dbc doesn't work
It keeps on failing with this error:HTTPError: 503 Server Error: Service Unavailable for url: https://community.cloud.databricks.com/api/2.0/feature-store/feature-tables/search?max_results=200 Response from server: { 'error_code': 'TEMPORARILY_UNAVAI...
- 8392 Views
- 2 replies
- 0 kudos
- 0 kudos
Any update with this issue?@abhi-verma have you received some support?
- 0 kudos
- 942 Views
- 0 replies
- 2 kudos
Customizing class imbalance handling in databricks.automl
Hi Databricks! I'd like to make a feature request for end users to be able to customize class imbalance behavior in `databricks.automl`, specifically `databricks.automl.classify`. This public documentation describes the default procedure, but my team...
- 942 Views
- 0 replies
- 2 kudos
- 1555 Views
- 1 replies
- 0 kudos
Bug: MLflow connection fails after 2d
Hi there, After exactly 2d of training, the following error is raised after an API call to MLflow: ValueError: Enum ErrorCode has no value defined for name '403' --------------------------------------------------------------------------- ValueError ...
- 1555 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @Alex42 !The error message indicates that access is forbidden due to an expired access token. This occurs when a notebook or job runs for an extended period, exceeding the default 48-hour threshold set for security reasons. The Databricks acces...
- 0 kudos
- 3130 Views
- 2 replies
- 0 kudos
Deploy ML
How deploy a model using community account version?
- 3130 Views
- 2 replies
- 0 kudos
- 0 kudos
From your workspace page are you able to see the option to create Models?
- 0 kudos
- 2797 Views
- 4 replies
- 0 kudos
AssertionError Failed to create the catalog
getting this error when trying to setup the get-started-with-databricks-for-machine-learning LAB . Unity catalog is enabled. Validating the locally installed datasets: | listing local files...(0 seconds) | validation completed...(0 seconds total) C...
- 2797 Views
- 4 replies
- 0 kudos
- 0 kudos
EDIT: I found the issue in my Databricks metastore was that it did not have a default storage location set. The academy setup scripts don't explicitly set MANAGED LOCATION and therefore without a default location it fails.I tried to establish a defau...
- 0 kudos
- 1602 Views
- 1 replies
- 0 kudos
Does Databricks Container Services (DCS) support for GPU containers with Databricks Runtime 11.3 LTS and higher?
I have been trying to start a cluster using DCS with GPU containers (https://github.com/databricks/containers/tree/master/ubuntu/gpu), but was only successful with Databricks Runtime 10.4 LTS and lower. With Databricks Runtime 11.3 LTS and higher, I ...
- 1602 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @ppang ! Since you posted your question, the repository you shared has received an update, which includes the following warning: "Using conda in DCS images is no longer supported starting Databricks Runtime 9.0. We highly recommend users to ext...
- 0 kudos
- 1956 Views
- 1 replies
- 0 kudos
Generative AI
I am working on generative AI. Does Databricks offer databases for storing vector embeddings, if yes, how efficient are they.
- 1956 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @RA_DATA !Yes, Databricks provides the Databricks Vector Search solution, which is a vector database optimized for storing and retrieving embeddings. With Vector Search, you can create a vector search index from a Delta table, which includes em...
- 0 kudos
- 2931 Views
- 1 replies
- 0 kudos
RuntimeError: Expected to mark a variable ready only once error
I'm using a Single Node machine with g5-2x-large to fine tune a LLaMa-2 model. My Come Notebook runs very smoothly on Google Col but when I try to run it on `Databricks`, it throws me the exact error given below:RuntimeError: Expected to mark a varia...
- 2931 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @saleem_shady! Have you tried including the parameter ddp_find_unused_parameters=False in your TrainingArguments? Here's an example of how to include it: https://github.com/databricks/databricks-ml-examples/blob/master/llm-models/llamav2/llamav...
- 0 kudos
- 1118 Views
- 1 replies
- 0 kudos
Specify extras of library in asset bundles yml file
Hello,I am using asset bundles to build, deploy, create a cluster and install a package in it. The package comes with some extra dependencies that I also want to include in the cluster. Do you know how to specify this extras in the databricks.yml fil...
- 1118 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @pablobd! Have you tried declaring these additional dependencies of your wheel file before the wheel file itself? Here's an example snippet for clarification: resources: jobs: train: name: train-ml tasks: - task_key: train-ml ...
- 0 kudos
- 1239 Views
- 3 replies
- 0 kudos
How to I select an 80/10/10 split when doing AutoML
Headline says it all. I am doing a regression and want to select a testvaltrain split that is not 60/20/20. Anyone know how to do this?
- 1239 Views
- 3 replies
- 0 kudos
- 0 kudos
You'd need to put 80% of your data with the earliest timestamp, then 10% with another one and 10% with another.
- 0 kudos
- 1282 Views
- 0 replies
- 1 kudos
Machine Learning Practitioner learning Plan Notebook demos
I am enrolled on the Machine Learning Practitioner learning Plan free version, I can't get the notebook demos to run on databricks community edition. How can I do the demo practices of these courses? Is there another alternative?
- 1282 Views
- 0 replies
- 1 kudos
- 1684 Views
- 1 replies
- 0 kudos
Machine learning accuracy depends on execution plans
I'm using Databricks for a machine learning project -- a fairly standard text classification problem, where I want to use the description of an item (i.e. AXELTTNING KOLKERAMIK MM) to predict which of n product categories the item belongs to ('Bushin...
- 1684 Views
- 1 replies
- 0 kudos
- 0 kudos
that is weird.The regression algorithm should just do a prediction on a dataframe. Such a huge difference in accuracy seems very suspicious.I would test the algorithm on a reference dataset, for which you know the accuracy beforehand.Perhaps your tr...
- 0 kudos
- 4170 Views
- 3 replies
- 0 kudos
java.lang.ClassNotFoundException: com.johnsnowlabs.nlp.DocumentAssembler
I am trying to serve a pyspark model using an endpoint. I was able to load and register the model normally. I could also load that model and perform inference but while serving the model, I am getting the following error: [94fffqts54] ERROR StatusLog...
- 4170 Views
- 3 replies
- 0 kudos
- 0 kudos
I'm having the same problem and have tried various solutions with no luck. I found some potentially relevant information on the following link: https://www.johnsnowlabs.com/serving-spark-nlp-via-api-3-3-databricks-jobs-and-mlflow-serve-apis/ In the ...
- 0 kudos
- 1530 Views
- 1 replies
- 0 kudos
Notebook cell gets hung up but code completes
Have been running into an issue when running a pymc-marketing model in a Databricks notebook. The cell that fits the model gets hung up and the progress bar stops moving, however the code completes and dumps all needed output into a folder. After the...
- 1530 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Retired_mod , Thanks for the feedback here as well as on the other discussion forum. I've commented on your trouble shooting tips on that board. One thing to touch upon hereVerify that the output files are correct and contain the expected results...
- 0 kudos
- 1384 Views
- 0 replies
- 0 kudos
Content Type error legacy serving
Hi,I have deployed an endpoint in Databricks using legacy serving. I am using the custom pyfunc in mlflow to deploy the custom code. This code uses Machine Learning to parse out the table of contents in some pdf files then returns the table of conten...
- 1384 Views
- 0 replies
- 0 kudos
