- 26131 Views
- 11 replies
- 12 kudos
Resolved! INFORMATION_SCHEMA IS NOT POPULATED WITH TABLE INFORMATION
I have created a metastore and within that metastore i have created multiple schemas and tables underlying it but none of table details is visible from information schema. All the tables are empty.Could you please let me know if I am missing here. Be...
- 26131 Views
- 11 replies
- 12 kudos
- 12 kudos
I noticed this issue is currently caused when you rename a catalog. The contents of <catalog>.information_schema are all views like this:SELECT * FROM system.information_schema.columns WHERE table_catalog = '<catalog>'If you rename the catalog...
- 12 kudos
- 3971 Views
- 1 replies
- 1 kudos
AutoML Trials Failing
Sometimes an AutoML experiment will have all trials fail and I cannot figure out what is causing it. Each individual run reports a validation f1 value but the source notebook is not available so I cannot track down the error. This seems to happen at ...
- 3971 Views
- 1 replies
- 1 kudos
- 8902 Views
- 2 replies
- 2 kudos
MLFlow model loading taking long time and "model serving" failing during init
I am trying to load a simple Minmaxscaler model that was logged as a run through spark's ML Pipeline api for reuse. On average it takes 40+ seconds just to load the model with the following example: This is fine and the model transforms my data corre...
- 8902 Views
- 2 replies
- 2 kudos
- 2 kudos
Hello,Any solutions found for this issue?I'm serving up a large number of models at a time, but since we converted to PySpark (due to our data demands), the mlflow.spark.load_model() is taking hours.Part of the reason to switch to spark was to help w...
- 2 kudos
- 1805 Views
- 1 replies
- 0 kudos
- 1805 Views
- 1 replies
- 0 kudos
- 0 kudos
Large Language Models (LLMs) revolutionize the insurance sector, automating support and enhancing accuracy across claims and underwriting. They're crucial for market analysis processing extensive textual data, and we welcome your insights on deployin...
- 0 kudos
- 5213 Views
- 1 replies
- 1 kudos
Help installing R package "sf" azure Databricks cluster
I need help installing the R package "sf" on the azure Databricks cluster. Any help will be greatly appreciated.I'm getting the error below when I try installing the "sf" package on a cluster."Error Code: DRIVER_LIBRARY_INSTALLATION_FAILURE. Error Me...
- 5213 Views
- 1 replies
- 1 kudos
- 1693 Views
- 0 replies
- 0 kudos
Terraform - Creating Jobs
Hello, Does anyone know how to create a job via Terraform, that automatically overwrites/updates an existing job with the same name?Tried a few different methods but there doesn't seem to be a clean approach. Wondering if anyone has worked this out?I...
- 1693 Views
- 0 replies
- 0 kudos
- 2038 Views
- 0 replies
- 0 kudos
databricks.mrm import ModelRiskApi
Hi, I am trying to import/access this module by DBX. However I have issue importing it and I don't find any blog posts/more information about this module beside the public github repo
- 2038 Views
- 0 replies
- 0 kudos
- 16847 Views
- 7 replies
- 2 kudos
Resolved! Served model creation failed
I have a model registered in unity catalog which works fine and I can load / run and get results returned. I wanted to create a serving endpoint but when I try I get this error.Served model creation failed for served model 'model_name', config versi...
- 16847 Views
- 7 replies
- 2 kudos
- 2 kudos
@kashy Looks like the model is not correctly referenced while loading. You should reference the path of the model till ‘model-best’, which is the top-level directory. loaded_model = mlflow.spacy.load_model("</path/to/your/model/>/model-best")
- 2 kudos
- 4034 Views
- 3 replies
- 1 kudos
Cluster termination issue (It was working fine with same code previously)
Hi, I am running arima code on databricks commmunity edition. Last time, it worked but now the cluster gets terminated at this command and says its completed. but i cant further plot the predictions since the cluster is terminated. # Fit the AutoARI...
- 4034 Views
- 3 replies
- 1 kudos
- 1 kudos
@Humi1245 You can view the event log of the cluster to understand the cause of the cluster termination. If it is due to gc issues, then we have to understand the reason behind high driver memory utilization which caused the GC. If it's due to inact...
- 1 kudos
- 6973 Views
- 2 replies
- 1 kudos
Resolved! Model serving Ran out of memory
Hi fellows, I encountered memory(?) error when sending POST requests to my real-time endpoint, and I'm unable to find hardware setting to increase memory, as suggested by the Service Logs (below). Steps to Repro:(1) I registered a custom MLFlow model...
- 6973 Views
- 2 replies
- 1 kudos
- 1 kudos
Thank you for your responses, @Annapurna_Hiriy and @Retired_modIndeed, it appeared that my original model (~800MB) was too big for the current server. Based on your suggestion, I made a simpler/smaller model for this project, and then I was able to d...
- 1 kudos
- 3140 Views
- 0 replies
- 0 kudos
Getting started with lakehouse monitoring
Watch Youtube video : https://www.youtube.com/watch?v=U9ctDgoVDIc
- 3140 Views
- 0 replies
- 0 kudos
- 5216 Views
- 3 replies
- 2 kudos
Resolved! Hello Community Users, Â We recently announced a new Large Language Models (LLM) program, the first of its kind on edX! Learn how to develop production...
Hello Community Users, We recently announced a new Large Language Models (LLM) program, the first of its kind on edX! Learn how to develop production-ready LLM applications and dive into the theory behind foundation models. Taught by industry experts...
- 5216 Views
- 3 replies
- 2 kudos
- 2 kudos
Hi @163050 You could download the Dbc file from the course, we already have the LLM course in the Customer Academy.
- 2 kudos
- 6961 Views
- 1 replies
- 1 kudos
sklearn logistic regression restarting kernel
Hello,I am trying to create a simple logistic regression model to test for the impact of PCA on my dataset. I'm getting the error in the attachment.It feels to me like a version mismatching - but I'm using a fresh cluster with no additional packages ...
- 6961 Views
- 1 replies
- 1 kudos
- 1 kudos
Sorry for the long delay - holiday & work activities stopped from me progressing this issue. The error was actually an OOM error - fixed by configuring cluster sizes appropriately.
- 1 kudos
- 11711 Views
- 2 replies
- 0 kudos
Databricks ML Professional Certification exam got suspended due to technical issue
Hi Team,I was taking online exam for Databricks Machine Learning Professional exam on 22nd September,2023(16:15 Asia/Calcutta), the exam first got suspended due to proctoring issue and was rescheduled by the proctor in the next 30 mins, then the exam...
- 11711 Views
- 2 replies
- 0 kudos
- 0 kudos
@Soumyajeet_das Thank you for filing a ticket through support! The team is working on it. Thank you for your patience.
- 0 kudos
- 4147 Views
- 0 replies
- 0 kudos
How to allocate more memory to GPU when training through databricks notebook
I am trying to train a Hubert Model, specifically the facebook/hubert-base-ls960 model on a custom speech dataset.Training parameters are below:trainer_config = { "OUTPUT_DIR": "results", "TRAIN_EPOCHS": 6, "TRAIN_BATCH_SIZE": 2, "EVAL_BATCH_SIZE...
- 4147 Views
- 0 replies
- 0 kudos
