- 1498 Views
- 1 replies
- 0 kudos
LLM Chatbot With Retrieval Augmented Generation (RAG)
When executing the second block under 01-Data-Preparation-and-IndexI get the following error. Please help. AnalysisException: [RequestId=c9625879-339d-45c6-abb5-f70d724ddb47 ErrorClass=INVALID_STATE] Metastore storage root URL does not exist.Please p...
- 1498 Views
- 1 replies
- 0 kudos
- 0 kudos
I fixed this issue by providing a MANAGED LOCATION for the catalog - meant updating the _resources/00-init file as follows - spark.sql(f"CREATE CATALOG IF NOT EXISTS {catalog} MANAGED LOCATION '<location path>'")
- 0 kudos
- 3408 Views
- 3 replies
- 0 kudos
Resolved! My Global Init Script doesn't run with the new(er) LTS version 13.3. It runs great on 12.2LTS
Hey Databricks, Seems like you changed the way Global Init Scripts work. How come you changed it? My Global Init Script runs great on 12.2LTS but not on the new(er) LTS version 13.3. We don't have Unity Catalog turned on. What's up with that? Ar...
- 3408 Views
- 3 replies
- 0 kudos
- 0 kudos
Thank you ChloeBors - I tried upgrading the ubuntu version per your suggestion but got a new error "Can t open lib ODBC Driver 17 for SQL Server file not found 0 SQLDriverConnect". I tried modifying this line to 18: ACCEPT_EULA=Y apt-get install mso...
- 0 kudos
- 2328 Views
- 0 replies
- 0 kudos
How to save a catalog table as a spark or pandas dataframe?
HelloI have a table in my catalog, and I want to have it as a pandas or spark df. I was using this code to do that before, but I don't know what is happened recently that the code is not working anymore. from pyspark.sql import SparkSession spark = S...
- 2328 Views
- 0 replies
- 0 kudos
- 1112 Views
- 2 replies
- 0 kudos
A problem has occured
I am using the Community version of Databricks, and even though how much I clear and delete my items, notebooks, the below message appear when I want to insert a new cell in the notebook. Where can I see my usage and quota? A problem has occuredServe...
- 1112 Views
- 2 replies
- 0 kudos
- 0 kudos
sorry, I do not see any Trash button on my side. Can you printscreen?
- 0 kudos
- 1008 Views
- 1 replies
- 1 kudos
Model logging issues - Azure Databricks
I am running job with service principal ( principal e1077c1b-1dcf-4975-8164-d14f748d4774). Mentioned job has a task that will log (mlflow.pyfunc.log_model) newly trained model to unity catalog, but I get PERMISSION DENIED error. I do not get why prin...
- 1008 Views
- 1 replies
- 1 kudos
- 1 kudos
I am running job with service principal ( principal e1077c1b-1dcf-4975-8164-d14f748d4774). Mentioned job has a task that will log (mlflow.pyfunc.log_model) newly trained model to unity catalog, but I get PERMISSION DENIED error. I do not get why prin...
- 1 kudos
- 1843 Views
- 2 replies
- 3 kudos
Resolved! Can we get the all notebooks attached to an all purpose compute at a particular instant ?
For an all purpose compute, we can see the notebooks attached to a cluster in the UI. Is there a way to get the same details using some api or other method in program.
- 1843 Views
- 2 replies
- 3 kudos
- 3 kudos
For an all purpose compute, we can see the notebooks attached to a cluster in the UI. Is there a way to get the same details using some api or other method in program.
- 3 kudos
- 845 Views
- 1 replies
- 0 kudos
Urgent: Issue with Databricks Certified Machine Learning Engineer Associate Exam
Hello Team,I encountered an issue during my Databricks Certified Machine Learning Engineer Associate exam, which took place on 30- 03- 2024, at 11:00 AM IST. Despite being present at my seat and viewing the camera, the proctor unexpectedly suspended...
- 845 Views
- 1 replies
- 0 kudos
- 0 kudos
@himashu-singh thank you for filing at ticket with the support team, it looks like they have already responded to you.
- 0 kudos
- 1210 Views
- 0 replies
- 0 kudos
How to enable custom metrics for databricks EC2 instance?
Case 1: I have an AWS Databricks Instance, followed some steps for enabling CloudWatch for the Databricks EC2 instance. However, memory metrics is not available in the cloud watch. For that followed below steps for enabling custom metrics for the EC2...
- 1210 Views
- 0 replies
- 0 kudos
- 2088 Views
- 1 replies
- 0 kudos
How to install and use tkinter in databricks notebooks?
I have access to databricks cloud UI. I use the notebooks for my experiments (not MLFlow).I install libraries using the notebooks by using this command - !pip install LIBRARY_NAMEI am unable to install tkinter and use it in notebook as. Is there a wa...
- 2088 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Retired_mod Thanks for your response. I believe the "Create Library" is depreciated. Although there is a way to install libraries in the cluster configurations which I found and can try to install libraries through there. After using that, still ...
- 0 kudos
- 1297 Views
- 1 replies
- 0 kudos
Exam suspended
Hi Team,My databricks exam got suspended on 28h march 2024 and it is still in the suspended state. I have raised a support request using the below linkhttps://help.databricks.com/s/contact-us?ReqType=trainingand my request Id is #00454905I would real...
- 1297 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi Team,My databricks exam got suspended on 28h march 2024 and it is still in the suspended state. I have raised a support request using the below linkhttps://help.databricks.com/s/contact-us?ReqType=trainingand my request Id is #00454905I would real...
- 0 kudos
- 889 Views
- 0 replies
- 0 kudos
Why are data companies like Databricks investing or looping in k-12 education institutions?
Hello there,I work in the K-12 education sector, where the use of data is becoming increasingly important. With some schools having to manage over 13 grades and hundreds, if not thousands, of students, the ability to use data effectively is crucial. ...
- 889 Views
- 0 replies
- 0 kudos
- 1670 Views
- 3 replies
- 0 kudos
issue when reading csv in pandas
Hello Team,I've encountered an issue while attempting to read a CSV data file into a pandas DataFrame by uploading it into DBFS in the community version of Databricks. Below is the error I encountered along with the code snippet I used:import pandas...
- 1670 Views
- 3 replies
- 0 kudos
- 0 kudos
Assuming dbutils.fs.ls works without the "dbfs:/" prefix, try using it directly, i.e. df1 = pd.read_csv("/FileStore/shared_uploads/shiv/Dea.csv") . Alternatively, adjust the path as needed if using a local file path df1 = pd.read_csv("dbfs:/FileStore...
- 0 kudos
- 946 Views
- 0 replies
- 0 kudos
How to override a in-built function in databricks
I am trying to override is_member() in-built function in such a way that, it always return true. How to do it in databricks using sql or python?
- 946 Views
- 0 replies
- 0 kudos
- 2128 Views
- 0 replies
- 0 kudos
Export notebook dashboard
I'm looking to find way to export notebook dashboards as HTML files.We will be scheduling the notebook via workflows, so I'm not sure if we'd be looking at exporting something from the workflow via API or if there's a better way to do this.I'm also c...
- 2128 Views
- 0 replies
- 0 kudos
- 946 Views
- 0 replies
- 0 kudos
delta live tables linkage leneage
not able to see linkage/lineage details for delta live tables and MVs.Getting pipeline error : use live.table_name instead of catalog.schema.table_name
- 946 Views
- 0 replies
- 0 kudos
