LLM Chatbot With Retrieval Augmented Generation (RAG)

amitpphatak — Tue, 02 Apr 2024 21:36:00 GMT

When executing the second block under

01-Data-Preparation-and-Index

I get the following error. Please help.

AnalysisException: [RequestId=c9625879-339d-45c6-abb5-f70d724ddb47 ErrorClass=INVALID_STATE] Metastore storage root URL does not exist.Please provide a storage location for the catalog (for example 'CREATE CATALOG myCatalog MANAGED LOCATION '<location-path>'). Alternatively set up a metastore root storage location to provide a storage location for all catalogs in the metastore.

File <command-666025524924316>, line 13 11 catalogs = [r['catalog'] for r in spark.sql("SHOW CATALOGS").collect()] 12 if catalog not in catalogs: ---> 13 spark.sql(f"CREATE CATALOG IF NOT EXISTS {catalog}") 14 if catalog == 'dbdemos': 15 spark.sql(f"ALTER CATALOG {catalog} OWNER TO `account users`")

File /databricks/spark/python/pyspark/errors/exceptions/captured.py:230, in capture_sql_exception.<locals>.deco(*a, **kw) 226 converted = convert_exception(e.java_exception) 227 if not isinstance(converted, UnknownException): 228 # Hide where the exception came from that shows a non-Pythonic 229 # JVM exception message. --> 230 raise converted from None 231 else: 232 raise

Re: LLM Chatbot With Retrieval Augmented Generation (RAG)

amitpphatak — Tue, 02 Apr 2024 21:58:44 GMT

I fixed this issue by providing a MANAGED LOCATION for the catalog - meant updating the _resources/00-init file as follows -

spark.sql(f"CREATE CATALOG IF NOT EXISTS {catalog} MANAGED LOCATION '<location path>'")

topic LLM Chatbot With Retrieval Augmented Generation (RAG) in Get Started Discussions

LLM Chatbot With Retrieval Augmented Generation (RAG)

Re: LLM Chatbot With Retrieval Augmented Generation (RAG)