- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-15-2023 07:20 AM
The first time i run my delta live table pipeline after setup, I get this error on starting it :-
------------------------------------
org.apache.spark.sql.catalyst.parser.ParseException:
Possibly unquoted identifier my-schema-name detected. Please consider quoting it with back-quotes as `my-schema-name`(line 1, pos 34)
== SQL ==
CREATE DATABASE IF NOT EXISTS my-schema-name
----------------------------------^^^
at org.apache.spark.sql.errors.QueryParsingErrors$.unquotedIdentifierError(QueryParsingErrors.scala:382)
at org.apache.spark.sql.catalyst.parser.PostProcessor$.exitErrorIdent(ParseDriver.scala:388)
at
--------------------------------------------
The pipeline works fine, if i leave the target schema field blank and run the pipeline.
I then update the pipeline with target schema my-schema-name and then successive pipeline updates are successful. But everytime i run the pipeline 1st time after setting it up, I get the above errror.
- Labels:
-
Delta
-
Table Pipeline
Accepted Solutions
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-20-2023 04:41 AM
Hey .. so the problem is fixed now. The issue was use of "-" in target schema name. When i changed it from "my-schema-name" to "my_schema_name" it works fine.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-17-2023 02:41 AM
Hi @Shagun Bhardwaj
Great to meet you, and thanks for your question!
Let's see if your peers in the community have an answer to your question. Thanks.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-20-2023 04:41 AM
Hey .. so the problem is fixed now. The issue was use of "-" in target schema name. When i changed it from "my-schema-name" to "my_schema_name" it works fine.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-20-2023 07:18 AM
This still errors on internal databricks spark/python code like
deltaTable.history()
@shagun wrote:The first time i run my delta live table pipeline after setup, I get this error on starting it :-
------------------------------------
org.apache.spark.sql.catalyst.parser.ParseException:
Possibly unquoted identifier my-schema-name detected. Please consider quoting it with back-quotes as `my-schema-name`(line 1, pos 34)
== SQL ==
CREATE DATABASE IF NOT EXISTS my-schema-name
----------------------------------^^^
at org.apache.spark.sql.errors.QueryParsingErrors$.unquotedIdentifierError(QueryParsingErrors.scala:382)
at org.apache.spark.sql.catalyst.parser.PostProcessor$.exitErrorIdent(ParseDriver.scala:388)
at
--------------------------------------------
The pipeline works fine, if i leave the target schema field blank and run the pipeline.
I then update the pipeline with target schema my-schema-name and then successive pipeline updates are successful. But everytime i run the pipeline 1st time after setting it up, I get the above errror.
Please fix! or just support dashes!

