<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic Re: DLT Pipeline event_log error - invalid pipeline name / The Spark SQL phase analysis failed in Data Engineering</title>
    <link>https://community.databricks.com/t5/data-engineering/dlt-pipeline-event-log-error-invalid-pipeline-name-the-spark-sql/m-p/109769#M43386</link>
    <description>&lt;P&gt;Hello Team,&lt;/P&gt;
&lt;P&gt;I do not see any current update about this. I will follow up on this internally and get back.&lt;/P&gt;</description>
    <pubDate>Tue, 11 Feb 2025 12:30:50 GMT</pubDate>
    <dc:creator>Alberto_Umana</dc:creator>
    <dc:date>2025-02-11T12:30:50Z</dc:date>
    <item>
      <title>DLT Pipeline event_log error - invalid pipeline name / The Spark SQL phase analysis failed</title>
      <link>https://community.databricks.com/t5/data-engineering/dlt-pipeline-event-log-error-invalid-pipeline-name-the-spark-sql/m-p/108552#M43082</link>
      <description>&lt;P&gt;I am trying the below queries using both SQL warehouse and a shared cluster on Databricks runtime (15.4/16.1) with Unity Catalog:&lt;/P&gt;&lt;DIV&gt;&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;DIV&gt;&lt;SPAN&gt;SELECT&lt;/SPAN&gt; &lt;SPAN&gt;*&lt;/SPAN&gt; &lt;SPAN&gt;FROM&lt;/SPAN&gt;&lt;SPAN&gt; event_log(&lt;/SPAN&gt;&lt;SPAN&gt;table&lt;/SPAN&gt;&lt;SPAN&gt;(&lt;/SPAN&gt;&lt;SPAN&gt;my_catalog&lt;/SPAN&gt;&lt;SPAN&gt;.&lt;/SPAN&gt;&lt;SPAN&gt;myschema&lt;/SPAN&gt;&lt;SPAN&gt;.bronze_employees))&lt;/SPAN&gt;&lt;/DIV&gt;&lt;BR /&gt;&lt;DIV&gt;&lt;SPAN&gt;SELECT&lt;/SPAN&gt; &lt;SPAN&gt;*&lt;/SPAN&gt; &lt;SPAN&gt;FROM&lt;/SPAN&gt;&lt;SPAN&gt; event_log(&lt;/SPAN&gt;&lt;SPAN&gt;"6b317553-5c5a-40d5-9541-1a5489f8b1oa"&lt;/SPAN&gt;&lt;SPAN&gt;)&lt;/SPAN&gt;&lt;/DIV&gt;&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;DIV&gt;Both return an error in the query output:&lt;/DIV&gt;&lt;DIV&gt;[INTERNAL_ERROR] The Spark SQL phase analysis failed with an internal error. You hit a bug in Spark or the Spark plugins you use. Please, report this bug to the corresponding communities or vendors, and provide the full stack trace. SQLSTATE: XX000&lt;/DIV&gt;&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;DIV&gt;From the cluster standard error output we see:&lt;/DIV&gt;&lt;/DIV&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;LI-CODE lang="markup"&gt;{
    "ts": "2025-02-03 07:39:56,967",
    "level": "ERROR",
    "logger": "pyspark.sql.connect.client.logging",
    "msg": "GRPC Error received",
    "context": {},
    "exception": {
        "class": "_MultiThreadedRendezvous",
        "msg": "&amp;lt;_MultiThreadedRendezvous of RPC that terminated with:\n\tstatus = StatusCode.INTERNAL\n\tdetails = \"[INTERNAL_ERROR] The Spark SQL phase analysis failed with an internal error. You hit a bug in Spark or the Spark plugins you use. Please, report this bug to the corresponding communities or vendors, and provide the full stack trace. SQLSTATE: XX000\"\n\tdebug_error_string = \"UNKNOWN:Error received from peer  {grpc_message:\"[INTERNAL_ERROR] The Spark SQL phase analysis failed with an internal error. You hit a bug in Spark or the Spark plugins you use. Please, report this bug to the corresponding communities or vendors, and provide the full stack trace. SQLSTATE: XX000\", grpc_status:13, created_time:\"2025-02-03T07:39:56.966893191+00:00\"}\"\n&amp;gt;",
        "stacktrace": [
            "Traceback (most recent call last):",
            "  File \"/databricks/spark/python/pyspark/sql/connect/client/core.py\", line 1910, in _execute_and_fetch_as_iterator",
            "    for b in generator:",
            "  File \"&amp;lt;frozen _collections_abc&amp;gt;\", line 356, in __next__",
            "  File \"/databricks/spark/python/pyspark/sql/connect/client/reattach.py\", line 140, in send",
            "    if not self._has_next():",
            "           ^^^^^^^^^^^^^^^^",
            "  File \"/databricks/spark/python/pyspark/sql/connect/client/reattach.py\", line 201, in _has_next",
            "    raise e",
            "  File \"/databricks/spark/python/pyspark/sql/connect/client/reattach.py\", line 173, in _has_next",
            "    self._current = self._call_iter(",
            "                    ^^^^^^^^^^^^^^^^",
            "  File \"/databricks/spark/python/pyspark/sql/connect/client/reattach.py\", line 298, in _call_iter",
            "    raise e",
            "  File \"/databricks/spark/python/pyspark/sql/connect/client/reattach.py\", line 278, in _call_iter",
            "    return iter_fun()",
            "           ^^^^^^^^^^",
            "  File \"/databricks/spark/python/pyspark/sql/connect/client/reattach.py\", line 174, in &amp;lt;lambda&amp;gt;",
            "    lambda: next(self._iterator)  # type: ignore[arg-type]",
            "            ^^^^^^^^^^^^^^^^^^^^",
            "  File \"/databricks/spark/python/pyspark/sql/connect/client/core.py\", line 657, in __iter__",
            "    for response in self._call:",
            "  File \"/databricks/python/lib/python3.12/site-packages/grpc/_channel.py\", line 540, in __next__",
            "    return self._next()",
            "           ^^^^^^^^^^^^",
            "  File \"/databricks/python/lib/python3.12/site-packages/grpc/_channel.py\", line 966, in _next",
            "    raise self",
            "grpc._channel._MultiThreadedRendezvous: &amp;lt;_MultiThreadedRendezvous of RPC that terminated with:",
            "\tstatus = StatusCode.INTERNAL",
            "\tdetails = \"[INTERNAL_ERROR] The Spark SQL phase analysis failed with an internal error. You hit a bug in Spark or the Spark plugins you use. Please, report this bug to the corresponding communities or vendors, and provide the full stack trace. SQLSTATE: XX000\"",
            "\tdebug_error_string = \"UNKNOWN:Error received from peer  {grpc_message:\"[INTERNAL_ERROR] The Spark SQL phase analysis failed with an internal error. You hit a bug in Spark or the Spark plugins you use. Please, report this bug to the corresponding communities or vendors, and provide the full stack trace. SQLSTATE: XX000\", grpc_status:13, created_time:\"2025-02-03T07:39:56.966893191+00:00\"}\"",
            "&amp;gt;"
        ]
    }
}​&lt;/LI-CODE&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;DIV&gt;From the cluster&amp;nbsp;log4j-active we see:&lt;/DIV&gt;&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;DIV&gt;org.apache.spark.SparkException: [INTERNAL_ERROR] The Spark SQL phase analysis failed with an internal error. You hit a bug in Spark or the Spark plugins you use. Please, report this bug to the corresponding communities or vendors, and provide the full stack trace. SQLSTATE: XX000&lt;BR /&gt;at org.apache.spark.SparkException$.internalError(SparkException.scala:116)&lt;BR /&gt;at org.apache.spark.sql.execution.QueryExecution$.toInternalError(QueryExecution.scala:1220)&lt;BR /&gt;at org.apache.spark.sql.execution.QueryExecution$.withInternalError(QueryExecution.scala:1233)&lt;BR /&gt;at org.apache.spark.sql.execution.QueryExecution.$anonfun$executePhase$2(QueryExecution.scala:599)&lt;BR /&gt;at com.databricks.util.LexicalThreadLocal$Handle.runWith(LexicalThreadLocal.scala:63)&lt;BR /&gt;at org.apache.spark.sql.execution.QueryExecution.$anonfun$executePhase$1(QueryExecution.scala:595)&lt;BR /&gt;at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:1422)&lt;BR /&gt;at org.apache.spark.sql.execution.QueryExecution.executePhase(QueryExecution.scala:595)&lt;BR /&gt;at org.apache.spark.sql.execution.QueryExecution.$anonfun$lazyAnalyzed$1(QueryExecution.scala:271)&lt;BR /&gt;at scala.util.Try$.apply(Try.scala:213)&lt;BR /&gt;at org.apache.spark.util.Utils$.doTryWithCallerStacktrace(Utils.scala:1676)&lt;BR /&gt;at org.apache.spark.util.Utils$.getTryWithCallerStacktrace(Utils.scala:1737)&lt;BR /&gt;at org.apache.spark.util.LazyTry.get(LazyTry.scala:58)&lt;BR /&gt;at org.apache.spark.sql.execution.QueryExecution.analyzed(QueryExecution.scala:303)&lt;BR /&gt;at org.apache.spark.sql.execution.QueryExecution.assertAnalyzed(QueryExecution.scala:251)&lt;BR /&gt;at org.apache.spark.sql.Dataset$.$anonfun$ofRows$2(Dataset.scala:131)&lt;BR /&gt;at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:1422)&lt;BR /&gt;at org.apache.spark.sql.SparkSession.$anonfun$withActiveAndFrameProfiler$1(SparkSession.scala:1429)&lt;BR /&gt;at com.databricks.spark.util.FrameProfiler$.record(FrameProfiler.scala:94)&lt;BR /&gt;at org.apache.spark.sql.SparkSession.withActiveAndFrameProfiler(SparkSession.scala:1429)&lt;BR /&gt;at org.apache.spark.sql.Dataset$.ofRows(Dataset.scala:123)&lt;BR /&gt;at org.apache.spark.sql.SparkSession.$anonfun$sql$4(SparkSession.scala:1102)&lt;BR /&gt;at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:1422)&lt;BR /&gt;at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:1054)&lt;BR /&gt;at org.apache.spark.sql.connect.planner.SparkConnectPlanner.executeSQL(SparkConnectPlanner.scala:3455)&lt;BR /&gt;at org.apache.spark.sql.connect.planner.SparkConnectPlanner.handleSqlCommand(SparkConnectPlanner.scala:3287)&lt;BR /&gt;at org.apache.spark.sql.connect.planner.SparkConnectPlanner.process(SparkConnectPlanner.scala:3222)&lt;BR /&gt;at org.apache.spark.sql.connect.execution.ExecuteThreadRunner.handleCommand(ExecuteThreadRunner.scala:413)&lt;BR /&gt;at org.apache.spark.sql.connect.execution.ExecuteThreadRunner.$anonfun$executeInternal$1(ExecuteThreadRunner.scala:299)&lt;BR /&gt;at org.apache.spark.sql.connect.execution.ExecuteThreadRunner.$anonfun$executeInternal$1$adapted(ExecuteThreadRunner.scala:220)&lt;BR /&gt;at org.apache.spark.sql.connect.service.SessionHolder.$anonfun$withSession$2(SessionHolder.scala:404)&lt;BR /&gt;at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:1422)&lt;BR /&gt;at org.apache.spark.sql.connect.service.SessionHolder.$anonfun$withSession$1(SessionHolder.scala:404)&lt;BR /&gt;at org.apache.spark.JobArtifactSet$.withActiveJobArtifactState(JobArtifactSet.scala:97)&lt;BR /&gt;at org.apache.spark.sql.artifact.ArtifactManager.$anonfun$withResources$1(ArtifactManager.scala:90)&lt;BR /&gt;at org.apache.spark.util.Utils$.withContextClassLoader(Utils.scala:240)&lt;BR /&gt;at org.apache.spark.sql.artifact.ArtifactManager.withResources(ArtifactManager.scala:89)&lt;BR /&gt;at org.apache.spark.sql.connect.service.SessionHolder.withSession(SessionHolder.scala:403)&lt;BR /&gt;at org.apache.spark.sql.connect.execution.ExecuteThreadRunner.executeInternal(ExecuteThreadRunner.scala:220)&lt;BR /&gt;at org.apache.spark.sql.connect.execution.ExecuteThreadRunner.org$apache$spark$sql$connect$execution$ExecuteThreadRunner$$execute(ExecuteThreadRunner.scala:139)&lt;BR /&gt;at org.apache.spark.sql.connect.execution.ExecuteThreadRunner$ExecutionThread.$anonfun$run$2(ExecuteThreadRunner.scala:639)&lt;BR /&gt;at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)&lt;BR /&gt;at com.databricks.unity.UCSEphemeralState$Handle.runWith(UCSEphemeralState.scala:51)&lt;BR /&gt;at com.databricks.unity.HandleImpl.runWith(UCSHandle.scala:104)&lt;BR /&gt;at com.databricks.unity.HandleImpl.$anonfun$runWithAndClose$1(UCSHandle.scala:109)&lt;BR /&gt;at scala.util.Using$.resource(Using.scala:269)&lt;BR /&gt;at com.databricks.unity.HandleImpl.runWithAndClose(UCSHandle.scala:108)&lt;BR /&gt;at org.apache.spark.sql.connect.execution.ExecuteThreadRunner$ExecutionThread.run(ExecuteThreadRunner.scala:639)&lt;BR /&gt;Suppressed: org.apache.spark.util.Utils$OriginalTryStackTraceException: Full stacktrace of original doTryWithCallerStacktrace caller&lt;BR /&gt;at org.apache.spark.SparkException$.internalError(SparkException.scala:116)&lt;BR /&gt;at org.apache.spark.sql.execution.QueryExecution$.toInternalError(QueryExecution.scala:1220)&lt;BR /&gt;at org.apache.spark.sql.execution.QueryExecution$.withInternalError(QueryExecution.scala:1233)&lt;BR /&gt;at org.apache.spark.sql.execution.QueryExecution.$anonfun$executePhase$2(QueryExecution.scala:599)&lt;BR /&gt;at com.databricks.util.LexicalThreadLocal$Handle.runWith(LexicalThreadLocal.scala:63)&lt;BR /&gt;at org.apache.spark.sql.execution.QueryExecution.$anonfun$executePhase$1(QueryExecution.scala:595)&lt;BR /&gt;at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:1422)&lt;BR /&gt;at org.apache.spark.sql.execution.QueryExecution.executePhase(QueryExecution.scala:595)&lt;BR /&gt;at org.apache.spark.sql.execution.QueryExecution.$anonfun$lazyAnalyzed$1(QueryExecution.scala:271)&lt;BR /&gt;at scala.util.Try$.apply(Try.scala:213)&lt;BR /&gt;at org.apache.spark.util.Utils$.doTryWithCallerStacktrace(Utils.scala:1676)&lt;BR /&gt;at org.apache.spark.util.LazyTry.tryT$lzycompute(LazyTry.scala:46)&lt;BR /&gt;at org.apache.spark.util.LazyTry.tryT(LazyTry.scala:46)&lt;BR /&gt;... 36 more&lt;BR /&gt;Caused by: java.lang.AssertionError: assertion failed: invalid pipeline schema: [Ljava.lang.String;@1ccd7699&lt;BR /&gt;at scala.Predef$.assert(Predef.scala:223)&lt;BR /&gt;at com.databricks.sql.dlt.EventLog.getPipelineEventLogTable(EventLog.scala:225)&lt;BR /&gt;at com.databricks.sql.dlt.EventLog.getPipelineEventLogTable(EventLog.scala:187)&lt;BR /&gt;at com.databricks.sql.dlt.EventLog.getPipelineIdAndEventLogTable(EventLog.scala:173)&lt;BR /&gt;at com.databricks.sql.dlt.EventLog.x$1$lzycompute(EventLog.scala:98)&lt;BR /&gt;at com.databricks.sql.dlt.EventLog.x$1(EventLog.scala:98)&lt;BR /&gt;at com.databricks.sql.dlt.EventLog.eventLogTable$lzycompute(EventLog.scala:98)&lt;BR /&gt;at com.databricks.sql.dlt.EventLog.eventLogTable(EventLog.scala:98)&lt;BR /&gt;at com.databricks.sql.dlt.EventLog.loadEventLogTable(EventLog.scala:108)&lt;BR /&gt;at com.databricks.sql.dlt.EventLogAnalysis.com$databricks$sql$dlt$EventLogAnalysis$$loadEventLogTable(EventLogAnalysis.scala:46)&lt;BR /&gt;at com.databricks.sql.dlt.EventLogAnalysis$$anonfun$rewrite$2.applyOrElse(EventLogAnalysis.scala:42)&lt;BR /&gt;at com.databricks.sql.dlt.EventLogAnalysis$$anonfun$rewrite$2.applyOrElse(EventLogAnalysis.scala:37)&lt;BR /&gt;at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.$anonfun$resolveOperatorsUpWithPruning$3(AnalysisHelper.scala:141)&lt;BR /&gt;at org.apache.spark.sql.catalyst.trees.CurrentOrigin$.withOrigin(origin.scala:85)&lt;BR /&gt;at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.$anonfun$resolveOperatorsUpWithPruning$1(AnalysisHelper.scala:141)&lt;BR /&gt;at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper$.allowInvokingTransformsInAnalyzer(AnalysisHelper.scala:436)&lt;BR /&gt;at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.resolveOperatorsUpWithPruning(AnalysisHelper.scala:137)&lt;BR /&gt;at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.resolveOperatorsUpWithPruning$(AnalysisHelper.scala:133)&lt;BR /&gt;at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.resolveOperatorsUpWithPruning(LogicalPlan.scala:41)&lt;BR /&gt;at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.$anonfun$resolveOperatorsUpWithPruning$2(AnalysisHelper.scala:138)&lt;BR /&gt;at org.apache.spark.sql.catalyst.trees.UnaryLike.mapChildren(TreeNode.scala:1314)&lt;BR /&gt;at org.apache.spark.sql.catalyst.trees.UnaryLike.mapChildren$(TreeNode.scala:1313)&lt;BR /&gt;at org.apache.spark.sql.catalyst.plans.logical.Project.mapChildren(basicLogicalOperators.scala:87)&lt;BR /&gt;at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.$anonfun$resolveOperatorsUpWithPruning$1(AnalysisHelper.scala:138)&lt;BR /&gt;at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper$.allowInvokingTransformsInAnalyzer(AnalysisHelper.scala:436)&lt;BR /&gt;at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.resolveOperatorsUpWithPruning(AnalysisHelper.scala:137)&lt;BR /&gt;at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.resolveOperatorsUpWithPruning$(AnalysisHelper.scala:133)&lt;BR /&gt;at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.resolveOperatorsUpWithPruning(LogicalPlan.scala:41)&lt;BR /&gt;at com.databricks.sql.dlt.EventLogAnalysis.rewrite(EventLogAnalysis.scala:37)&lt;BR /&gt;at com.databricks.sql.dlt.EventLogAnalysis.rewrite(EventLogAnalysis.scala:32)&lt;BR /&gt;at com.databricks.sql.optimizer.DatabricksEdgeRule.apply(DatabricksEdgeRule.scala:36)&lt;BR /&gt;at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$execute$14(RuleExecutor.scala:470)&lt;BR /&gt;at org.apache.spark.sql.catalyst.rules.RecoverableRuleExecutionHelper.processRule(RuleExecutor.scala:620)&lt;BR /&gt;at org.apache.spark.sql.catalyst.rules.RecoverableRuleExecutionHelper.processRule$(RuleExecutor.scala:603)&lt;BR /&gt;at org.apache.spark.sql.catalyst.rules.RuleExecutor.processRule(RuleExecutor.scala:130)&lt;BR /&gt;at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$execute$13(RuleExecutor.scala:470)&lt;BR /&gt;at com.databricks.spark.util.FrameProfiler$.record(FrameProfiler.scala:94)&lt;BR /&gt;at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$execute$12(RuleExecutor.scala:469)&lt;BR /&gt;at scala.collection.LinearSeqOptimized.foldLeft(LinearSeqOptimized.scala:126)&lt;BR /&gt;at scala.collection.LinearSeqOptimized.foldLeft$(LinearSeqOptimized.scala:122)&lt;BR /&gt;at scala.collection.immutable.List.foldLeft(List.scala:91)&lt;BR /&gt;at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$execute$11(RuleExecutor.scala:465)&lt;BR /&gt;at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)&lt;BR /&gt;at com.databricks.spark.util.FrameProfiler$.record(FrameProfiler.scala:94)&lt;BR /&gt;at org.apache.spark.sql.catalyst.rules.RuleExecutor.executeBatch$1(RuleExecutor.scala:442)&lt;BR /&gt;at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$execute$20(RuleExecutor.scala:575)&lt;BR /&gt;at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$execute$20$adapted(RuleExecutor.scala:575)&lt;BR /&gt;at scala.collection.immutable.List.foreach(List.scala:431)&lt;BR /&gt;at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$execute$1(RuleExecutor.scala:575)&lt;BR /&gt;at com.databricks.spark.util.FrameProfiler$.record(FrameProfiler.scala:94)&lt;BR /&gt;at org.apache.spark.sql.catalyst.rules.RuleExecutor.execute(RuleExecutor.scala:348)&lt;BR /&gt;at org.apache.spark.sql.catalyst.analysis.Analyzer.executeSameContext(Analyzer.scala:493)&lt;BR /&gt;at org.apache.spark.sql.catalyst.analysis.Analyzer.$anonfun$execute$1(Analyzer.scala:486)&lt;BR /&gt;at org.apache.spark.sql.catalyst.analysis.AnalysisContext$.withNewAnalysisContext(Analyzer.scala:383)&lt;BR /&gt;at org.apache.spark.sql.catalyst.analysis.Analyzer.execute(Analyzer.scala:486)&lt;BR /&gt;at org.apache.spark.sql.catalyst.analysis.Analyzer.execute(Analyzer.scala:402)&lt;BR /&gt;at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$executeAndTrack$1(RuleExecutor.scala:340)&lt;BR /&gt;at org.apache.spark.sql.catalyst.QueryPlanningTracker$.withTracker(QueryPlanningTracker.scala:211)&lt;BR /&gt;at org.apache.spark.sql.catalyst.rules.RuleExecutor.executeAndTrack(RuleExecutor.scala:340)&lt;BR /&gt;at org.apache.spark.sql.catalyst.analysis.resolver.HybridAnalyzer.resolveInFixedPoint(HybridAnalyzer.scala:190)&lt;BR /&gt;at org.apache.spark.sql.catalyst.analysis.resolver.HybridAnalyzer.$anonfun$apply$1(HybridAnalyzer.scala:76)&lt;BR /&gt;at org.apache.spark.sql.catalyst.analysis.resolver.HybridAnalyzer.withTrackedAnalyzerBridgeState(HybridAnalyzer.scala:111)&lt;BR /&gt;at org.apache.spark.sql.catalyst.analysis.resolver.HybridAnalyzer.apply(HybridAnalyzer.scala:71)&lt;BR /&gt;at org.apache.spark.sql.catalyst.analysis.Analyzer.$anonfun$executeAndCheck$1(Analyzer.scala:473)&lt;BR /&gt;at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper$.markInAnalyzer(AnalysisHelper.scala:443)&lt;BR /&gt;at org.apache.spark.sql.catalyst.analysis.Analyzer.executeAndCheck(Analyzer.scala:473)&lt;BR /&gt;at org.apache.spark.sql.execution.QueryExecution.$anonfun$lazyAnalyzed$2(QueryExecution.scala:277)&lt;BR /&gt;at com.databricks.spark.util.FrameProfiler$.record(FrameProfiler.scala:94)&lt;BR /&gt;at org.apache.spark.sql.catalyst.QueryPlanningTracker.measurePhase(QueryPlanningTracker.scala:525)&lt;BR /&gt;at org.apache.spark.sql.execution.QueryExecution.$anonfun$executePhase$5(QueryExecution.scala:600)&lt;BR /&gt;at org.apache.spark.sql.execution.SQLExecution$.withExecutionPhase(SQLExecution.scala:145)&lt;BR /&gt;at org.apache.spark.sql.execution.QueryExecution.$anonfun$executePhase$4(QueryExecution.scala:600)&lt;BR /&gt;at org.apache.spark.sql.execution.QueryExecution$.withInternalError(QueryExecution.scala:1231)&lt;BR /&gt;at org.apache.spark.sql.execution.QueryExecution.$anonfun$executePhase$2(QueryExecution.scala:599)&lt;BR /&gt;at com.databricks.util.LexicalThreadLocal$Handle.runWith(LexicalThreadLocal.scala:63)&lt;BR /&gt;at org.apache.spark.sql.execution.QueryExecution.$anonfun$executePhase$1(QueryExecution.scala:595)&lt;BR /&gt;at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:1422)&lt;BR /&gt;at org.apache.spark.sql.execution.QueryExecution.executePhase(QueryExecution.scala:595)&lt;BR /&gt;at org.apache.spark.sql.execution.QueryExecution.$anonfun$lazyAnalyzed$1(QueryExecution.scala:271)&lt;BR /&gt;at scala.util.Try$.apply(Try.scala:213)&lt;BR /&gt;at org.apache.spark.util.Utils$.doTryWithCallerStacktrace(Utils.scala:1676)&lt;BR /&gt;at org.apache.spark.util.LazyTry.tryT$lzycompute(LazyTry.scala:46)&lt;BR /&gt;at org.apache.spark.util.LazyTry.tryT(LazyTry.scala:46)&lt;/DIV&gt;&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;DIV&gt;and also from the log4j-active we see:&lt;/DIV&gt;&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;DIV&gt;com.databricks.backend.daemon.driver.JupyterDriverLocal$SqlCommHandler$MagicSQLExecutionException: Traceback (most recent call last):&lt;BR /&gt;File "/databricks/python_shell/lib/dbruntime/sql_magic/sql_magic.py", line 165, in execute_via_sql_comm_handler&lt;BR /&gt;df = self.get_query_request_result(request["query"])&lt;BR /&gt;^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^&lt;BR /&gt;File "/databricks/python_shell/lib/dbruntime/sql_magic/sql_magic.py", line 122, in get_query_request_result&lt;BR /&gt;df = self.asserting_spark.sql(query, widget_bindings)&lt;BR /&gt;^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^&lt;BR /&gt;File "/databricks/spark/python/pyspark/sql/connect/session.py", line 796, in sql&lt;BR /&gt;data, properties, ei = self.client.execute_command(cmd.command(self._client))&lt;BR /&gt;^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^&lt;BR /&gt;File "/databricks/spark/python/pyspark/sql/connect/client/core.py", line 1472, in execute_command&lt;BR /&gt;data, _, metrics, observed_metrics, properties = self._execute_and_fetch(&lt;BR /&gt;^^^^^^^^^^^^^^^^^^^^^^^^&lt;BR /&gt;File "/databricks/spark/python/pyspark/sql/connect/client/core.py", line 1948, in _execute_and_fetch&lt;BR /&gt;for response in self._execute_and_fetch_as_iterator(&lt;BR /&gt;File "/databricks/spark/python/pyspark/sql/connect/client/core.py", line 1924, in _execute_and_fetch_as_iterator&lt;BR /&gt;self._handle_error(error)&lt;BR /&gt;File "/databricks/spark/python/pyspark/sql/connect/client/core.py", line 2244, in _handle_error&lt;BR /&gt;self._handle_rpc_error(error)&lt;BR /&gt;File "/databricks/spark/python/pyspark/sql/connect/client/core.py", line 2348, in _handle_rpc_error&lt;BR /&gt;raise convert_exception(&lt;BR /&gt;pyspark.errors.exceptions.connect.SparkException: [INTERNAL_ERROR] The Spark SQL phase analysis failed with an internal error. You hit a bug in Spark or the Spark plugins you use. Please, report this bug to the corresponding communities or vendors, and provide the full stack trace. SQLSTATE: XX000&lt;/DIV&gt;</description>
      <pubDate>Mon, 03 Feb 2025 10:55:44 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/dlt-pipeline-event-log-error-invalid-pipeline-name-the-spark-sql/m-p/108552#M43082</guid>
      <dc:creator>N38</dc:creator>
      <dc:date>2025-02-03T10:55:44Z</dc:date>
    </item>
    <item>
      <title>Re: DLT Pipeline event_log error - invalid pipeline name / The Spark SQL phase analysis failed</title>
      <link>https://community.databricks.com/t5/data-engineering/dlt-pipeline-event-log-error-invalid-pipeline-name-the-spark-sql/m-p/108561#M43084</link>
      <description>&lt;P&gt;Hello&amp;nbsp;&lt;a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/147495"&gt;@N38&lt;/a&gt;,&lt;/P&gt;
&lt;P&gt;Thanks for your report! I have validated internally and our engineering team is aware of this and working on it via&amp;nbsp;ES-1282279&lt;/P&gt;</description>
      <pubDate>Mon, 03 Feb 2025 12:43:47 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/dlt-pipeline-event-log-error-invalid-pipeline-name-the-spark-sql/m-p/108561#M43084</guid>
      <dc:creator>Alberto_Umana</dc:creator>
      <dc:date>2025-02-03T12:43:47Z</dc:date>
    </item>
    <item>
      <title>Re: DLT Pipeline event_log error - invalid pipeline name / The Spark SQL phase analysis failed</title>
      <link>https://community.databricks.com/t5/data-engineering/dlt-pipeline-event-log-error-invalid-pipeline-name-the-spark-sql/m-p/108580#M43087</link>
      <description>&lt;P&gt;Thank you&amp;nbsp;&lt;a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/106294"&gt;@Alberto_Umana&lt;/a&gt;&amp;nbsp;- please keep me posted as you progress. We are currently unable to use this function and it will be great to have this resolved as soon as possible.&lt;/P&gt;</description>
      <pubDate>Mon, 03 Feb 2025 13:06:06 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/dlt-pipeline-event-log-error-invalid-pipeline-name-the-spark-sql/m-p/108580#M43087</guid>
      <dc:creator>N38</dc:creator>
      <dc:date>2025-02-03T13:06:06Z</dc:date>
    </item>
    <item>
      <title>Re: DLT Pipeline event_log error - invalid pipeline name / The Spark SQL phase analysis failed</title>
      <link>https://community.databricks.com/t5/data-engineering/dlt-pipeline-event-log-error-invalid-pipeline-name-the-spark-sql/m-p/108616#M43096</link>
      <description>&lt;P&gt;Sure&amp;nbsp;&lt;a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/147495"&gt;@N38&lt;/a&gt;&amp;nbsp;- Engineering is still looking and trying to reproduce the issue.&lt;/P&gt;</description>
      <pubDate>Mon, 03 Feb 2025 16:23:48 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/dlt-pipeline-event-log-error-invalid-pipeline-name-the-spark-sql/m-p/108616#M43096</guid>
      <dc:creator>Alberto_Umana</dc:creator>
      <dc:date>2025-02-03T16:23:48Z</dc:date>
    </item>
    <item>
      <title>Re: DLT Pipeline event_log error - invalid pipeline name / The Spark SQL phase analysis failed</title>
      <link>https://community.databricks.com/t5/data-engineering/dlt-pipeline-event-log-error-invalid-pipeline-name-the-spark-sql/m-p/108617#M43097</link>
      <description>&lt;P&gt;Thank you for the update, if you need any further information please let me know.&lt;/P&gt;</description>
      <pubDate>Mon, 03 Feb 2025 16:31:42 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/dlt-pipeline-event-log-error-invalid-pipeline-name-the-spark-sql/m-p/108617#M43097</guid>
      <dc:creator>N38</dc:creator>
      <dc:date>2025-02-03T16:31:42Z</dc:date>
    </item>
    <item>
      <title>Re: DLT Pipeline event_log error - invalid pipeline name / The Spark SQL phase analysis failed</title>
      <link>https://community.databricks.com/t5/data-engineering/dlt-pipeline-event-log-error-invalid-pipeline-name-the-spark-sql/m-p/109016#M43204</link>
      <description>&lt;P&gt;Is this a universal issue as I've been having the same problem?&lt;/P&gt;</description>
      <pubDate>Wed, 05 Feb 2025 20:34:22 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/dlt-pipeline-event-log-error-invalid-pipeline-name-the-spark-sql/m-p/109016#M43204</guid>
      <dc:creator>Mbunko</dc:creator>
      <dc:date>2025-02-05T20:34:22Z</dc:date>
    </item>
    <item>
      <title>Re: DLT Pipeline event_log error - invalid pipeline name / The Spark SQL phase analysis failed</title>
      <link>https://community.databricks.com/t5/data-engineering/dlt-pipeline-event-log-error-invalid-pipeline-name-the-spark-sql/m-p/109018#M43206</link>
      <description>&lt;P&gt;Yes&amp;nbsp;&lt;a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/148009"&gt;@Mbunko&lt;/a&gt;&amp;nbsp;- our engineering team is working on it.&lt;/P&gt;</description>
      <pubDate>Wed, 05 Feb 2025 20:45:03 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/dlt-pipeline-event-log-error-invalid-pipeline-name-the-spark-sql/m-p/109018#M43206</guid>
      <dc:creator>Alberto_Umana</dc:creator>
      <dc:date>2025-02-05T20:45:03Z</dc:date>
    </item>
    <item>
      <title>Re: DLT Pipeline event_log error - invalid pipeline name / The Spark SQL phase analysis failed</title>
      <link>https://community.databricks.com/t5/data-engineering/dlt-pipeline-event-log-error-invalid-pipeline-name-the-spark-sql/m-p/109099#M43223</link>
      <description>&lt;P&gt;Thank you for the update&amp;nbsp;&lt;a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/106294"&gt;@Alberto_Umana&lt;/a&gt;, I look forward to hearing more about the solution!&lt;/P&gt;</description>
      <pubDate>Thu, 06 Feb 2025 08:17:08 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/dlt-pipeline-event-log-error-invalid-pipeline-name-the-spark-sql/m-p/109099#M43223</guid>
      <dc:creator>N38</dc:creator>
      <dc:date>2025-02-06T08:17:08Z</dc:date>
    </item>
    <item>
      <title>Re: DLT Pipeline event_log error - invalid pipeline name / The Spark SQL phase analysis failed</title>
      <link>https://community.databricks.com/t5/data-engineering/dlt-pipeline-event-log-error-invalid-pipeline-name-the-spark-sql/m-p/109744#M43379</link>
      <description>&lt;P&gt;Good morning, is there any update on this issue?&lt;/P&gt;</description>
      <pubDate>Tue, 11 Feb 2025 09:53:35 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/dlt-pipeline-event-log-error-invalid-pipeline-name-the-spark-sql/m-p/109744#M43379</guid>
      <dc:creator>N38</dc:creator>
      <dc:date>2025-02-11T09:53:35Z</dc:date>
    </item>
    <item>
      <title>Re: DLT Pipeline event_log error - invalid pipeline name / The Spark SQL phase analysis failed</title>
      <link>https://community.databricks.com/t5/data-engineering/dlt-pipeline-event-log-error-invalid-pipeline-name-the-spark-sql/m-p/109769#M43386</link>
      <description>&lt;P&gt;Hello Team,&lt;/P&gt;
&lt;P&gt;I do not see any current update about this. I will follow up on this internally and get back.&lt;/P&gt;</description>
      <pubDate>Tue, 11 Feb 2025 12:30:50 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/dlt-pipeline-event-log-error-invalid-pipeline-name-the-spark-sql/m-p/109769#M43386</guid>
      <dc:creator>Alberto_Umana</dc:creator>
      <dc:date>2025-02-11T12:30:50Z</dc:date>
    </item>
    <item>
      <title>Re: DLT Pipeline event_log error - invalid pipeline name / The Spark SQL phase analysis failed</title>
      <link>https://community.databricks.com/t5/data-engineering/dlt-pipeline-event-log-error-invalid-pipeline-name-the-spark-sql/m-p/110877#M43726</link>
      <description>&lt;P&gt;Hi, is there an ETA on this fix?&lt;/P&gt;</description>
      <pubDate>Fri, 21 Feb 2025 15:14:23 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/dlt-pipeline-event-log-error-invalid-pipeline-name-the-spark-sql/m-p/110877#M43726</guid>
      <dc:creator>Mbunko</dc:creator>
      <dc:date>2025-02-21T15:14:23Z</dc:date>
    </item>
    <item>
      <title>Re: DLT Pipeline event_log error - invalid pipeline name / The Spark SQL phase analysis failed</title>
      <link>https://community.databricks.com/t5/data-engineering/dlt-pipeline-event-log-error-invalid-pipeline-name-the-spark-sql/m-p/111644#M43961</link>
      <description>&lt;P&gt;Hi,&lt;BR /&gt;I am also facing same issue, is there any ETA to fix it?&lt;/P&gt;</description>
      <pubDate>Tue, 04 Mar 2025 02:03:04 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/dlt-pipeline-event-log-error-invalid-pipeline-name-the-spark-sql/m-p/111644#M43961</guid>
      <dc:creator>ron99</dc:creator>
      <dc:date>2025-03-04T02:03:04Z</dc:date>
    </item>
  </channel>
</rss>

