https://community.databricks.com/t5/get-started-discussions/classcastexception-when-attempting-to-timetravel-databricks/m-p/55429#M6279 <P>Did you find a solution?</P> Mon, 18 Dec 2023 12:11:24 GMT SusanaD 2023-12-18T12:11:24Z https://community.databricks.com/t5/get-started-discussions/classcastexception-when-attempting-to-timetravel-databricks/m-p/44365#M6277 <P>Hi all,</P><P>Using databricks-connect 11.3.19, I get an "<SPAN>java.lang.ClassCastException" when attempting to timetravel. The exact same statement works fine when executed in the databricks GUI directly. Any ideas on what's going on? Is this a known limitation of databricks-connect?</SPAN></P> Mon, 11 Sep 2023 14:35:36 GMT https://community.databricks.com/t5/get-started-discussions/classcastexception-when-attempting-to-timetravel-databricks/m-p/44365#M6277 JordiDekker 2023-09-11T14:35:36Z https://community.databricks.com/t5/get-started-discussions/classcastexception-when-attempting-to-timetravel-databricks/m-p/44366#M6278 <P>&nbsp;</P><LI-CODE lang="python"># failing code: spark.sql(f"RESTORE TABLE {table} TO VERSION AS OF 0") # stack trace: """ Exception has occurred: Py4JJavaError (note: full exception trace is shown but execution is paused at: test_rollback_on_exception) An error occurred while calling o44.sql. : java.lang.ClassCastException: org.apache.spark.sql.execution.datasources.LogicalRelation cannot be cast to com.databricks.sql.catalyst.TimeTravel at org.apache.spark.sql.catalyst.plans.logical.RestoreTableStatement.withNewChildInternal(RestoreTableStatement.scala:39) at org.apache.spark.sql.catalyst.plans.logical.RestoreTableStatement.withNewChildInternal(RestoreTableStatement.scala:32) at org.apache.spark.sql.catalyst.trees.UnaryLike.$anonfun$mapChildren$5(TreeNode.scala:1196) at org.apache.spark.sql.catalyst.trees.CurrentOrigin$.withOrigin(TreeNode.scala:99) at org.apache.spark.sql.catalyst.trees.UnaryLike.mapChildren(TreeNode.scala:1195) at org.apache.spark.sql.catalyst.trees.UnaryLike.mapChildren$(TreeNode.scala:1190) at org.apache.spark.sql.catalyst.plans.logical.RestoreTableStatement.mapChildren(RestoreTableStatement.scala:32) at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.$anonfun$resolveOperatorsUpWithPruning$1(AnalysisHelper.scala:136) at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper$.allowInvokingTransformsInAnalyzer(AnalysisHelper.scala:354) at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.resolveOperatorsUpWithPruning(AnalysisHelper.scala:135) at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.resolveOperatorsUpWithPruning$(AnalysisHelper.scala:131) at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.resolveOperatorsUpWithPruning(LogicalPlan.scala:31) at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.resolveOperatorsUp(AnalysisHelper.scala:112) at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.resolveOperatorsUp$(AnalysisHelper.scala:111) at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.resolveOperatorsUp(LogicalPlan.scala:31) at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveTimeTravel$.apply(Analyzer.scala:1834) at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveTimeTravel$.apply(Analyzer.scala:1833) at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$execute$3(RuleExecutor.scala:216) at com.databricks.spark.util.FrameProfiler$.record(FrameProfiler.scala:24) at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$execute$2(RuleExecutor.scala:216) at scala.collection.LinearSeqOptimized.foldLeft(LinearSeqOptimized.scala:126) at scala.collection.LinearSeqOptimized.foldLeft$(LinearSeqOptimized.scala:122) at scala.collection.immutable.List.foldLeft(List.scala:91) at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$execute$1(RuleExecutor.scala:213) at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$execute$1$adapted(RuleExecutor.scala:205) at scala.collection.immutable.List.foreach(List.scala:431) at org.apache.spark.sql.catalyst.rules.RuleExecutor.execute(RuleExecutor.scala:205) at org.apache.spark.sql.catalyst.analysis.Analyzer.org$apache$spark$sql$catalyst$analysis$Analyzer$$executeSameContext(Analyzer.scala:331) at org.apache.spark.sql.catalyst.analysis.Analyzer.$anonfun$execute$1(Analyzer.scala:324) at org.apache.spark.sql.catalyst.analysis.AnalysisContext$.withNewAnalysisContext(Analyzer.scala:231) at org.apache.spark.sql.catalyst.analysis.Analyzer.execute(Analyzer.scala:324) at org.apache.spark.sql.catalyst.analysis.Analyzer.execute(Analyzer.scala:252) at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$executeAndTrack$1(RuleExecutor.scala:184) at org.apache.spark.sql.catalyst.QueryPlanningTracker$.withTracker(QueryPlanningTracker.scala:154) at org.apache.spark.sql.catalyst.rules.RuleExecutor.executeAndTrack(RuleExecutor.scala:184) at org.apache.spark.sql.catalyst.analysis.Analyzer.$anonfun$executeAndCheck$1(Analyzer.scala:304) at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper$.markInAnalyzer(AnalysisHelper.scala:361) at org.apache.spark.sql.catalyst.analysis.Analyzer.executeAndCheck(Analyzer.scala:303) at org.apache.spark.sql.execution.QueryExecution.$anonfun$analyzed$1(QueryExecution.scala:147) at com.databricks.spark.util.FrameProfiler$.record(FrameProfiler.scala:24) at org.apache.spark.sql.catalyst.QueryPlanningTracker.measurePhase(QueryPlanningTracker.scala:340) at org.apache.spark.sql.execution.QueryExecution.$anonfun$executePhase$3(QueryExecution.scala:337) at org.apache.spark.sql.execution.QueryExecution$.withInternalError(QueryExecution.scala:745) at org.apache.spark.sql.execution.QueryExecution.$anonfun$executePhase$1(QueryExecution.scala:337) at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:985) at org.apache.spark.sql.execution.QueryExecution.executePhase(QueryExecution.scala:334) at org.apache.spark.sql.execution.QueryExecution.analyzed$lzycompute(QueryExecution.scala:141) at org.apache.spark.sql.execution.QueryExecution.analyzed(QueryExecution.scala:141) at org.apache.spark.sql.execution.QueryExecution.assertAnalyzed(QueryExecution.scala:133) at org.apache.spark.sql.Dataset$.$anonfun$ofRows$2(Dataset.scala:106) at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:985) at org.apache.spark.sql.Dataset$.ofRows(Dataset.scala:104) at org.apache.spark.sql.SparkSession.$anonfun$sql$1(SparkSession.scala:820) at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:985) at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:815) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244) at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:380) at py4j.Gateway.invoke(Gateway.java:306) at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132) at py4j.commands.CallCommand.execute(CallCommand.java:79) at py4j.ClientServerConnection.waitForCommands(ClientServerConnection.java:195) at py4j.ClientServerConnection.run(ClientServerConnection.java:115) at java.lang.Thread.run(Thread.java:750) """</LI-CODE><P>&nbsp;</P> Mon, 11 Sep 2023 14:38:22 GMT https://community.databricks.com/t5/get-started-discussions/classcastexception-when-attempting-to-timetravel-databricks/m-p/44366#M6278 JordiDekker 2023-09-11T14:38:22Z https://community.databricks.com/t5/get-started-discussions/classcastexception-when-attempting-to-timetravel-databricks/m-p/55429#M6279 <P>Did you find a solution?</P> Mon, 18 Dec 2023 12:11:24 GMT https://community.databricks.com/t5/get-started-discussions/classcastexception-when-attempting-to-timetravel-databricks/m-p/55429#M6279 SusanaD 2023-12-18T12:11:24Z