- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-22-2015 09:40 AM
@Vida Ha I just did "Run All" on a clone of the "BroadcastHashJoin" notebook, and it appears to have errors.
On
%sql ANALYZE TABLE my_small_table COMPUTE STATISTICS noscanwhich appears right after "Configure a BroadcastHashJoin for a small table.", we get org.apache.spark.sql.catalyst.analysis.NoSuchTableException. I'm guessing this is b/c at this point in the notebook (on it's first run), my_small_table has only been created with registerTempTable; not with saveAsTable (which I think is required for ANALYZE).
If I run the code blocks lower down to do the saveAsTable and then come back here and rerun the "ANALYZE" step, I get:
Error in SQL statement: com.databricks.backend.daemon.driver.DriverLocal$SQLExecutionException: java.lang.UnsupportedOperationException: Analyze only works for Hive tables, but my_small_table is a LogicalRelation