- 3671 Views
- 5 replies
- 6 kudos
Resolved! How to import SqlDWRelation from com.databricks.spark.sqldw
Hello, All - I'm working on a project using the SQL DataWarehouse connector built into Databricks (https://docs.databricks.com/data/data-sources/azure/synapse-analytics.html). From there, I'm trying to extract information from the logical plan / logi...
- 3671 Views
- 5 replies
- 6 kudos
- 6 kudos
@Werner Stinckens​ Thanks for the reply! The SQL DW Connector itself is working just fine and I can retrieve the results from the SQL DW. I'm trying to extract the metadata (i.e. the Server, Database, and Table name) from the logical plan (or throu...
- 6 kudos
- 1106 Views
- 1 replies
- 0 kudos
How does Spark SQL Catalyst optimizer work?
How does Catalyst optimizer improves the performances, what is its role?
- 1106 Views
- 1 replies
- 0 kudos
- 0 kudos
Catalyst optimizer converts unresolved logical plan into executable physical plan, deep dive is available here
- 0 kudos