- 18064 Views
- 2 replies
- 6 kudos
Resolved! Difference between "spark.table" & "spark.read.table"?
Hi,I want to make a PySpark DataFrame from a Table. I would like to ask about the difference of the following commands:spark.read.table(TableName)&spark.table(TableName)Both return PySpark DataFrame and look similar. Thanks.
- 18064 Views
- 2 replies
- 6 kudos
- 6 kudos
Hi @Kaniz Fatma​ I selected answer from @Kedar Deshpande​ as the best answer.
- 6 kudos
- 1056 Views
- 1 replies
- 3 kudos
Resolved! How to specify directory when reading table?
Hi, Assume that I have created several tables in Databricks workspace. If two tables have similar names but stored in different folders, how I can read them by "spark.read.table". I ask this question because input to the "spark.read.table" is only ta...
- 1056 Views
- 1 replies
- 3 kudos
- 3 kudos
spark.read.table reads table registered in catalog/metastore. If you have multiple databases in metastore, just prefix table name with database name db.table
- 3 kudos