Deuce
New Contributor II

First create a table from the file and then read the table via workspace. This has worked for me.

Under Catalog, click the "+" button and then "Add Data" > "Create or modify data" > give the name of the table and upload the file.

Once done, use below command to access the table (orders_230714_200740):: 

order_df = spark.read \
.format("csv") \

.option("header","true") \
.table("workspace.default.orders_230714_200740")

Deuce_0-1753515219121.png