First create a table from the file and then read the table via workspace. This has worked for me.
Under Catalog, click the "+" button and then "Add Data" > "Create or modify data" > give the name of the table and upload the file.
Once done, use below command to access the table (orders_230714_200740)::
order_df = spark.read \
.format("csv") \
.option("header","true") \
.table("workspace.default.orders_230714_200740")
