I am new to learning Spark and working on some practice; I have uploaded a zip file in DBFS /FileStore/tables directory and trying to run a python code to unzip the file; The python code is as:
from zipfile import *
with ZipFile("/FileStore/tables/flight_data.zip", "r") as zipObj:
zipObj.extractall()
It throws an error:
FileNotFoundError: [Errno 2] No such file or directory: '/FileStore/tables/flight_data.zip'
When i check manually and also through the code dbutils.fs.ls("/FileStore/tables/") it returns
Out[13]: [ FileInfo(path='dbfs:/FileStore/tables/flight_data.zip', name='flight_data.zip', size=59082358)]
Can someone please review and advise; I am using community edition to run this on cluster with configuration:
Data Bricks Runtime Version 8.3 (includes Apache Spark 3.1.1, Scala 2.12)