- 8340 Views
- 5 replies
- 0 kudos
help me in converting the below code equivalent to databricks sql PS. with recursive is not working
SELECT position_no, position_function, work_function, job_profile_id, pos_cat as position_category, pos_cat_desc, job_posting_title as pos_title, employee_status as emp_status, emp_status_desc, clevel, subs...
- 8340 Views
- 5 replies
- 0 kudos
Latest Reply
- 35515 Views
- 6 replies
- 3 kudos
I have to read zipped csv file using spark without unzipping it. can anyone please provide pyspark/spark sql code for that?
Zipped csv files are receiving to s3 raw layer.
- 35515 Views
- 6 replies
- 3 kudos
Latest Reply
- 3 kudos
@Jog Giri​ I also recently encountered a similar scenario, the below code solved my purpose without any issues.import zipfile for i in dbutils.fs.ls('/mnt/zipfilespath/'): with zipfile.ZipFile(i.path.replace('dbfs:','/dbfs'), mode="r") as zip_ref:...
- 3 kudos