cancel
Showing results for 
Search instead for 
Did you mean: 
Data Governance
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Data_Analytics1
by Contributor III
  • 15624 Views
  • 11 replies
  • 3 kudos

File not found error.

FileNotFoundError: [Errno 2] No such file or directory: '/dbfs/FileStore/config.share'When I am trying to read the config.share file, it is throwing this error. I tried with spark path format as well which is dbfs:/FileStore/config.share' but it also...

  • 15624 Views
  • 11 replies
  • 3 kudos
Latest Reply
raghu2
New Contributor III
  • 3 kudos

Was able to resolve the issue by adding pyOpenSSL library to the cluster.

  • 3 kudos
10 More Replies
rammy
by Contributor III
  • 3778 Views
  • 5 replies
  • 18 kudos

How would i upload file stream object to S3 bucket using pyspark?

I could able to save data using pyspark into S3 but not sure on how to save a file stream object into S3 bucket using pyspark. I could achieve this with help of python but when Unity catalog was enabled on Databrciks it always ends up with an access ...

  • 3778 Views
  • 5 replies
  • 18 kudos
Latest Reply
rammy
Contributor III
  • 18 kudos

I got to know that there is a change required at Unity-catalog to make it work with Python and got a recommendation to use pyspark to store file into S3.I do not see much information about storing a file stream object in an S3 bucket anywhere. Can an...

  • 18 kudos
4 More Replies
Labels