dbutils.fs.ls is giving "null uri host This can be caused by unencoded / in the password string"

antoniok — Thu, 08 Sep 2022 12:36:57 GMT

I'm trying to list number of files in s3 bucket. I've initially used "aws s3 ls <s3://>" to list the files and it worked. However, when trying to do the same using dbutils.fs.ls, I'm getting

java.lang.NullPointerException: null uri host. This can be caused by unencoded / in the password string

My main goal is to export this list of output in either a txt or csv file and save in somewhere in DBFS. Would it be possible to do so just using bash? If not, how would you fix this error using dbutils.fs.ls? Thank you for your time

Re: dbutils.fs.ls is giving "null uri host This can be caused by unencoded / in the password string"

marcus1 — Tue, 27 Sep 2022 15:53:32 GMT

You might be encountering an issue with bucket naming. Which I'm also getting with a bucket named something.[0-9]

https://issues.apache.org/jira/browse/HADOOP-17241

topic dbutils.fs.ls is giving "null uri host This can be caused by unencoded / in the password string" in Data Engineering

dbutils.fs.ls is giving "null uri host This can be caused by unencoded / in the password string"

Re: dbutils.fs.ls is giving "null uri host This can be caused by unencoded / in the password string"