topic Re: java.io.IOException: No FileSystem for scheme: null in Data Engineering

java.io.IOException: No FileSystem for scheme: null

PraveenKumarB — Wed, 24 Apr 2019 14:08:28 GMT

Getting the error when try to load the uploaded file in py notebook.

# File location and type file_location = "//FileStore/tables/data/d1.csv"

file_type = "csv"

# CSV options

infer_schema = "true"

first_row_is_header = "false"

delimiter = ","

# The applied options are for CSV files. For other file types, these will be ignored.

df = spark.read.format(file_type)

.option("inferSchema", infer_schema)

.option("header", first_row_is_header)

.option("sep", delimiter)

.load(file_location)

display(df)

Error at highlighted line:

Py4JJavaError Traceback (most recent call last) <command-2996484959822084> in <module>() 9 10# The applied options are for CSV files. For other file types, these will be ignored.---> 11df = spark.read.format(file_type).option("inferSchema", infer_schema).option("header", first_row_is_header).option("sep", delimiter).load(file_location) 12 13 display(df)/databricks/spark/python/pyspark/sql/readwriter.py in load(self, path, format, schema, **options) 164 self.options(**options) 165if isinstance(path, basestring):--> 166return self.df(self.jreader.load(path)) 167elif path isnotNone: 168if type(path)!= list:/databricks/spark/python/lib/py4j-0.10.7-src.zip/py4j/java_gateway.py in call(self, *args) 1255 answer = self.gateway_client.send_command(command) 1256 return_value = get_return_value( -> 1257 answer, self.gateway_client, self.target_id, self.name) 1258

Re: java.io.IOException: No FileSystem for scheme: null

mathan_pillai — Tue, 30 Apr 2019 10:12:27 GMT

Hi @Praveen B

The file location need to have the filesystem scheme. so it should be of the format dbfs:/FileStore/tables/data/d1.csv

Let us know if it works.

Thanks

Re: java.io.IOException: No FileSystem for scheme: null

Rodneyjoyce — Sun, 28 Jul 2019 04:28:05 GMT

Yes, this worked - cheers

Rodney

Re: java.io.IOException: No FileSystem for scheme: null

naughtonelad — Fri, 02 Oct 2020 08:14:56 GMT

what about setting the file location which points at blob storage associated with a storage account?

I am trying for https://storageaccountname.blob.core.windows.net/testfile.csv but I come back with:

java.io.IOException: No FileSystem for scheme: https

Re: java.io.IOException: No FileSystem for scheme: null

DivyanshuBhatia — Sun, 22 Nov 2020 14:29:46 GMT

@naughtonelad if your issue is solved,please let me know as I am facing the same problem

Re: java.io.IOException: No FileSystem for scheme: null

DivyanshuBhatia — Mon, 23 Nov 2020 08:45:30 GMT

@naughtonelad Did you get the solution of the question you mentioned in the comment? If yes, please share as I am facing the same issue.