cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

java.io.IOException: No FileSystem for scheme: null

PraveenKumarB
New Contributor

Getting the error when try to load the uploaded file in py notebook.

# File location and type file_location = "//FileStore/tables/data/d1.csv"

file_type = "csv"

# CSV options

infer_schema = "true"

first_row_is_header = "false"

delimiter = ","

# The applied options are for CSV files. For other file types, these will be ignored.

df = spark.read.format(file_type)

.option("inferSchema", infer_schema)

.option("header", first_row_is_header)

.option("sep", delimiter)

.load(file_location)

display(df)

Error at highlighted line:

Py4JJavaError Traceback (most recent call last) <command-2996484959822084> in <module>() 9 10# The applied options are for CSV files. For other file types, these will be ignored.---> 11df = spark.read.format(file_type).option("inferSchema", infer_schema).option("header", first_row_is_header).option("sep", delimiter).load(file_location) 12 13 display(df)/databricks/spark/python/pyspark/sql/readwriter.py in load(self, path, format, schema, **options) 164 self.options(**options) 165if isinstance(path, basestring):--> 166return self.df(self.jreader.load(path)) 167elif path isnotNone: 168if type(path)!= list:/databricks/spark/python/lib/py4j-0.10.7-src.zip/py4j/java_gateway.py in call(self, *args) 1255 answer = self.gateway_client.send_command(command) 1256 return_value = get_return_value( -> 1257 answer, self.gateway_client, self.target_id, self.name) 1258

5 REPLIES 5

mathan_pillai
Valued Contributor
Valued Contributor

Hi @Praveen B

The file location need to have the filesystem scheme. so it should be of the format dbfs:/FileStore/tables/data/d1.csv

Let us know if it works.

Thanks

Yes, this worked - cheers

Rodney

what about setting the file location which points at blob storage associated with a storage account?

I am trying for https://storageaccountname.blob.core.windows.net/testfile.csv but I come back with:

java.io.IOException: No FileSystem for scheme: https

@naughtonelad​  Did you get the solution of the question you mentioned in the comment? If yes, please share as I am facing the same issue.

DivyanshuBhatia
New Contributor II

@naughtonelad​  if your issue is solved,please let me know as I am facing the same problem

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!