Databricks

microamp · 01-26-2018

Hi,I have files hosted on an Azure Data Lake Store which I can connect from Azure Databricks configured as per instructions here.I can read JSON files fine, however, I'm getting the following error when I try to read an Avro file.spark.read.format("c...

microamp · 02-06-2018

You may want to try mounting your Data Lake Store to DBFS and access your files through the mounted path. https://docs.databricks.com/spark/latest/data-sources/azure/azure-datalake.html#mounting-azure-data-lake-stores-with-dbfs I have not tried it y...

microamp · 02-06-2018

I have not unfortunately. I can load the Avro file as JSON although I would get corrupted data as expected, but at least that proves that the file is accessible. I don't know what's causing the above error.

Databricks

User Stats

User Activity

Azure Data Lake Config Issue: No value for dfs.adls.oauth2.access.token.provider found in conf file.

Re: Azure Data Lake Config Issue: No value for dfs.adls.oauth2.access.token.provider found in conf file.

Re: Azure Data Lake Config Issue: No value for dfs.adls.oauth2.access.token.provider found in conf file.