cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Databricks not able to access latest files in Azure ADLS Gen1

pankajBhatt
New Contributor II

I have mounted my path from Databricks to AzureADLS Gen1. using SPN as service accunt

untill yesterday everything was ok, but today I see,

  1. I can view all older deleted folders. I can not see them in ADLS . but my databricks dbutils.fs.ls() shows them.
  2. all my latest created files and subfolders , i can view them in ADLS but my databricks dbutils.fs.ls() do not show them.

I have compared the "access" property of older and new folders and it is same.

any suggestion?

error message :java.io.FileNotFoundException: File/Folder does not exist: ................

1 REPLY 1

Anonymous
Not applicable

Hi @pankaj bhatt​ 

Hope everything is going great.

Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we can help you. 

Cheers!

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group