cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Read the file from datalake in databricks -No such file directory error

g96g
New Contributor III

0

I have a problem with reading the file from ADLS gen 2.

I have dont the mounting properly as after executing 

dbutils.fs.ls('/mnt/bronze')

 I can see the file path.

the way how I did the mounting:

 
# dbutils.fs.mount(
#   source = "abfss://"+container_read+"@"+storage_account_name_read+".dfs.core.windows.net/",
#   mount_point = "/mnt/dataverse",
#   extra_configs = configs)
the way how I read the file:
 

the way how I read the file:

with open('/mnt/dataverse/model.json', 'r') as f:
 
    data = f.read()
 
    manifest = json.loads(data)

and it throws the error 

No such file or directory

Sketchy part is that I can read the file usign different cluster ( 

runtime 11.3.x-scala2.12

) but after switching to 

12.2

 cluster I cant read it.

Any idea how can I fix this?

1 REPLY 1

Anonymous
Not applicable

Hi @Givi Saluโ€‹ 

Great to meet you, and thanks for your question!

Let's see if your peers in the community have an answer to your question. Thanks.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group