Using R, how do we write csv file to say dbfs:/tmp?

[THIAM_HUATTAN]

let us say I already have the data 'TotalData'

write.csv(TotalData,file='/tmp/TotalData.csv',row.names = FALSE)

I do not see any error from above

when I list files below:

%fs ls /tmp

I do not see any files written there. Why?

[Cedric]

Hi Thiam,

Thank you for reaching out to us. In this case it seems that you have written a file to the OS /tmp and tried to fetch the same folder in DBFS.

Written >> /tmp/TotalData.csv

Reading >> /dbfs/tmp/TotalData.csv

Please try to execute write.csv with the following path instead:

write.csv(TotalData,file='/dbfs/tmp/TotalData.csv',row.names = FALSE)

%fs ls /tmp

Then you will see the file in DBFS. If your intention was to write it to the OS /tmp, please do the following:

write.csv(TotalData,file='/tmp/TotalData.csv',row.names = FALSE)

%sh ls /tmp

%sh allows you to run shell code on the OS while %fs is used for DBFS file access.

Please read the following documentation for more information:

https://docs.databricks.com/notebooks/notebooks-use.html#:~:text=Notebooks%20also%20support%20a%20fe...

[THIAM_HUATTAN]

%r

write.csv(df,file='/tmp/df.csv',row.names = FALSE)

%fs ls /tmp

above does not show that the file df.csv exist

below will have error:

%r

write.csv(df,file='/dbfs/tmp/df.csv',row.names = FALSE)

Warning in file(file, ifelse(append, "a", "w")) :

cannot open file '/dbfs/tmp/df.csv': No such file or directory

Error in file(file, ifelse(append, "a", "w")) :

cannot open the connection

Some(<code style = 'font-size:10pt'> Error in file(file, ifelse(append, &quot;a&quot;, &quot;w&quot;)): cannot open the connection </code>)

[THIAM_HUATTAN]

please see above. thanks.