topic Re: Upload a file in Machine Learning

Upload a file

magrat08 — Fri, 10 Jan 2025 22:46:24 GMT

Hi - I'm trying to upload a file, so that I can use the same in my notebook to try ML experiments with Databricks. From my workspace, I created a folder. But the option 'Create -> File' does not do anything. So not able to add any file.

From a notebook, there is an option to upload a file to DBFS. I used that and uploaded my file, copied the path which it gave me. When I tried to use that in the python code (pandas read_csv), it gives me 'FileNotFoundError: [Errno 2] No such file or directory'. when I try to run ls command, I can see the file, but am not able to copy (using cp command) nor am I able to refer it in pandas code.

Am not sure how to get past this error. Am using community edition.

Re: Upload a file

Walter_C — Sat, 11 Jan 2025 00:31:16 GMT

On the Folder you have created, you need to click on the 3 dots instead on the option Create and on this 3 dots you will see the option Import, here you will be able to upload the file you created.

To manage or make use of Databricks files you can use this guide for the different options https://docs.databricks.com/en/files/index.html

Re: Upload a file

magrat08 — Sat, 11 Jan 2025 02:09:16 GMT

The 3 dots -> Create -> Import only imports a notebook. It does not accept any files with extension .csv etc. I tried that already. As I said am using community edition.

Re: Upload a file

Walter_C — Sat, 11 Jan 2025 14:05:40 GMT

Can you try the approach mentioned in https://ganeshchandrasekaran.com/databricks-how-to-load-data-from-google-drive-github-c98d6b34d1b5