topic Re: If someone saves a flat file in a Databricks notebook without specifying a location, where does in Data Engineering

If someone saves a flat file in a Databricks notebook without specifying a location, where does it go?

User16826992666 — Thu, 17 Jun 2021 04:00:14 GMT

I ran the code block below and now I can't find the file. Where would this get saved since no location was specified?

Re: If someone saves a flat file in a Databricks notebook without specifying a location, where does it go?

sean_owen — Thu, 17 Jun 2021 18:28:19 GMT

In this case, you are just writing a file to the working directory of the driver process. It'll be under something like /home/[user] on the local file system. Anything you write to "/dbfs/..." however goes to distributed storage, even though it looks like a regular file. That would go into your 'root bucket' unless you write to a DBFS path under which another bucket has been mounted.

Re: If someone saves a flat file in a Databricks notebook without specifying a location, where does

jecastelo — Mon, 26 Aug 2024 22:06:12 GMT

/Workspace/Users/your.email@companyname.com/myfile.txt