Where the data is stored in processing
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-15-2021 08:53 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-18-2021 02:30 PM
Data used within the Databricks platform is controlled by the customer and sits on your own VPC.
Some types of data (such as partial query results, command logs executed from a notebook) will get transferred and/or stored on Databricks accounts (for not more than 30 days) in an encrypted fashion.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-02-2021 01:02 PM
One clarification to the point above. The data is stored in your (the customer's) account and S3. All of the ephemeral workers are spun up in your own account and VPC. Very little information is actually stored in the Databricks account, other than what is needed to provide a quality level service and user experience. You might check out the architecture documents here. https://docs.databricks.com/getting-started/overview.html
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-08-2022 10:09 PM
The central processing unit, also known as the CPU, is the brain of the computer and is where all programmes and instructions are executed. Computers employ two different forms of memory: primary memory and secondary memory. Data and programmes are kept in secondary memory, which serves as the primary storage.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-11-2022 08:40 PM
No all the data is stored within your own AWS.Some data to enhance your databricks experience maybe stored in DBFS

