Bronze layer tables

spallinti — Thu, 29 Jun 2023 22:17:22 GMT

What type of tables do we use for Bronze layer. Managed or external when our raw data is in csv file

Re: Bronze layer tables

Vinay_M_R — Fri, 30 Jun 2023 11:27:59 GMT

You can create either a managed or an unmanaged (external) table in the bronze layer, depending on your preference and use case. If you choose to create a managed table, Databricks will manage both the metadata and the data for the table. If you choose to create an unmanaged table, you will manage the data yourself, and Databricks will only manage the metadata. Since the data is in CSV format, you can use the following code to create a managed table:

%sql
CREATE TABLE bronze_table
USING csv
OPTIONS (path "/path/to/csv/files")

Or, you can use the following code to create an unmanaged table:

%sql
CREATE TABLE bronze_table
USING csv
OPTIONS (path "/path/to/csv/files")
LOCATION "/path/to/csv/files"

Note that with an unmanaged table, you must specify the LOCATION where the data is stored.

topic Bronze layer tables in Administration & Architecture

Bronze layer tables

Re: Bronze layer tables