cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Delta Live Table "Default Schema" mandatory but not editable

hedbergjacob
New Contributor II

Hi,

We have an issue with a DLT pipeline. We want to add some source code to an existing pipeline. However, when we save, error message shows that "Default schema" is a mandatory field. However, we are not able to edit the field. The DLT pipeline does not have a default schema as of now.

However, I see that "default schema" is mandatory since patch "Delta Live Tables now supports publishing to tables in multiple schemas and catalogs".

I have full admin rights on workspace.

Any ideas on how to go about this? Do we need create a new pipeline and set it up again?

1 ACCEPTED SOLUTION

Accepted Solutions

NandiniN
Databricks Employee
Databricks Employee

Does the pipeline settings JSON includes the "schema" field.

If you have full admin rights, you can update the existing pipeline settings to include the "schema" field.

Like 

curl -X PATCH https://<databricks-instance>/api/2.0/pipelines/<pipeline-id> \
-H "Authorization: Bearer <your-access-token>" \
-H "Content-Type: application/json" \
-d '{
  "schema": "your_default_schema"
}'

 

https://docs.databricks.com/en/delta-live-tables/properties.html

**schema **

Type: string

The name of the default schema for the pipeline, where all datasets and metadata for the pipeline are published by default. See Set the target catalog and schema.

View solution in original post

2 REPLIES 2

NandiniN
Databricks Employee
Databricks Employee

Does the pipeline settings JSON includes the "schema" field.

If you have full admin rights, you can update the existing pipeline settings to include the "schema" field.

Like 

curl -X PATCH https://<databricks-instance>/api/2.0/pipelines/<pipeline-id> \
-H "Authorization: Bearer <your-access-token>" \
-H "Content-Type: application/json" \
-d '{
  "schema": "your_default_schema"
}'

 

https://docs.databricks.com/en/delta-live-tables/properties.html

**schema **

Type: string

The name of the default schema for the pipeline, where all datasets and metadata for the pipeline are published by default. See Set the target catalog and schema.

Thank you!

Still, should it not be possible to change it in the UI?

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group