cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Error when creating a delta live table pipeline

NM447101
New Contributor II

INVALID_PARAMETER_VALUE: Validation failed for node_type_id, the value must be Standard_DS3_v2 (is "Standard_F8s")

image 

3 REPLIES 3

NM447101
New Contributor II

specify node_type_id in the json file when creating the pipeline

Tayyab_Vohra
Contributor

The error message indicates that there is an issue with the node type that you have specified for your Delta Live Table pipeline in Databricks. Specifically, the node type must be set to "Standard_DS3_v2", but the error message indicates that it has been set to "Standard_F8s", which is not a valid node type for the pipeline.

To resolve this issue, you should update the configuration of your Delta Live Table pipeline to use a valid node type. You can typically do this by modifying the configuration file for the pipeline or updating the parameters that are passed to the pipeline when it is created.

In this case, you should update the node type to "Standard_DS3_v2". This can be done in the Databricks UI by selecting the pipeline and then updating the "node_type_id" parameter to the correct value. Alternatively, you can update the configuration file for the pipeline and then recreate the pipeline using the updated configuration.

Once you have updated the node type to a valid value, you should be able to run your Delta Live Table pipeline without encountering any validation errors.

Anonymous
Not applicable

Hi @Nitya Mehta​ 

Thank you for posting your question in our community! We are happy to assist you.

To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your question?

This will also help other community members who may have similar questions in the future. Thank you for your participation and let us know if you need any further assistance! 

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group