H @szymon_dybczak , thank you for the advice. After investigating the problem has been solved. 

The error message mentioned in the title is not the key, the below error message “A pipeline with a different id is already registered in this Credential Scope. The pipeline in a CredentialScope cannot be updated once it is registered” leads me to a similar question with the answer: https://community.databricks.com/t5/data-engineering/describe-table-extended-on-materialized-views-u...

The reason why this issue happened is because I isolated this SQL task(file) into an independent pipeline. So the way to fix it is just merge the event query task with the pipeline which generates the target table together.

bronze_pipeline:
      libraries:
        - file:
            path: ./bronze/pipeline.py
        - file:
            path: ./bronze/data_quality_check.sql