topic Re: Pass catalog/schema/table name as a parameter to sql task in Data Engineering

Pass catalog/schema/table name as a parameter to sql task

EdemSeitkh — Tue, 23 Jan 2024 14:52:08 GMT

Hi, i am trying to pass catalog name as a parameter into query for sql task, and it pastes it with single quotes, which results in error. Is there a way to pass raw value or other possible workarounds?

query:

INSERT INTO {{ catalog }}.pas.product_snapshot
SELECT ...

task parameters

 { "catalog": "dev" }

error message:

[PARSE_SYNTAX_ERROR] Syntax error at or near ''dev''.(line 1, pos 12) == SQL == INSERT INTO 'dev'.pas.product_snapshot  SELECT ...

Thanks!

Re: Pass catalog/schema/table name as a parameter to sql task

EdemSeitkh — Tue, 23 Jan 2024 15:05:15 GMT

workaround that worked for me was to create databricks sql query, add enum parameter and use that query in task, instead of git file.

Re: Pass catalog/schema/table name as a parameter to sql task

shan_chandra — Tue, 23 Jan 2024 16:01:50 GMT

@EdemSeitkh - you may need to populate in a single quote -'{{ catalog }}'. Hopefully, you had created a sql query in DBSQL query editor and it will provide the parameters to populate in the UI itself like below example.

Re: Pass catalog/schema/table name as a parameter to sql task

EdemSeitkh — Wed, 24 Jan 2024 16:40:28 GMT

@shan_chandra yes, i have created with DBSQL query and it worked fine. Previously it was using direct file from git and had this issue i described.

Re: Pass catalog/schema/table name as a parameter to sql task

lathaniel — Tue, 09 Apr 2024 22:37:52 GMT

@EdemSeitkh can you elaborate on your workaround? Curious how you were able to implement an enum paramter in DBSQL.

I'm running into this same issue now.

Re: Pass catalog/schema/table name as a parameter to sql task

jeroaranda — Wed, 29 May 2024 23:37:38 GMT

dropdownlist works well, however it doesnt work when i do a dynamic parameter like {{task.name}}.

Any one got a solution?

Re: Pass catalog/schema/table name as a parameter to sql task

detom — Mon, 05 Jan 2026 20:52:45 GMT

This works

USE CATALOG IDENTIFIER({{ catalog_name }});
USE SCHEMA IDENTIFIER({{ schema_name }});