https://community.databricks.com/t5/data-engineering/is-it-possible-to-have-customized-task-parameter-variables/m-p/6967#M2964 <P>@Yanan Zhang​&nbsp;:</P><P></P><P>As per the documentation you shared, Databricks Task parameter variables are used to parameterize notebook tasks in a Databricks workspace. These variables are used to pass values from the parent notebook to the child notebook that is being executed as a task. However, it appears that Databricks currently only supports a predefined set of whitelisted Task parameter variables, and it does not explicitly mention support for custom variables.</P><P>The whitelisted Task parameter variables that are currently supported in Databricks include:</P><UL><LI>{{task_id}}: The unique identifier of the task.</LI><LI>{{task_run_number}}: The number of times the task has been run.</LI><LI>{{task_run_id}}: The unique identifier of the current task run.</LI><LI>{{task_retry_number}}: The number of times the task has been retried.</LI><LI>{{task_max_retries}}: The maximum number of retries allowed for the task.</LI></UL><P>These variables can be used in notebook cells or in the notebook parameters to dynamically pass values during the execution of notebook tasks.</P><P>If you need to use custom variables or parameters in your Databricks tasks, you may need to implement your own logic within the notebooks to handle these custom variables, such as passing them as input parameters or reading them from external sources like configuration files or environment variables. You can use standard Python or Scala code within the notebooks to handle these custom variables as needed.</P> Wed, 05 Apr 2023 01:23:18 GMT Anonymous 2023-04-05T01:23:18Z https://community.databricks.com/t5/data-engineering/is-it-possible-to-have-customized-task-parameter-variables/m-p/6966#M2963 <P>I found some <A href="https://docs.databricks.com/workflows/jobs/jobs.html?_gl=1*paalo7*_gcl_aw*R0NMLjE2NzkzMzA2ODYuQ2p3S0NBandpT0NnQmhBZ0Vpd0FqdjV3aENJTzMzQlRsSE5vZWpBUnVEU3hWMGx1RC0zUExqd194S3dDaXpRU1hnMzI4Ri1vUVQ3OGN4b0NKTVlRQXZEX0J3RQ..&amp;_ga=2.67481617.1492280226.1679941569-45feea20-8f83-471c-ba10-67d8c9594e8f&amp;_gac=1.261304063.1679330688.CjwKCAjwiOCgBhAgEiwAjv5whCIO33BTlHNoejARuDSxV0luD-3PLjw_xKwCizQSXg328F-oQT78cxoCJMYQAvD_BwE#id4" alt="https://docs.databricks.com/workflows/jobs/jobs.html?_gl=1*paalo7*_gcl_aw*R0NMLjE2NzkzMzA2ODYuQ2p3S0NBandpT0NnQmhBZ0Vpd0FqdjV3aENJTzMzQlRsSE5vZWpBUnVEU3hWMGx1RC0zUExqd194S3dDaXpRU1hnMzI4Ri1vUVQ3OGN4b0NKTVlRQXZEX0J3RQ..&amp;_ga=2.67481617.1492280226.1679941569-45feea20-8f83-471c-ba10-67d8c9594e8f&amp;_gac=1.261304063.1679330688.CjwKCAjwiOCgBhAgEiwAjv5whCIO33BTlHNoejARuDSxV0luD-3PLjw_xKwCizQSXg328F-oQT78cxoCJMYQAvD_BwE#id4" target="_blank">Task parameter variables</A> in this document, <A href="https://community.databricks.com/s/feed/0D58Y0000A7AUWhSQO" target="test_blank">https://community.databricks.com/s/feed/0D58Y0000A7AUWhSQO</A>. Sounds like it will be much flexible with double curly braces for Task parameter variables. However, from the documentation, seems only a whitelisted variables are supported. Is it possible to have customized (i.e. created by myself) task variables?</P> Mon, 27 Mar 2023 23:14:26 GMT https://community.databricks.com/t5/data-engineering/is-it-possible-to-have-customized-task-parameter-variables/m-p/6966#M2963 yzhang 2023-03-27T23:14:26Z https://community.databricks.com/t5/data-engineering/is-it-possible-to-have-customized-task-parameter-variables/m-p/6967#M2964 <P>@Yanan Zhang​&nbsp;:</P><P></P><P>As per the documentation you shared, Databricks Task parameter variables are used to parameterize notebook tasks in a Databricks workspace. These variables are used to pass values from the parent notebook to the child notebook that is being executed as a task. However, it appears that Databricks currently only supports a predefined set of whitelisted Task parameter variables, and it does not explicitly mention support for custom variables.</P><P>The whitelisted Task parameter variables that are currently supported in Databricks include:</P><UL><LI>{{task_id}}: The unique identifier of the task.</LI><LI>{{task_run_number}}: The number of times the task has been run.</LI><LI>{{task_run_id}}: The unique identifier of the current task run.</LI><LI>{{task_retry_number}}: The number of times the task has been retried.</LI><LI>{{task_max_retries}}: The maximum number of retries allowed for the task.</LI></UL><P>These variables can be used in notebook cells or in the notebook parameters to dynamically pass values during the execution of notebook tasks.</P><P>If you need to use custom variables or parameters in your Databricks tasks, you may need to implement your own logic within the notebooks to handle these custom variables, such as passing them as input parameters or reading them from external sources like configuration files or environment variables. You can use standard Python or Scala code within the notebooks to handle these custom variables as needed.</P> Wed, 05 Apr 2023 01:23:18 GMT https://community.databricks.com/t5/data-engineering/is-it-possible-to-have-customized-task-parameter-variables/m-p/6967#M2964 Anonymous 2023-04-05T01:23:18Z