โ03-16-2023 12:05 AM
Hi all,
We are using Azure Databricks.
We would like to see if we can track usage of jobs initiated from Tableau /Python (via simba spark ODBC driver)
One way we can think of is to add tag to the job.
But we are not sure if we can add tags to job when we use ODBC driver.
appreciate if any one can guide us on this.
Thanks!
โ03-20-2023 05:04 AM
@Vidula Khannaโ We can add custom values to the job clusters as well. When you create the job task, click on edit cluster details which will take you to the cluster configuration where you can add the custom tags. In case of Tableau queries, it would be ODBC queries on which we can't customize the cluster configurations. The ODBC/JDBC queries will be run on existing clusters, so add the custom tags to these clusters.
https://docs.databricks.com/workflows/jobs/jobs-quickstart.html#create-a-job
โ03-17-2023 08:06 PM
@lewis wongโ You can add custom tags to the cluster/SQL warehouse on which Tableau/ODBC queries are run. Those tags will be propagated to Azure VMs. and you can use them in the cost analysis.
https://learn.microsoft.com/en-us/azure/databricks/clusters/configure#cluster-tags
https://learn.microsoft.com/en-us/azure/databricks/sql/admin/sql-endpoints
โ03-19-2023 07:21 PM
Hi @Vidula Khannaโ
Thanks a lot for the reply!
Does it mean that tags can only be added to cluster? Individual jobs won't be able to have its own tag?
Thanks again!
โ03-18-2023 12:36 AM
Hi @lewis wongโ
Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.
Please help us select the best solution by clicking on "Select As Best" if it does.
Your feedback will help us ensure that we are providing the best possible service to you.
Thank you!
โ03-20-2023 05:04 AM
@Vidula Khannaโ We can add custom values to the job clusters as well. When you create the job task, click on edit cluster details which will take you to the cluster configuration where you can add the custom tags. In case of Tableau queries, it would be ODBC queries on which we can't customize the cluster configurations. The ODBC/JDBC queries will be run on existing clusters, so add the custom tags to these clusters.
https://docs.databricks.com/workflows/jobs/jobs-quickstart.html#create-a-job
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโt want to miss the chance to attend and share knowledge.
If there isnโt a group near you, start one and help create a community that brings people together.
Request a New Group