โ10-18-2023 03:22 AM
Hello,
I am working with Unity Catalogue in Azure Databricks. I have enabled the system schemas for my workspace but unable to figure out a way to send these system table logs to ADLS which I have mounted using Azure Databricks Connector.
Can someone help me with that? This documentation just talks about enabling and disabling.
#UnityCatalogue
โ10-18-2023 09:57 PM
โ10-19-2023 05:36 AM
@daniel_sahal Thanks for the response.
Is there any way to send Billable Usage Logs, Pricing Logs and others to ADLS as well? Will be of great help if you could share the documentation for that as well.
โ10-19-2023 12:28 PM
@Amber-26 please follow below steps in "export Billing data" and create custom queries this is one way. mostly system billing schema that you enabled have fields (sku etc.) should have match with main billing sheet .
looks there is no direct way to store system schema table logs
https://learn.microsoft.com/en-us/azure/azure-arc/data/view-billing-data-in-azure
โ10-19-2023 09:52 PM
Hello @karthik_p , thanks for your response. Although there is no way to send schemas logs to ADLS. One way I found is the perform an SQL query on the schema to get data and send it to ADLS as explained in this documentation
Let me know if this is the right way. Thanks!
โ10-20-2023 08:49 AM
@Amber-26 you can try this approach, also if you want to have graphical representation of everything you can use lakehouse monitoring feature, where after enabling these tables, you can consume them into dashboards and run them and analyze them
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโt want to miss the chance to attend and share knowledge.
If there isnโt a group near you, start one and help create a community that brings people together.
Request a New Group