Brahmareddy
Esteemed Contributor II

Hi sparkycloud,

Thanks for your reply. You're right to be thinking about these limitations, especially with serverless. For audit logs on Azure, the older method with init scripts and JARs won’t work on serverless, but you can still use Azure Monitor’s diagnostic settings at the workspace level to push logs to Log Analytics, Event Hub, or Storage, and that works fine even with serverless since it’s handled outside the cluster. As for scheduling jobs across workspaces, I agree—it’s not scalable to maintain jobs in every workspace just to collect logs. You could script it using APIs from a central place, but it’s still overhead. Tools like Monte Carlo, Acceldata, or Unravel are definitely worth looking into, and yes, many of them support serverless and Unity Catalog, since they work through metadata or APIs rather than depending on your cluster type. If you want less operational headache and more visibility across workspaces, those tools are a solid long-term bet. Let me know if you want help picking or testing one!

Regards,

Brahma