I agree that status updates must be useful and actionable.

If I understood your question correctly, you want to have the Databricks service notifications to be available in a Databricks table. I wouldn't use email subscription for this. I would use the webhook approach.

I am not proficient with Azure though so I can only describe the design in general terms:

  • Deploy a serverless HTTP endpoint (maybe with Azure Logic Apps or Azure Functions). The purpose of the endpoint would be to save incoming requests to blob storage.
  • Submit the endpoint URL to the status page and configure which notifications you want to receive. 
  • Set up incremental ingestion from blob storage in Databricks and trigger it by a schedule at a desired frequency to collect the notifications from blob storage and save them to a Delta table.
  • Set up downstream processes that would trigger other actions in response to specific notifications.

I hope this helps!