System Tables Preview - retention period?

[alexometis]

The new System Tables for billing, pricing & compute look really useful and easier to consume than getting it via the APIs.

However I can't see in the documentation:

• Does data only start being gathered when you turn them on or is there immediately a history there?
• Regardless, what is the retention period of the data in there - 30 days like table history or longer or configurable?

Does anyone know? We're on a trial account so we don't have much history to test this on - and it appears we can't raise a support ticket to ask either! 

[alexometis]

Hi @Retired_mod ,

Really appreciate the responses and detail. A couple of follow ups:

Data Collection Start: When we enabled them, we saw data in them from the previous day (when our trial started). So it seems it captures some back-in-time data... do you know how much? Or have we misread our tables? 

Retention Period: Where are these configurable? I can't see anything in the documentation or API responses that indicate a way to do this.

[Avvar2022]

@Retired_mod  -

We are customer of databricks. Have databricks premium workspace with unity catalog enabled. and we have also legacy workspaces (non-unity enabled).

I can see history is available for all workspaces (unity and non-unity) in same meta store region.

Regarding retention - storage location is as below, looks like data is store in control plane on databricks. Since data is not stored in data plane, we can't configure LCM on our end. Currently it is preview will this change in once it becomes GA?

Storage location: uc-deltasharing://system.access.audit#system.access.audit