BigQuery as foreign catalog - full object structs

[mdelvaux]

Hi -

We have mounted BigQuery, hosting Google Analytics data, as a foreign catalog.

When querying the tables, objects are returned as strings, with all keys obfuscated by "f" or "v", likely to avoid replicating object keys across all records and hence minimizing transfer of data.

How can these be mapped back to full object structure? Is there any off-the-shelf util / config?

Thanks,

Max

[Kaniz_Fatma]

Hi @mdelvaux, It seems like you're dealing with obfuscated keys in your BigQuery foreign catalog setup, which is a method to minimize data transfer by not replicating object keys across records. To map these keys back to their full object structures, you can consider creating a custom mapping logic or table that translates the obfuscated keys to their original names. You might also use BigQuery's Data Catalog to manage and search metadata, providing insights into your data's structure. Reviewing the Google Analytics export schema documentation can also be helpful, as it often details naming conventions used in exported data. For further assistance, sharing more details about your setup or specific challenges can help tailor the guidance.