cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Column access patterns

noorbasha534
Valued Contributor II

Hello all

Floating this question again separately ((few weeks ago I clubbed this as part of predictive optimization)) -

Has anyone cracked to get the list if columns being used in joins & filters, especially in the context that access to end users is given at views level (not table level) & these views can be deeply nested until the point we trace the underlying tables...

The idea is to map these columns back to the original/underlying tables...

Appreciate the mind share here.

Br,

Noor.

1 REPLY 1

SP_6721
Contributor III

Hi @noorbasha534 ,

Iโ€™m not aware of a direct way to do this, but one approach is to parse each viewโ€™s SQL definition to identify the columns used in join and filter conditions, then use lineage tools to trace them through nested views back to the underlying tables.

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local communityโ€”sign up today to get started!

Sign Up Now