Hi @johschmidt42 ,This is a great question, but the mystery actually lies in the very first line of your read configuration: spark_session.readStream.format(source="delta")Because you are using .format("delta") instead of .format("cloudFiles"), you a...
Hello @Vamsi3757 , This is an excellent architecture question. You are completely right to avoid PATs (due to lifecycle/security risks) and Service Principals (which mask individual user identities and make Unity Catalog audit logging difficult).To s...
Hello there,This is a really insightful question. I completely understand why this feels counterintuitive at first, especially if you are looking at it purely through the lens of traditional lexical scoping (where a local variable usually shadows a g...
