Hi @shan-databricks When MongoDB has fields where all sampled documents are null, Spark cannot infer a data type, so it assigns NullType (void). Delta Lake rejects this because it needs a concrete type for Parquet storage.My suggestion would be the F...
Hi @Raj_DB ,For reliable 30-day trend reporting, don't rely on time travel — use an explicit snapshot table instead.The pattern:1. Daily job appends a snapshot of your source table to a history table with a snapshot_date partition column2. Purge rows...
Hi @DineshOjha The best approach is parameterized SQL with widget-based defaults in your Python wrapper, wired to DABs target variables. Why this works on both fronts: Engineers run the notebook interactively and widget defaults kick in (dev values)....
Hi @AnandGNR ,My understanding based on above error was your org has a policy: "Private endpoint must be configured for Key Vault" with effect deny. When Databricks tries to programmatically grant its SP Get/List on your vault during scope creation, ...
Hi @AnandGNR ,The userAADToken error means the CLI doesn't support AKV scope creation — use the REST API directly with an Azure AD token instead of a Personal Access Token.
