language interface itself. Genie can generate SQL, but it still needs clear business definitions, relationships, metrics, and terminology to know what the user actually means. Databricks itself recommends well-documented datasets, SQL expressions, ex...
I’d avoid doing a dbutils.fs.ls followed by one Auto Loader stream per object type. That creates more streams/checkpoints as the number of object types grows.A cleaner pattern is to use one Auto Loader stream over the directory, extract objecttype fr...
