Databricks Community

I have the same error if I query SELECT 1 from remote_query(). From documentation:> To use the remote_query function, you first need to create a Unity Catalog connectionSo, not sure why it rebels against creators

yes, I would take that as a pinch of salt

Databricks Job/Task parameter interface does not provide a built-in UI feature to restrict the possible values entered by user. Yoou can add a runtime validation code inside the notebook to allow/fail based on the values entered in.

As the User IDs and Group IDs share the same namespace in Databricks you cannot create a Group with the same email address that is already registered as a User in your Databricks account.You better rename the group.

Thanks for your quick and extensive reply.Given that I don't have any administration rights on the Azure/Databricks environment and don't have the REST-server under control, some of the sensible suggestions are difficult.I will work with IT to check ...

Classic 360 Custoemr View case and Databricks is certainly the right platform to do so.Strcutred Data - Stores in the Delta TablesEmail and PDFs - stored in Volumes, however, metadata as path to the volumes stored in delta table against customer-idIn...

Hi Suheb, when using delta tables with databricks, whenever you use proper liquid clustering indexes or partitions, you should get a good performance in comparison to relational engines to deal with big data volumes.However, you can also separate tab...

Databricks can install Maven libraries by coordinate and lets you point at a custom repository URL. However, passing credentials for authenticated private Maven repositories directly through the Libraries UI/Jobs is not natively supported today and r...

Migrating large on-premise ETL workflows to Databricks often goes wrong when teams try to “lift and shift” legacy logic directly into Spark. Poor data layout, tiny files, and inefficient partitioning can quickly hurt performance, so restructuring dat...

What Spark Does During a Broadcast Join-Spark identifies the smaller table (say 80MB).The driver collects this small table to a single JVM.The driver serializes the table into a broadcast variable.The broadcast variable is shipped to all executors.Ex...

I would need to dive deeper in your scenario but it sounds to me a strategy could be:1) Create a view in your SQL Server database with "current data" UNION "historical data". You can set an additional boolean field with True in first query and False ...

@excavator-matt “Can we tag streaming tables with ABAC and expect it to be safe across versions?”Yes, streaming tables are fully subject to UC ABAC, but if the table is physically recreated, table‑level tags can be lost“Is there first‑class support i...

Can you try by explicitly adding: databricks model-versions get-by-alias <catalog>.<schema>.<model> staging