Databricks Community

Hey @Yunky007 You should use the cron expression 0 10 * * * to start the process at 10 AM.Then, inside your script, implement a loop or mechanism that keeps the logic running for 10 hours, that’s the trick. import time from datetime import datetime, ...

Hello @BhavyaSreeBanga! The Genie - Upload File option might need to be explicitly enabled by your Databricks account team, even if you have admin access and can see other Genie features. It’s worth checking with your account team to see if it’s been...

Hey @BigAlThePal, It looks like a UI bug, especially in Microsoft Edge. The code actually runs, but the output doesn't show until you refresh. A few quick things you can try:Run cells individually instead of using "Run All"Switch to Chrome or Firefox...

Hi @jakobhaggstrom, this error likely occurs due to the type of secret you're using. For M2M authentication, the Databricks JDBC driver requires a Databricks generated OAuth secret, not a Microsoft Entra ID client secret. While your service principal...

Hi @petitregny ,The issue you’re encountering is likely due to the access mode of your cluster. Serverless compute uses standard/shared access mode, which does not allow you to directly access AWS credentials (such as the instance profile) in the sam...

Hey @notwarte,Using the __databricks_internal catalog to trace the underlying storage location is a solid approach for investigating their footprint.Regarding your question about storage duplication: yes, materialized views in Databricks do store a p...

Hi @KIRKQUINBAR, if you enable Predictive Optimization at the metastore level in Unity Catalog, it automatically applies to all Unity Catalog managed tables within that metastore, no matter which workspace is accessing them. PO runs centrally, so the...

Hi, All the information for the creation and modification of assets is recorded within the system tables. Perhaps, when a catalog is created, a possible solution could be to trigger a job that notifies the central team about this event.

Hello!To parametrize a Databricks DLT pipeline with a static configuration file using Asset Bundles, include your JSON/YAML config file in the bundle. In your DLT pipeline code, read this file using Python's file I/O (referencing its deployed path). ...

Why don't Databricks engage with external prometric centres like other vendors so that exams can be given without any glitches ?