Databricks Community

Hi @neerajdubey_86,   Photon will almost certainly make your queries faster, but whether it also makes them cheaper depends on your workload.   Photon is Databricks native vectorized query engine. It replaces the JVM-based Spark execution layer with ...

Hi,   Interesting topic, I've pulled together some relevant info for you: TLDR If your underlying data is in Cloudflare R2, the cloud-provider egress charge for cross-cloud Delta Sharing is effectively zero because R2 does not charge for egress. Howe...

@AndreiaC Databricks Apps are currently not supported as an asset type in Databricks Marketplace. While Marketplace supports data assets, tables, views, volumes, notebooks, machine learning models and MCP servers (Preview), Apps operate under a diffe...

As suggested by @ShamenParis 1 - DROP SCHEMA catalog_name.schema_name CASCADE;2 - resource "databricks_schema" "this" { catalog_name = databricks_catalog.this.name name = "example" force_destroy = true }

@cltj This is a classic example of how an architecture can become difficult to scale over time. Initially, we onboarded only a few clients and maintained client-specific tables. However, as the number of clients grew, the solution resulted in a large...

@Abishrp Most of the platform level administrative APIs require full Account Admin or Workspace Admin privileges. At the account level - tasks like workspace creation, listing all workspaces, managing account-wide settings, handling workspace assignm...

@vamsi_simbus You can stage the wheel & other files inside a Unity Catalog Volume governed by strict schema level RBAC. You can use a a dedicated Service Principal that owns the bundle resources (jobs, DLT pipelines, Databricks Apps etc). You can gra...

Based on my understanding, that is the expected case. The Cost management gives data at aggregated level and not granular one. In case if there is a need to identifying user to model suage, then we would have to enable diagnostic setting into Azure A...