Databricks Community

szymon_dybczak

Databricks has a new/updated feature in Beta: Databricks Container Services for standard compute.Docs: https://docs.databricks.com/aws/en/compute/custom-containers-standardWith this feature, you can specify a Docker image when creating standard compu...

szymon_dybczak

With Genie Code, you can now add a Tableau or Power BI file and have it build an AI/BI dashboard that replicates your existing visualizations - while connecting them to metric views that mirror the underlying business logic.Import BI files using Geni...

szymon_dybczak

For a long time, one of the hardest questions in lakehouse architecture was:How do we let external engines access governed data without bypassing governance?Databricks is making this pattern much cleaner with Unity Catalog external access.The idea is...

szymon_dybczak

If your CI/CD pipelines suddenly started failing out of nowhere with this error:"error downloading Terraform: unable to verify checksums signature: openpgp: key expired"and you’re using Databricks CLI - you’re probably hitting the same issue I did.Th...

szymon_dybczak

One of the more frustrating things when working with materialized views in Databricks was checking whether a view had refreshed incrementally. One way to verify it was by checking the event log, but that required running the pipeline and executing a ...

szymon_dybczak

Hi @Shivaprasad ,It can be networking issue. Could you tell us your networking setup? Does your storage account has public network access disabled?Are you using standalone materialized view or you're creating MV via SDP pipeline?

szymon_dybczak

Hi @Shivaprasad ,Nope, all purpose cluster are not supported. Standalone materialized views can be created/refreshed either from a Unity Catalog-enabled Pro or Serverless SQL Warehouse, or from a notebook attached to Serverless General Compute. So we...

szymon_dybczak

Hi @loujiang ,Databricks Runtime is not a vanilla Apache Spark distribution. DBR is built on top of a highly optimized version of Apache Spark, but also adds enhancements and additional components that substantially improve usability, performance, an...

szymon_dybczak

Hi @Alessio_F ,This happens because in Databricks SQL both year and month functions are just aliases over following patterns:- extract (YEAR FROM expr)- extract(MONTH FROM expr) When Databricks pushes a predicate or expression down to the remote SQL ...

szymon_dybczak

Hi @Brahmareddy ,There's no outage. You can already check the status on following page:https://status.databricks.com/I've also checked on my end and everything is working as expected. What issues did you encounter?If my was helpful, please consider m...

Databricks Community

User Stats

User Activity

Databricks Container Services now available for Standard Compute - custom Docker images in shared co

Databricks now supports importing Tableau and Power BI files into Genie Code to automatically build

Access Databricks data using external systems

Mitigation for "error downloading Terraform" during bundle deployments

Finally! A simple way to validate whether your Materialized View can actually refresh incrementally

Re: Can we able to create materialized view in databricks using all purpose cluster

Re: Can we able to create materialized view in databricks using all purpose cluster

Re: Databricks Runtime, Pyspark and Spark Versions

Re: Extract SQL function in SQL Server federated database

Re: Databricks Free Edition Suddenly Not Working and unable to login