A practical framework for choosing between Delta Tables and Materialized Views in Databricks pipelinesEvery few weeks someone on my team asks the same question.We’re designing a Gold aggregation - daily revenue by region, weekly active users, somethi...
Hi everyone,I’m currently deepening my Databricks learning journey and one thing I’ve noticed is that there are many ways to get started, but not all of them help equally once you move from theory to real projects.For those who already have some hand...
Hi, I'm glad it was helpful. I think people gravitate to their skillset in Databricks. So we tend to see statisticians and data scientists gravitating to the AI/ML and some basic data engineering. Whereas Data Engineers will stay in the Jobs and pipe...
I try to export a job as a DBA in order to create an Asset Bundle according to thishttps://community.databricks.com/t5/data-engineering/databricks-asset-bundle-dab-from-existing-workspace/td-p/49309I am on Windows 10 Pro x64 withDatabricks CLI v0.223...
To export an existing folder under /Workspace/... export-dir command could be used : databricks workspace export-dir /Workspace/Applications/ucx/logs/migrate-tables/run-123-0/ /Users/artem.sheiko/logs
When running a Databricks notebook,an error occurs stating that SOME_TABLE is not a Delta table.However, after executing the describe detail command and checking the format,the table is shown as Delta.Without taking any specific actions, re-running ...
Webinar: Goodbye, Data Warehouse. Hello, Lakehouse.The data warehouse had a good run. But now there’s a simpler, cheaper and more efficient alternative: the lakehouse. Come and learn all about it in a webinar on May 18, 2023.If you’re still running s...
