Databricks Community

Coffee77

 En este video, creado como recordatorio para mi mala memoria a largo plazo, explico de forma sencilla: ✅ Qué es un DataFrame ✅ Cómo se distribuye en particiones ✅ Cómo se ejecuta en un cluster (driver y workers) ✅ Qué ocurre en un shuffle✅ Relació...

Coffee77 · 01-20-2026

Here is a very short video on how to use collect() method with caution as it could overwhelm the cluster in some big data scenarios!!!! Now only in Spanish but I guess youtube will do the trick to translate into very correct English xDD

Coffee77 · 11-14-2025

Hi guys,I am trying to use table_changes CDF function in an external SQL function run it from an SQL Warehouse serverless cluster in order to retrieve a set of changes from a given table. Here is the documentation for this fuunction:https://docs.data...

Coffee77 · 11-11-2025

In this video, I try to showcase in a very simplified way how to enable and setup AI & BI dashboards to control costs and take actions. I hope this could be useful. I think it is a superb feature to get insights on costs while straightforward to setu...

Coffee77 · 11-09-2025

Hi guys!Working recently in fully understanding (and helping others...) Databricks Asset Bundles (DAB) and having fun creating some diagrams with DAB flow at high level. First one contains flow with a simple deployment in PROD and second one contains...

Coffee77

Take a look at this: https://docs.databricks.com/aws/en/jobs/monitor#finished-runs-count-graph I think that is the correct expected way of getting you're looking for.

Coffee77

Nothing to do with that. You can use Free Edition in Azure for sure. I guess your problem is you should create your workspace in Azure, not in AWS. Here are more details about it: https://learn.microsoft.com/en-us/azure/databricks/getting-started/fre...

Coffee77

Recently, I am creating some "self-reminder" videos for helping my long-term poor human memory  and maybe to help others. Understand internals of Dataframes, how partitions are related to jobs, stages, shuffles and tasks and, how transformations or ...

Coffee77

This is a fairly generic question because the answer depends not only on the worker node configuration, but also on the Spark configuration—particularly how partitions are handled before and after shuffles. Other important considerations include whet...

Coffee77 · 01-20-2026

Thanks for mentioning with a little bit of delay 

Databricks Community

User Stats

User Activity

🇪🇸 Por qué el DataFrame es el objeto de datos más importante en el procesamiento distribuido

Very short video on tip about Collect() method!!!

How to inject non-literal values in "table_changes" CDF function?

Control Databricks Costs with AI & BI Dashboards - Video Summary

Databricks Asset Bundles - High Level Diagrams Flow

Re: Why count Run Status not Showing

Re: Issue on Service Credential creation for Azure Databricks access connector

Re: 🇪🇸 Por qué el DataFrame es el objeto de datos más importante en el procesamiento distribuido

Re: Best clusters configuration to process 100gb data??

Re: 🎬 Databricks Community 2025 Highlights | A Year, Built Together