https://community.databricks.com/t5/machine-learning/what-are-the-recommended-practices-for-handling-skewed-datasets/m-p/141635#M4474 <P>What should you do when your dataset is uneven—some values appear too many times and others appear very few times—while working in Databricks?</P> Thu, 11 Dec 2025 07:18:17 GMT Suheb 2025-12-11T07:18:17Z https://community.databricks.com/t5/machine-learning/what-are-the-recommended-practices-for-handling-skewed-datasets/m-p/141635#M4474 <P>What should you do when your dataset is uneven—some values appear too many times and others appear very few times—while working in Databricks?</P> Thu, 11 Dec 2025 07:18:17 GMT https://community.databricks.com/t5/machine-learning/what-are-the-recommended-practices-for-handling-skewed-datasets/m-p/141635#M4474 Suheb 2025-12-11T07:18:17Z https://community.databricks.com/t5/machine-learning/what-are-the-recommended-practices-for-handling-skewed-datasets/m-p/141640#M4475 <P>Hi&nbsp;<a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/194685">@Suheb</a>&nbsp;,</P><P>Refer to really good guide prepared by Databricks team. When you have a skewed dataset the primary things you can do are following:</P><P><STRONG>1. Filter skewed values</STRONG></P><P><STRONG>2. Apply&nbsp;Skew hints</STRONG></P><P><STRONG>3.&nbsp;AQE skew optimization</STRONG></P><P><STRONG>4.&nbsp;Salting</STRONG></P><P>Much detailed description of above terms can be found in below guide:</P><P><A href="https://www.databricks.com/discover/pages/optimize-data-workloads-guide#skew-remediation" target="_blank">Comprehensive Guide to Optimize Data Workloads | Databricks</A></P> Thu, 11 Dec 2025 08:41:58 GMT https://community.databricks.com/t5/machine-learning/what-are-the-recommended-practices-for-handling-skewed-datasets/m-p/141640#M4475 szymon_dybczak 2025-12-11T08:41:58Z