Hubert-Dudek
Databricks MVP

‎12-05-2022 11:59 AM

try that

https://spark.apache.org/docs/3.1.3/api/python/reference/api/pyspark.sql.functions.percentile_approx...

there is also Psypark Pandas function but haven't used Pandas on Spark with dlt

https://spark.apache.org/docs/latest/api/python/reference/pyspark.pandas/api/pyspark.pandas.DataFram...


My blog: https://databrickster.medium.com/