Databricks

Managed tables are stored under the /user/hive/warehouse, which is also mentioned in the documentation. In our workflow, we use that path to read the parquet files from outside (through databricks connector). Can we assume this path is reliable, or i...

The usual way to use Apache Sedona inside pySpark is by first registering Sedona types and functions withSedonaRegistrator.registerAll(spark)We need to have these autoregistered when the cluster start (to be able, for example, to perform geospatial q...