For your tables, I’m curious if you could utilize Liquid Clustering to reduce some of the maintenance issues relating to choosing Z-Order vs. partitioning.
Saying this, one potential way is to read the Delta transaction log and read the Add Info st...
Hi @Kamaldeep Singh​ Just so you know, this is an open hackathon and does not require Databricks, so we cannot offer cloud/service credits. As mentioned in other threads, using a cloud/service is not required to participate in this open hackathon Th...
The `fireCallsDelta` table already exists, and it appears it was created as a PARQUET table. A couple of options:DELETE the original Parquet table as a separate statement (i.e., in a separate cell so it can complete itself before any other jobs exe...
Please note, the issue noted above [Storage System] Support for AWS S3 (multiple clusters/drivers/JVMs) is for Delta Lake OSS. As noted in this issue as well as Issue 324, as of this writing, S3 lacks putIfAbsent transactional consistency. For Del...
