- 5302 Views
- 1 replies
- 0 kudos
delta lake in Apache Spark
Hi,As per documentation https://docs.delta.io/latest/quick-start.html , we can configure DeltaCatalog using spark.sql.catalog.spark_catalog.The Iceberg supports two Catalog implementations (https://iceberg.apache.org/docs/latest/spark-configuration/#...
- 5302 Views
- 1 replies
- 0 kudos
- 0 kudos
@Arun Sethia​ :Yes, Delta Lake also supports custom catalogs. Delta Lake uses the Spark Catalog API, which allows for pluggable catalog implementations. You can implement your own custom catalog to use with Delta Lake.To use a custom catalog, you can...
- 0 kudos
- 7619 Views
- 7 replies
- 4 kudos
Resolved! Unsupported cloud file system schema 'wasbs' error in custom catalog, but not in hive_metastore
When trying to run a create table USING CSV that pulls data from an azure blob storage path in a custom catalog I created, I get an error stating Unsupported cloud file system schema 'wasbs'.However, when I run this code in the hive_metastore catalog...
- 7619 Views
- 7 replies
- 4 kudos
