spark.sparkContext.setCheckpointDir - External Azure Storage

sintsan
New Contributor II

‎04-25-2023 01:40 AM

Is it possible to direct spark.sparkContext.setCheckpointDir to an external Azure Storage Container location (instead of DBFS) & if so how, there's very little documentation on that.

Labels:
0 Kudos