Not Able To Access GCP storage bucket from Databricks
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-09-2025 03:41 AM
While running :
df = spark.read.format("csv") \
.option("header", "true") \
.option("inferSchema", "true") \
.load('path')
df.show()
Getting error : java.io.IOException: Invalid PKCS8 data.
Cluster Spark Config :
spark.hadoop.fs.gs.auth.service.account.private.key.id {{secrets/newscope/gsaprivatekeyid}} spark.hadoop.fs.gs.auth.service.account.private.key {{secrets/newscope/gsaprivatekeynew}} spark.hadoop.google.cloud.auth.service.account.enable true spark.hadoop.fs.gs.project.id <projectid> spark.hadoop.fs.gs.auth.service.account.email <email id>
Have followed the document : Connect to Google Cloud Storage - Azure Databricks | Microsoft Learn
Please Help
