configure AWS authentication for serverless Spark

liu
Contributor

I only have an AWS Access Key ID and Secret Access Key, and I want to use this information to access S3.

However, the official documentation states that I need to set the AWS_SECRET_ACCESS_KEY and AWS_ACCESS_KEY_ID environment variables, but I cannot find a way to set these two environment variables.

documentation: Connect to Amazon S3 | Databricks on Google Cloud