Databricks Community

huytran · 12-01-2024

I am following this guide on writing data to the BigQuery table.Right now, I have an error when I try to write data using Databricks Secret instead of the JSON credential file and setting the GOOGLE_APPLICATION_CREDENTIALS environment variable. java....

huytran · 12-09-2024

@VZLA I checked my cluster setup and it is a shared cluster. Many people in my company can use it for their notebook.And here is the full stackstrace:--------------------------------------------------------------------------- Py4JJavaError ...

huytran · 12-09-2024

Hi @VZLA The code returns below. The 2nd print command returns "[REDACTED]" and I think it is because we don't encode it.GOOGLE_APPLICATION_CREDENTIALS: /tmp/cred.json [REDACTED] And I got the same error above:Py4JJavaError: An error occurred while c...

huytran · 12-09-2024

Hi @VZLA I tried to get the Databricks Secret, write to a temporary file, and set the temporary file path to GOOGLE_APPLICATION_CREDENTIALS with the code below. And yes, I have to encode the Secret value so I can write it to a temporary file.cred = d...

Databricks Community

User Stats

User Activity

Cannot write data to BigQuery when using Databricks secret

Re: Cannot write data to BigQuery when using Databricks secret

Re: Cannot write data to BigQuery when using Databricks secret

Re: Cannot write data to BigQuery when using Databricks secret