09-30-2022 12:25 PM
Hi,
I am able to read data from a Bigquery table ,But am getting error writing data to a table in Bigquery
Followed instuctions in this document.
Connecting Databricks to BigQuery | Google Cloud
%scala
import scala.io.Source
val contentCred = "/dbfs/FileStore/keys/uday_123.json"
val jsonBytes = Source.fromFile(contentCred).getLines.mkString
myEvents.write.format("bigquery").mode("overwrite").option("temporaryGcsBucket", "databricks-bq-789")
.option("credentials", new String(java.util.Base64.getEncoder.encode(jsonBytes.getBytes)))
.option("parentProject", "uday-***")
.option("project", "uday-***")
.option("table","uday-***.uday_testdata.employee1")
.save()
Error:
IOException: Error getting access token from metadata server at: http://169.254.169.254/computeMetadata/v1/instance/service-accounts/default/token
Caused by: HttpResponseException: 404 Not Found
GET http://169.254.169.254/computeMetadata/v1/instance/service-accounts/default/token
ResourceNotFound
The specified resource does not exist.
'computeMetadata' isn't a valid resource name.
10-02-2022 10:51 PM
Hi @uday s, There is a similar thread on our community with the best answer. Please have a look and let us know if that helps.
10-02-2022 11:13 PM
Thanks @Kaniz Fatma for the reply.
I have followed the steps mentioned in the thread, But I got the same error
OException: Error getting access token from metadata server at: http://169.254.169.254/computeMetadata/v1/instance/service-accounts/default/token
Caused by: HttpResponseException: 404 Not Found
Please note I am able to read data from Bigquery table, But not able to write data.
10-03-2022 11:12 PM
Could anyone reply on solution for this error
10-07-2022 08:40 AM
Hi @uday s,
I've encountered this issue earlier this week. Could you please ensure that your cluster configuration is correct? I was able to write to the BigQuery tables after following Step 2.
https://docs.databricks.com/data/data-sources/google/bigquery.html#step-2-set-up-databricks
Let me know if it works!
02-10-2023 10:38 AM
I've the same issue. I can read a BigQuery table.
But when I'm trying to save data into bigquery :
IOException: Error getting access token from metadata server at: http://169.254.169.254/computeMetadata/v1/instance/service-accounts/default/token
Caused by: HttpResponseException: 404 Not Found
GET http://***.***.***.***/computeMetadata/v1/instance/service-accounts/default/token
http://www.w3.org/2001/XMLSchema-instance"; xmlns:xsd="http://www.w3.org/2001/XMLSchema">
ResourceNotFound
The specified resource does not exist.
'computeMetadata' isn't a valid resource name.
10-22-2022 11:05 PM
Hi @uday s
Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help.
We'd love to hear from you.
Thanks!
Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections.
Click here to register and join today!
Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.