cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results forย 
Search instead forย 
Did you mean:ย 
Help
Data Engineering
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results forย 
Search instead forย 
Did you mean:ย 

DBFS with Google Cloud Storage(GCS)

Go to solution
rajib76
New Contributor II

โ€Ž03-11-2022 12:20 PM

Does DBFS support GCS?

1 ACCEPTED SOLUTION

Accepted Solutions

Go to solution
Hubert-Dudek
Esteemed Contributor III

โ€Ž03-12-2022 02:51 AM

Yes you need just to create service account for databricks and than assign storage admin role to bucket. After that you can mount GCS standard way:

bucket_name = "<bucket-name>"
mount_name = "<mount-name>"
dbutils.fs.mount("gs://%s" % bucket_name, "/mnt/%s" % mount_name)
display(dbutils.fs.ls("/mnt/%s" % mount_name))

more info here https://docs.gcp.databricks.com/data/data-sources/google/gcs.html

View solution in original post

1 REPLY 1

Go to solution
Hubert-Dudek
Esteemed Contributor III

โ€Ž03-12-2022 02:51 AM

Yes you need just to create service account for databricks and than assign storage admin role to bucket. After that you can mount GCS standard way:

bucket_name = "<bucket-name>"
mount_name = "<mount-name>"
dbutils.fs.mount("gs://%s" % bucket_name, "/mnt/%s" % mount_name)
display(dbutils.fs.ls("/mnt/%s" % mount_name))

more info here https://docs.gcp.databricks.com/data/data-sources/google/gcs.html

Announcements
Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.