Databricks connect to GCS

[James1100]

Hi,

Would like to ask if anyone knows how to connect to GCS - basically read csv file from GCS bucket.

I have no issue connecting to Data Lake.

Thank you so much in advance.

[Kaniz · Accepted solution]

Hi @James C​ , 

read_csv 
 

supports reading directly from Google Cloud Storage.

Simply provide a link to the bucket like this:

df = pd.read_csv('gs://bucket/your_path.csv')

The read_csv will then use gcsfs module to read the DataFrame, which means it had to be installed (or you will get an exception pointing at missing dependency).

[Vartika]

Hi @James C​,

Just checking in. If @Kaniz Fatma​'s answer helped, would you let us know and mark the answer as best? If not, would you be happy to give us more information?

We'd love to hear from you.

Cheers!