Access azure storage account from databricks notebook using pyspark or SQL

Ambi
Databricks Partner

‎04-04-2022 09:34 AM

I have a storage account - Azure BLOB Storage

There I had container. Inside the container we had a CSV file. Couldn't read the file using the access Key and Storage account name.

Any idea how to read file using PySpark/SQL? Thanks in advance

Labels:

Hubert-Dudek
Databricks MVP

‎04-04-2022 09:46 AM

@Ambiga D​ , How to mount Azure Data Lake Storage - https://community.databricks.com/s/feed/0D53f00001eQGOHCA4

How to mount blob storage (remember to allow network access to storage from your databricks workspace):

configs = {"fs.azure.account.key.YOUR_STORAGE.blob.core.windows.net" : "YOUR_KEY"}
 
dbutils.fs.mount(
  source = "wasbs://YOUR_CONTAINER@YOUR_STORAGE.blob.core.windows.net",
  mount_point = "/mnt/YOUR_FOLDER",
  extra_configs = configs)


My blog: https://databrickster.medium.com/

Ambi
Databricks Partner
In response to Hubert-Dudek

‎04-05-2022 05:40 AM

@Hubert Dudek​ , Thank you for the the solution. Couldn't create the private endpoint in the network access. We will work on this and update you.

Hubert-Dudek
Databricks MVP
In response to Ambi

‎04-18-2022 02:40 AM

Hi, have you managed to mount?


My blog: https://databrickster.medium.com/

Atanu
Databricks Employee
Databricks Employee

‎05-12-2022 10:47 PM

@Ambiga D​ you need to mount the storage https://docs.databricks.com/data/data-sources/azure/azure-storage.html#mount-azure-blob-storage-cont... you can follow this,thanks.

View solution in original post

jose_gonzalez
Databricks Employee
Databricks Employee
In response to Atanu

‎06-07-2022 11:15 AM

Hi @Ambiga D​,

Just a friendly follow-up. Did any of our previous replies help you to resolved this issue? Please let us know if you still need help

0 Kudos