topic Re: How to import blob storage container with sub-directories as a database in databricks sql? in Data Engineering

How to import blob storage container with sub-directories as a database in databricks sql?

Athar — Fri, 01 Jul 2022 10:10:59 GMT

I am trying to upload blob storage on databricks sql warehouse. I followed this document https://docs.databricks.com/data/data-sources/azure/azure-storage.html. but this doesn't seem to be working. Query executed fine but created schema was empty. And how we can make sure that data is always synced with blob container?

Re: How to import blob storage container with sub-directories as a database in databricks sql?

Prabakar — Mon, 04 Jul 2022 15:50:15 GMT

Was there any error reported after the query execution?

Re: How to import blob storage container with sub-directories as a database in databricks sql?

BilalAslamDbrx — Fri, 08 Jul 2022 13:34:16 GMT

@Athar Abbas the simplest thing would be to create a SAS token to the ADLS Gen 2 container and then use the COPY INTO command with the AZURE_SAS_TOKEN credential: https://docs.microsoft.com/en-us/azure/databricks/data/data-sources/azure/adls-gen2/azure-datalake-gen2-sas-access

Re: How to import blob storage container with sub-directories as a database in databricks sql?

jose_gonzalez — Wed, 20 Jul 2022 22:42:33 GMT

Hi @Athar Abbas,

Just a friendly follow-up. Did any of the responses help you to resolve your question? if it did, please mark it as best. Otherwise, please let us know if you still need help.