topic How we can read data from adls gen 2 using bash (%sh) command.(without mounting) in Data Engineering

How we can read data from adls gen 2 using bash (%sh) command.(without mounting)

SS2 — Wed, 05 Apr 2023 08:23:15 GMT

Hi @Ananth Arunachalam/Team,

Can we read file from ADLS gen 2 using shell script (%%bash or %%sh ) without doing mounting.

Please let me know. Thank you.

karthik_p — Wed, 05 Apr 2023 15:24:37 GMT

@S S you can access data in ADLS GEn2 using multiple ways, please check below article.

easy way is using storage account access key method

SS2 — Thu, 06 Apr 2023 02:33:49 GMT

@karthik p i know with the help of pyspark(python) and spark (Scala) you can access.

But my question is that how you can access in shell because shell dose not support Spark.

For ex:- echo "abfss://container@storageAccount.dfs.core.windows.net/external-location/path/to/data"

This will not work.

If you're not getting it then try to run this command (echo ..) in your Databricks notebook and see what error you're getting.