getting short of error while mount to storage account.

kumarPatra_07 — Tue, 27 Aug 2024 12:33:51 GMT

while mount to the storage account using this below code

dbutils.fs.mount(

source=f"wasbs://{cointainer_name}@{storage_name}.blob.core.windows.net",

mount_point=f"/mnt/{cointainer_name}",

extra_configs={f"fs.azure.account.key.{storage_name}.blob.core.windows.net": access_key}

)
it give this short of error can you help me to debug this
"

Py4JError: An error occurred while calling o448.mount. Trace: py4j.security.Py4JSecurityException: Method public com.[REDACTED].backend.daemon.dbutils.DBUtilsCore$Result com.[REDACTED].backend.daemon.dbutils.DBUtilsCore.mount(java.lang.String,java.lang.String,java.lang.String,java.lang.String,java.util.Map) is not whitelisted on class class com.[REDACTED].backend.daemon.dbutils.DBUtilsCore at py4j.security.WhitelistingPy4JSecurityManager.checkCall(WhitelistingPy4JSecurityManager.java:473) at py4j.Gateway.invoke(Gateway.java:305) at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132) at py4j.commands.CallCommand.execute(CallCommand.java:79) at py4j.ClientServerConnection.waitForCommands(ClientServerConnection.java:199) at py4j.ClientServerConnection.run(ClientServerConnection.java:119) at java.lang.Thread.run(Thread.java:750)

File <command-3603786488933343>, line 1 ----> 1 dbutils.fs.mount( 2 source=f"wasbs://</span><span>{</span><span class="ansi-yellow-bg">cointainer_name}@{storage_name}.blob.core.windows.net", 3 mount_point=f"/mnt/{cointainer_name}", 4 extra_configs={f"fs.azure.account.key.{storage_name}.blob.core.windows.net": access_key} 5 )"

File /[REDACTED]/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/protocol.py:330, in get_return_value(answer, gateway_client, target_id, name) 326 raise Py4JJavaError( 327 "An error occurred while calling {0}{1}{2}.\n". 328 format(target_id, ".", name), value) 329 else: --> 330 raise Py4JError( 331 "An error occurred while calling {0}{1}{2}. Trace:\n{3}\n". 332 format(target_id, ".", name, value)) 333 else: 334 raise Py4JError( 335 "An error occurred while calling {0}{1}{2}". 336 format(target_id, ".", name))"

Re: getting short of error while mount to storage account.

Ayushi_Suthar — Tue, 04 Feb 2025 08:09:04 GMT

Hi @kumarPatra_07 , Greetings!

From the above code which you have shared, I could see that you are using a WASBS driver to mount the storage and as of now, WASB is already deprecated.

Reference document : https://learn.microsoft.com/en-us/azure/databricks/connect/storage/azure-storage#:~:text=The%20legacy%20Windows%20Azure%20Storage%20Blob%20driver%20(WASB)%20has%20been%20deprecated.%20ABFS%20has%20numerous%20benefits%20over%20WASB.

So can you please use the below method to mount the storage :

https://learn.microsoft.com/en-us/azure/databricks/dbfs/mounts#mount-adls-gen2-or-blob-storage-with-abfs

Please let me know if this helps and leave a like if this information is useful, followups are appreciated.

Regards,

Ayushi

topic getting short of error while mount to storage account. in Data Engineering

getting short of error while mount to storage account.

Re: getting short of error while mount to storage account.