https://community.databricks.com/t5/data-engineering/unable-to-setcheckpointdir-in-unitycatalog-enabled-workspace/m-p/54782#M30161 <P>I have a Unity catalog enabled workspace where I am trying to setCheckpointDir during runtime. The method looks to authenticate using&nbsp;fs.azure.account.key instead of storage credentials. I am using databricks access connector which has "Storage Blob Data Contributor" role on my storage account. The relevant containers are also added as external locations.</P><P>Error:</P><P><FONT color="#FF0000"><EM>Py4JJavaError: An error occurred while calling o350.setCheckpointDir.</EM></FONT><BR /><FONT color="#FF0000"><EM>: Failure to initialize configuration for storage account: Invalid configuration value detected for fs.azure.account.keyInvalid configuration value detected for fs.azure.account.key</EM></FONT></P> Wed, 06 Dec 2023 14:30:36 GMT reshmir18 2023-12-06T14:30:36Z https://community.databricks.com/t5/data-engineering/unable-to-setcheckpointdir-in-unitycatalog-enabled-workspace/m-p/54782#M30161 <P>I have a Unity catalog enabled workspace where I am trying to setCheckpointDir during runtime. The method looks to authenticate using&nbsp;fs.azure.account.key instead of storage credentials. I am using databricks access connector which has "Storage Blob Data Contributor" role on my storage account. The relevant containers are also added as external locations.</P><P>Error:</P><P><FONT color="#FF0000"><EM>Py4JJavaError: An error occurred while calling o350.setCheckpointDir.</EM></FONT><BR /><FONT color="#FF0000"><EM>: Failure to initialize configuration for storage account: Invalid configuration value detected for fs.azure.account.keyInvalid configuration value detected for fs.azure.account.key</EM></FONT></P> Wed, 06 Dec 2023 14:30:36 GMT https://community.databricks.com/t5/data-engineering/unable-to-setcheckpointdir-in-unitycatalog-enabled-workspace/m-p/54782#M30161 reshmir18 2023-12-06T14:30:36Z https://community.databricks.com/t5/data-engineering/unable-to-setcheckpointdir-in-unitycatalog-enabled-workspace/m-p/54864#M30177 <P><a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/9">@Retired_mod</a>&nbsp;I have provided all the necessary permissions and were able to browse through the folders of the container added as an external location.</P><P>I don't understand why the method <EM>setcheckpointdir</EM> looks for account key when the access is already provided using <EM>storage credentials</EM> for the storage account.</P> Thu, 07 Dec 2023 13:46:12 GMT https://community.databricks.com/t5/data-engineering/unable-to-setcheckpointdir-in-unitycatalog-enabled-workspace/m-p/54864#M30177 reshmir18 2023-12-07T13:46:12Z