<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic AWS Secrets Manager access in Administration &amp; Architecture</title>
    <link>https://community.databricks.com/t5/administration-architecture/aws-secrets-manager-access/m-p/111679#M3080</link>
    <description>&lt;P&gt;Hi&lt;/P&gt;&lt;P&gt;I am trying to establish a method of accessing secrets from AWS Secrets Manager and understand this can be done with boto as suggested from AWS.&lt;/P&gt;&lt;P&gt;We have created all of the relevant IAM roles, instance profiles etc.&amp;nbsp; Accessing S3 with this method is working well.&lt;/P&gt;&lt;P&gt;However, whenever I try to interact with Secrets Manager I keep getting the&lt;BR /&gt;"&lt;SPAN class=""&gt;NoCredentialsError&lt;/SPAN&gt;&lt;SPAN&gt;: Unable to locate credentials" error.&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&lt;SPAN&gt;The role assigned to the EC2 after creation has the relevant permission to read/write from Secrets Manager.&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&lt;SPAN&gt;I'm at a dead end and appreciate any help.&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&lt;SPAN&gt;Many Thanks&lt;BR /&gt;&lt;BR /&gt;&lt;BR /&gt;Example code:&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&lt;SPAN&gt;import boto3&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;DIV&gt;&lt;DIV&gt;&lt;SPAN&gt;&amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; session &lt;/SPAN&gt;&lt;SPAN&gt;=&lt;/SPAN&gt;&lt;SPAN&gt; boto3.&lt;/SPAN&gt;&lt;SPAN&gt;Session&lt;/SPAN&gt;&lt;SPAN&gt;(&lt;/SPAN&gt;&lt;SPAN&gt;region_name&lt;/SPAN&gt;&lt;SPAN&gt;=&lt;/SPAN&gt;&lt;SPAN&gt;region_name)&lt;/SPAN&gt;&lt;/DIV&gt;&lt;DIV&gt;&lt;SPAN&gt;&amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;/SPAN&gt;&lt;SPAN&gt;# Create a Secrets Manager client using instance profile/IAM role&lt;/SPAN&gt;&lt;/DIV&gt;&lt;DIV&gt;&lt;SPAN&gt;&amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; client &lt;/SPAN&gt;&lt;SPAN&gt;=&lt;/SPAN&gt;&lt;SPAN&gt; session.&lt;/SPAN&gt;&lt;SPAN&gt;client&lt;/SPAN&gt;&lt;SPAN&gt;(&lt;/SPAN&gt;&lt;SPAN&gt;service_name&lt;/SPAN&gt;&lt;SPAN&gt;=&lt;/SPAN&gt;&lt;SPAN&gt;'secretsmanager'&lt;/SPAN&gt;&lt;SPAN&gt;)&lt;/SPAN&gt;&lt;/DIV&gt;&lt;DIV&gt;&lt;SPAN&gt;&amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;/SPAN&gt;&lt;/DIV&gt;&lt;DIV&gt;&lt;SPAN&gt;&amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;/SPAN&gt;&lt;SPAN&gt;# Get the secret value&lt;/SPAN&gt;&lt;/DIV&gt;&lt;DIV&gt;&lt;SPAN&gt;&amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; response &lt;/SPAN&gt;&lt;SPAN&gt;=&lt;/SPAN&gt;&lt;SPAN&gt; client.&lt;/SPAN&gt;&lt;SPAN&gt;get_secret_value&lt;/SPAN&gt;&lt;SPAN&gt;(&lt;/SPAN&gt;&lt;/DIV&gt;&lt;DIV&gt;&lt;SPAN&gt;&amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;/SPAN&gt;&lt;SPAN&gt;SecretId&lt;/SPAN&gt;&lt;SPAN&gt;=&lt;/SPAN&gt;&lt;SPAN&gt;secret_id&lt;/SPAN&gt;&lt;/DIV&gt;&lt;DIV&gt;&lt;SPAN&gt;&amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; )&lt;/SPAN&gt;&lt;/DIV&gt;&lt;/DIV&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;</description>
    <pubDate>Tue, 04 Mar 2025 08:57:11 GMT</pubDate>
    <dc:creator>patrykp</dc:creator>
    <dc:date>2025-03-04T08:57:11Z</dc:date>
    <item>
      <title>AWS Secrets Manager access</title>
      <link>https://community.databricks.com/t5/administration-architecture/aws-secrets-manager-access/m-p/111679#M3080</link>
      <description>&lt;P&gt;Hi&lt;/P&gt;&lt;P&gt;I am trying to establish a method of accessing secrets from AWS Secrets Manager and understand this can be done with boto as suggested from AWS.&lt;/P&gt;&lt;P&gt;We have created all of the relevant IAM roles, instance profiles etc.&amp;nbsp; Accessing S3 with this method is working well.&lt;/P&gt;&lt;P&gt;However, whenever I try to interact with Secrets Manager I keep getting the&lt;BR /&gt;"&lt;SPAN class=""&gt;NoCredentialsError&lt;/SPAN&gt;&lt;SPAN&gt;: Unable to locate credentials" error.&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&lt;SPAN&gt;The role assigned to the EC2 after creation has the relevant permission to read/write from Secrets Manager.&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&lt;SPAN&gt;I'm at a dead end and appreciate any help.&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&lt;SPAN&gt;Many Thanks&lt;BR /&gt;&lt;BR /&gt;&lt;BR /&gt;Example code:&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&lt;SPAN&gt;import boto3&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;DIV&gt;&lt;DIV&gt;&lt;SPAN&gt;&amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; session &lt;/SPAN&gt;&lt;SPAN&gt;=&lt;/SPAN&gt;&lt;SPAN&gt; boto3.&lt;/SPAN&gt;&lt;SPAN&gt;Session&lt;/SPAN&gt;&lt;SPAN&gt;(&lt;/SPAN&gt;&lt;SPAN&gt;region_name&lt;/SPAN&gt;&lt;SPAN&gt;=&lt;/SPAN&gt;&lt;SPAN&gt;region_name)&lt;/SPAN&gt;&lt;/DIV&gt;&lt;DIV&gt;&lt;SPAN&gt;&amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;/SPAN&gt;&lt;SPAN&gt;# Create a Secrets Manager client using instance profile/IAM role&lt;/SPAN&gt;&lt;/DIV&gt;&lt;DIV&gt;&lt;SPAN&gt;&amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; client &lt;/SPAN&gt;&lt;SPAN&gt;=&lt;/SPAN&gt;&lt;SPAN&gt; session.&lt;/SPAN&gt;&lt;SPAN&gt;client&lt;/SPAN&gt;&lt;SPAN&gt;(&lt;/SPAN&gt;&lt;SPAN&gt;service_name&lt;/SPAN&gt;&lt;SPAN&gt;=&lt;/SPAN&gt;&lt;SPAN&gt;'secretsmanager'&lt;/SPAN&gt;&lt;SPAN&gt;)&lt;/SPAN&gt;&lt;/DIV&gt;&lt;DIV&gt;&lt;SPAN&gt;&amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;/SPAN&gt;&lt;/DIV&gt;&lt;DIV&gt;&lt;SPAN&gt;&amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;/SPAN&gt;&lt;SPAN&gt;# Get the secret value&lt;/SPAN&gt;&lt;/DIV&gt;&lt;DIV&gt;&lt;SPAN&gt;&amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; response &lt;/SPAN&gt;&lt;SPAN&gt;=&lt;/SPAN&gt;&lt;SPAN&gt; client.&lt;/SPAN&gt;&lt;SPAN&gt;get_secret_value&lt;/SPAN&gt;&lt;SPAN&gt;(&lt;/SPAN&gt;&lt;/DIV&gt;&lt;DIV&gt;&lt;SPAN&gt;&amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &lt;/SPAN&gt;&lt;SPAN&gt;SecretId&lt;/SPAN&gt;&lt;SPAN&gt;=&lt;/SPAN&gt;&lt;SPAN&gt;secret_id&lt;/SPAN&gt;&lt;/DIV&gt;&lt;DIV&gt;&lt;SPAN&gt;&amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; )&lt;/SPAN&gt;&lt;/DIV&gt;&lt;/DIV&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;</description>
      <pubDate>Tue, 04 Mar 2025 08:57:11 GMT</pubDate>
      <guid>https://community.databricks.com/t5/administration-architecture/aws-secrets-manager-access/m-p/111679#M3080</guid>
      <dc:creator>patrykp</dc:creator>
      <dc:date>2025-03-04T08:57:11Z</dc:date>
    </item>
    <item>
      <title>Re: AWS Secrets Manager access</title>
      <link>https://community.databricks.com/t5/administration-architecture/aws-secrets-manager-access/m-p/111747#M3082</link>
      <description>&lt;P&gt;Hi&amp;nbsp;&lt;a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/151857"&gt;@patrykp&lt;/a&gt;,&lt;/P&gt;
&lt;P&gt;Verify that the attached IAM policy includes the necessary &lt;CODE&gt;secretsmanager:GetSecretValue&lt;/CODE&gt;, &lt;CODE&gt;secretsmanager:ListSecrets&lt;/CODE&gt;&lt;/P&gt;</description>
      <pubDate>Tue, 04 Mar 2025 17:04:53 GMT</pubDate>
      <guid>https://community.databricks.com/t5/administration-architecture/aws-secrets-manager-access/m-p/111747#M3082</guid>
      <dc:creator>Alberto_Umana</dc:creator>
      <dc:date>2025-03-04T17:04:53Z</dc:date>
    </item>
    <item>
      <title>Re: AWS Secrets Manager access</title>
      <link>https://community.databricks.com/t5/administration-architecture/aws-secrets-manager-access/m-p/111800#M3083</link>
      <description>&lt;P&gt;Hi &lt;a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/106294"&gt;@Alberto_Umana&lt;/a&gt;,&lt;/P&gt;&lt;P data-unlink="true"&gt;Yes, the Role has the&amp;nbsp;SecretsManagerReadWrite&amp;nbsp;policy.&lt;/P&gt;&lt;P&gt;Also within my furthet investigation I tried running it via Personal Cluster and it worked!&lt;/P&gt;&lt;P&gt;Basically, 3 scenarios:&lt;/P&gt;&lt;P&gt;- Shared Cluster with applied InstanceProfile - Secrets failing&lt;BR /&gt;- Personal without InstanceProfile&amp;nbsp; applied - Secrets failing&lt;BR /&gt;- Shared Cluster with applied InstanceProfile - Secrets received succesfully.&lt;BR /&gt;&lt;BR /&gt;So I guess problem is with the Access mode of the cluster? Cannot find anything related to that in the docs.&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;</description>
      <pubDate>Wed, 05 Mar 2025 07:56:11 GMT</pubDate>
      <guid>https://community.databricks.com/t5/administration-architecture/aws-secrets-manager-access/m-p/111800#M3083</guid>
      <dc:creator>patrykp</dc:creator>
      <dc:date>2025-03-05T07:56:11Z</dc:date>
    </item>
  </channel>
</rss>

