<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic Re: Issue with Lakebridge transpile installation – SSL Certificate Error in Data Engineering</title>
    <link>https://community.databricks.com/t5/data-engineering/issue-with-lakebridge-transpile-installation-ssl-certificate/m-p/132560#M49549</link>
    <description>&lt;P&gt;&lt;SPAN&gt;The error indicates that while installing Lakebridge's transpile component on Databricks with Python 3.13, SSL certificate verification fails due to a "Missing Authority Key Identifier" in the certificate chain. This is a result of stricter requirements on certificate fields in recent Python and OpenSSL versions.&lt;/SPAN&gt;&lt;/P&gt;
&lt;P&gt;&lt;SPAN&gt;&lt;STRONG&gt;Create/Update Certificate Bundle:&lt;/STRONG&gt;&amp;nbsp;Fetch the full certificate chain, ensuring it contains required Authority Key Identifiers. Use:&lt;/SPAN&gt;&lt;/P&gt;
&lt;P&gt;&lt;SPAN&gt;&amp;nbsp;openssl s_client -showcerts -connect &amp;lt;your-host&amp;gt;:443 &amp;lt;/dev/null | sed -n -e '/-BEGIN/,/-END/ p' &amp;gt; fullchain.pem&lt;BR /&gt;&lt;/SPAN&gt;&lt;/P&gt;
&lt;P&gt;&lt;SPAN&gt;Then in Python,&lt;/SPAN&gt;&lt;/P&gt;
&lt;P&gt;&lt;SPAN&gt;import os&lt;BR /&gt;os.environ["REQUESTS_CA_BUNDLE"] = "/path/to/fullchain.pem"&lt;BR /&gt;&lt;/SPAN&gt;&lt;/P&gt;
&lt;P&gt;&lt;SPAN&gt;This allows Python's requests library to validate using the updated CA bundle.&lt;/SPAN&gt;&lt;/P&gt;
&lt;UL class="marker:text-quiet list-disc"&gt;
&lt;LI class="py-0 my-0 prose-p:pt-0 prose-p:mb-2 prose-p:my-0 [&amp;amp;&amp;gt;p]:pt-0 [&amp;amp;&amp;gt;p]:mb-2 [&amp;amp;&amp;gt;p]:my-0"&gt;
&lt;P class="my-2 [&amp;amp;+p]:mt-4 [&amp;amp;_strong:has(+br)]:inline-block [&amp;amp;_strong:has(+br)]:pb-2"&gt;&lt;STRONG&gt;Regenerate Certificates:&lt;/STRONG&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;If using local/test certificates (e.g., generated by minica), use the latest tool version that is compliant with RFC 5280 and Python 3.13's requirements.&lt;/P&gt;
&lt;/LI&gt;
&lt;LI class="py-0 my-0 prose-p:pt-0 prose-p:mb-2 prose-p:my-0 [&amp;amp;&amp;gt;p]:pt-0 [&amp;amp;&amp;gt;p]:mb-2 [&amp;amp;&amp;gt;p]:my-0"&gt;
&lt;P class="my-2 [&amp;amp;+p]:mt-4 [&amp;amp;_strong:has(+br)]:inline-block [&amp;amp;_strong:has(+br)]:pb-2"&gt;&lt;STRONG&gt;Use&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;CODE&gt;certifi&lt;/CODE&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;CA Bundle:&lt;/STRONG&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;Install and use the&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;CODE&gt;certifi&lt;/CODE&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;Python package, which provides a trusted, up-to-date CA root store:&amp;nbsp; In Python, run:&amp;nbsp;import certifi&lt;BR /&gt;os.environ["REQUESTS_CA_BUNDLE"] = certifi.where()&lt;BR /&gt;&lt;SPAN&gt;This can resolve issues if system CA stores are out-of-date.&lt;/SPAN&gt;&lt;SPAN&gt;As a last resort for testing only, you may disable SSL verification in your installation script:&lt;/SPAN&gt;&lt;/P&gt;
&lt;/LI&gt;
&lt;/UL&gt;
&lt;P&gt;&lt;SPAN&gt;import ssl&lt;BR /&gt;ssl._create_default_https_context = ssl._create_unverified_context&lt;BR /&gt;&lt;/SPAN&gt;&lt;/P&gt;
&lt;P&gt;&lt;SPAN&gt;But this should never be used in production as it reduces security.&lt;/SPAN&gt;&lt;/P&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;</description>
    <pubDate>Fri, 19 Sep 2025 12:35:07 GMT</pubDate>
    <dc:creator>mark_ott</dc:creator>
    <dc:date>2025-09-19T12:35:07Z</dc:date>
    <item>
      <title>Issue with Lakebridge transpile installation – SSL Certificate Error</title>
      <link>https://community.databricks.com/t5/data-engineering/issue-with-lakebridge-transpile-installation-ssl-certificate/m-p/129632#M48580</link>
      <description>&lt;P&gt;Hi Team,&lt;/P&gt;&lt;P&gt;I am trying to use &lt;STRONG&gt;Lakebridge to test a small piece of code for conversion. The base installation of Lakebridge worked fine, but when I attempt to install &lt;STRONG&gt;transpile, I encounter SSL-related errors. I even tried to hardcode of the certificates still failing.&lt;/STRONG&gt;&lt;/STRONG&gt;&lt;/P&gt;&lt;H3&gt;Environment &amp;amp; Versions Tried&lt;/H3&gt;&lt;UL&gt;&lt;LI&gt;&lt;P&gt;&lt;STRONG&gt;Python 3.13&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;DIV class=""&gt;&lt;DIV class=""&gt;&amp;nbsp;&lt;DIV class=""&gt;&lt;SPAN&gt;&lt;SPAN&gt;&lt;SPAN class=""&gt;22:&lt;SPAN class=""&gt;40:&lt;SPAN class=""&gt;24 &lt;SPAN class=""&gt;ERROR [src/databricks/labs/lakebridge.install-transpile] URLError: &amp;lt;urlopen &lt;SPAN class=""&gt;error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Missing Authority &lt;SPAN class=""&gt;Key Identifier (_ssl.c:&lt;SPAN class=""&gt;1032)&amp;gt;&lt;/SPAN&gt;&lt;/SPAN&gt;&lt;/SPAN&gt;&lt;/SPAN&gt;&lt;/SPAN&gt;&lt;/SPAN&gt;&lt;/SPAN&gt;&lt;/SPAN&gt;&lt;/SPAN&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;PRE&gt;&amp;nbsp;&lt;/PRE&gt;&lt;UL&gt;&lt;LI&gt;&lt;P&gt;&lt;STRONG&gt;Python 3.10 &amp;amp; 3.11&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;DIV class=""&gt;&lt;DIV class=""&gt;&lt;DIV class=""&gt;&lt;DIV class=""&gt;&amp;nbsp;&lt;DIV class=""&gt;&lt;SPAN&gt;&lt;SPAN&gt;&lt;SPAN class=""&gt;Could &lt;SPAN class=""&gt;not &lt;SPAN class=""&gt;fetch &lt;SPAN class=""&gt;URL &lt;SPAN class=""&gt;https:&lt;SPAN class=""&gt;//pypi.org/simple/pip/: There was a problem confirming the ssl certificate: HTTPSConnectionPool(host='pypi.org', port=443): Max retries exceeded with url: /simple/pip/ (Caused by &lt;SPAN class=""&gt;SSLError(&lt;SPAN class=""&gt;SSLCertVerificationError(&lt;SPAN class=""&gt;1, &lt;SPAN class=""&gt;'[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:997)'))) &lt;SPAN class=""&gt;- &lt;SPAN class=""&gt;skipping&lt;/SPAN&gt;&lt;/SPAN&gt;&lt;/SPAN&gt;&lt;/SPAN&gt;&lt;/SPAN&gt;&lt;/SPAN&gt;&lt;/SPAN&gt;&lt;/SPAN&gt;&lt;/SPAN&gt;&lt;/SPAN&gt;&lt;/SPAN&gt;&lt;/SPAN&gt;&lt;/SPAN&gt;&lt;/SPAN&gt;&lt;PRE&gt;&amp;nbsp;&lt;/PRE&gt;&lt;H3&gt;What I Tried&lt;/H3&gt;&lt;UL&gt;&lt;LI&gt;&lt;P&gt;Tested with multiple Python versions (3.10, 3.11, 3.13)&lt;/P&gt;&lt;/LI&gt;&lt;LI&gt;&lt;P&gt;Installation of base Lakebridge works fine&lt;/P&gt;&lt;/LI&gt;&lt;LI&gt;&lt;P&gt;Error only occurs while installing &lt;STRONG&gt;transpile&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;Has anyone faced a similar issue? Could you please guide me on how to resolve the SSL certificate verification error during transpile installation?&lt;/P&gt;&lt;P&gt;Thanks in advance!&lt;/P&gt;&lt;/LI&gt;&lt;/UL&gt;&lt;/DIV&gt;&lt;/DIV&gt;&lt;/DIV&gt;&lt;/DIV&gt;&lt;/DIV&gt;&lt;/LI&gt;&lt;/UL&gt;&lt;/DIV&gt;&lt;/DIV&gt;&lt;/DIV&gt;&lt;/LI&gt;&lt;/UL&gt;</description>
      <pubDate>Mon, 25 Aug 2025 14:20:37 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/issue-with-lakebridge-transpile-installation-ssl-certificate/m-p/129632#M48580</guid>
      <dc:creator>aravindan_tk</dc:creator>
      <dc:date>2025-08-25T14:20:37Z</dc:date>
    </item>
    <item>
      <title>Re: Issue with Lakebridge transpile installation – SSL Certificate Error</title>
      <link>https://community.databricks.com/t5/data-engineering/issue-with-lakebridge-transpile-installation-ssl-certificate/m-p/132560#M49549</link>
      <description>&lt;P&gt;&lt;SPAN&gt;The error indicates that while installing Lakebridge's transpile component on Databricks with Python 3.13, SSL certificate verification fails due to a "Missing Authority Key Identifier" in the certificate chain. This is a result of stricter requirements on certificate fields in recent Python and OpenSSL versions.&lt;/SPAN&gt;&lt;/P&gt;
&lt;P&gt;&lt;SPAN&gt;&lt;STRONG&gt;Create/Update Certificate Bundle:&lt;/STRONG&gt;&amp;nbsp;Fetch the full certificate chain, ensuring it contains required Authority Key Identifiers. Use:&lt;/SPAN&gt;&lt;/P&gt;
&lt;P&gt;&lt;SPAN&gt;&amp;nbsp;openssl s_client -showcerts -connect &amp;lt;your-host&amp;gt;:443 &amp;lt;/dev/null | sed -n -e '/-BEGIN/,/-END/ p' &amp;gt; fullchain.pem&lt;BR /&gt;&lt;/SPAN&gt;&lt;/P&gt;
&lt;P&gt;&lt;SPAN&gt;Then in Python,&lt;/SPAN&gt;&lt;/P&gt;
&lt;P&gt;&lt;SPAN&gt;import os&lt;BR /&gt;os.environ["REQUESTS_CA_BUNDLE"] = "/path/to/fullchain.pem"&lt;BR /&gt;&lt;/SPAN&gt;&lt;/P&gt;
&lt;P&gt;&lt;SPAN&gt;This allows Python's requests library to validate using the updated CA bundle.&lt;/SPAN&gt;&lt;/P&gt;
&lt;UL class="marker:text-quiet list-disc"&gt;
&lt;LI class="py-0 my-0 prose-p:pt-0 prose-p:mb-2 prose-p:my-0 [&amp;amp;&amp;gt;p]:pt-0 [&amp;amp;&amp;gt;p]:mb-2 [&amp;amp;&amp;gt;p]:my-0"&gt;
&lt;P class="my-2 [&amp;amp;+p]:mt-4 [&amp;amp;_strong:has(+br)]:inline-block [&amp;amp;_strong:has(+br)]:pb-2"&gt;&lt;STRONG&gt;Regenerate Certificates:&lt;/STRONG&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;If using local/test certificates (e.g., generated by minica), use the latest tool version that is compliant with RFC 5280 and Python 3.13's requirements.&lt;/P&gt;
&lt;/LI&gt;
&lt;LI class="py-0 my-0 prose-p:pt-0 prose-p:mb-2 prose-p:my-0 [&amp;amp;&amp;gt;p]:pt-0 [&amp;amp;&amp;gt;p]:mb-2 [&amp;amp;&amp;gt;p]:my-0"&gt;
&lt;P class="my-2 [&amp;amp;+p]:mt-4 [&amp;amp;_strong:has(+br)]:inline-block [&amp;amp;_strong:has(+br)]:pb-2"&gt;&lt;STRONG&gt;Use&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;CODE&gt;certifi&lt;/CODE&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;CA Bundle:&lt;/STRONG&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;Install and use the&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;&lt;CODE&gt;certifi&lt;/CODE&gt;&lt;SPAN&gt;&amp;nbsp;&lt;/SPAN&gt;Python package, which provides a trusted, up-to-date CA root store:&amp;nbsp; In Python, run:&amp;nbsp;import certifi&lt;BR /&gt;os.environ["REQUESTS_CA_BUNDLE"] = certifi.where()&lt;BR /&gt;&lt;SPAN&gt;This can resolve issues if system CA stores are out-of-date.&lt;/SPAN&gt;&lt;SPAN&gt;As a last resort for testing only, you may disable SSL verification in your installation script:&lt;/SPAN&gt;&lt;/P&gt;
&lt;/LI&gt;
&lt;/UL&gt;
&lt;P&gt;&lt;SPAN&gt;import ssl&lt;BR /&gt;ssl._create_default_https_context = ssl._create_unverified_context&lt;BR /&gt;&lt;/SPAN&gt;&lt;/P&gt;
&lt;P&gt;&lt;SPAN&gt;But this should never be used in production as it reduces security.&lt;/SPAN&gt;&lt;/P&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;</description>
      <pubDate>Fri, 19 Sep 2025 12:35:07 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/issue-with-lakebridge-transpile-installation-ssl-certificate/m-p/132560#M49549</guid>
      <dc:creator>mark_ott</dc:creator>
      <dc:date>2025-09-19T12:35:07Z</dc:date>
    </item>
  </channel>
</rss>

