mark_ott
Databricks Employee
Databricks Employee

The error indicates that while installing Lakebridge's transpile component on Databricks with Python 3.13, SSL certificate verification fails due to a "Missing Authority Key Identifier" in the certificate chain. This is a result of stricter requirements on certificate fields in recent Python and OpenSSL versions.

Create/Update Certificate Bundle: Fetch the full certificate chain, ensuring it contains required Authority Key Identifiers. Use:

 openssl s_client -showcerts -connect <your-host>:443 </dev/null | sed -n -e '/-BEGIN/,/-END/ p' > fullchain.pem

Then in Python,

import os
os.environ["REQUESTS_CA_BUNDLE"] = "/path/to/fullchain.pem"

This allows Python's requests library to validate using the updated CA bundle.

  • Regenerate Certificates: If using local/test certificates (e.g., generated by minica), use the latest tool version that is compliant with RFC 5280 and Python 3.13's requirements.

  • Use certifi CA Bundle: Install and use the certifi Python package, which provides a trusted, up-to-date CA root store:  In Python, run: import certifi
    os.environ["REQUESTS_CA_BUNDLE"] = certifi.where()
    This can resolve issues if system CA stores are out-of-date.As a last resort for testing only, you may disable SSL verification in your installation script:

import ssl
ssl._create_default_https_context = ssl._create_unverified_context

But this should never be used in production as it reduces security.

 

 

 

View solution in original post