Sporadic HTTP failure with SQL Serverless (bug?)

[ibanezcp88]

Our SQL Serverless installation has sporadic failures to our blob container in Azure.  The blob container is locked down to a vnet, and we are using the private endpoint to enable serverless access.  It will work fine for several hours, and then show the error below.  Stopping and starting the warehouse resolves the issue.  This only started about last week.  Is this a known issue, and are there any workarounds?  

FAILED_PRECONDITION: HTTP error: 400 body:

"error": "code":"AccountRequiresHttps","message":"The account being accessed does not support http.

This is an external table using abfs://

delta.autoOptimize.autoCompact=true
delta.autoOptimize.optimizeWrite=true
delta.columnMapping.maxColumnId=37
delta.columnMapping.mode=name
delta.minReaderVersion=2
delta.minWriterVersion=5
delta.tuneFileSizesForRewrites=true

[Walter_C]

This issue can occur if the connection to the blob container is attempted over HTTP instead of HTTPS.

Given that the problem started about a week ago and stopping and starting the warehouse resolves the issue temporarily, it suggests that there might be an intermittent configuration or network issue.

Here are a few steps you can take to troubleshoot and potentially resolve the issue:

1. Verify HTTPS Configuration: Ensure that all connections to the Azure Storage account are configured to use HTTPS. This includes checking the settings in your SQL Serverless configuration and any network security groups or firewalls that might be affecting the traffic.

2. Check Private Endpoint Configuration: Since you are using a private endpoint, verify that the private endpoint is correctly configured and that there are no intermittent network issues affecting the connectivity. Ensure that the DNS settings are correctly resolving the private endpoint.

3. Network Security Groups (NSGs) and Firewalls: Review the NSGs and firewall rules associated with your VNet and private endpoint to ensure that they allow HTTPS traffic to the Azure Storage account.

4. Azure Storage Account Settings: Check the settings of your Azure Storage account to ensure that it is configured to require secure transfer (HTTPS). This setting can be found in the Azure portal under the configuration settings of the storage accoun

[ibanezcp88]

I've confirmed all of that.  This seems like an AI generated response.  It seems more likely that Databricks rolled out a feature a week ago that is causing instability in the serverless warehouses.  Any other specific things to check would be appreciated!