Foreign Catalog - AWS Redshift

[Dnirmania]

Hello Everyone

Recently, my team integrated an AWS Redshift database as a foreign catalog in Azure Databricks. We can successfully run SELECT queries and create regular views on top of the foreign catalog table. However, when attempting to create a materialized view, we encounter a "connection timeout" error. We're using a SQL Warehouse Pro with 24 DBU/hr per cluster, and the foreign catalog table contains only 26 rows and 5 columns.

Any assistance with this issue would be greatly appreciated.

Thanks,
Dinesh

[Alberto_Umana]

Hi @Dnirmania,

Materialized views in SQL often use serverless Delta Live Tables pipelines, which might be causing the connection timeout due to IP whitelisting restrictions. Serverless compute might not be able to connect to the federated source if the IPs are not whitelisted, can you query your federated table using serverless?