Foreign Catalog - AWS Redshift

Dnirmania — Wed, 15 Jan 2025 17:00:01 GMT

Hello Everyone

Recently, my team integrated an AWS Redshift database as a foreign catalog in Azure Databricks. We can successfully run SELECT queries and create regular views on top of the foreign catalog table. However, when attempting to create a materialized view, we encounter a "connection timeout" error. We're using a SQL Warehouse Pro with 24 DBU/hr per cluster, and the foreign catalog table contains only 26 rows and 5 columns.

Any assistance with this issue would be greatly appreciated.

Thanks,
Dinesh

Re: Foreign Catalog - AWS Redshift

Alberto_Umana — Wed, 15 Jan 2025 17:57:29 GMT

Hi @Dnirmania,

Materialized views in SQL often use serverless Delta Live Tables pipelines, which might be causing the connection timeout due to IP whitelisting restrictions. Serverless compute might not be able to connect to the federated source if the IPs are not whitelisted, can you query your federated table using serverless?

topic Re: Foreign Catalog - AWS Redshift in Warehousing & Analytics

Foreign Catalog - AWS Redshift

Re: Foreign Catalog - AWS Redshift