topic Re: connect rds from databricks sql editor in Data Engineering

connect rds from databricks sql editor

pinaki1 — Tue, 02 May 2023 06:36:59 GMT

Is it possible to connect and execute query directly from rds in sql editor without using unity catelog

Re: connect rds from databricks sql editor

-werners- — Wed, 03 May 2023 09:09:32 GMT

what do you mean by RDS?

Databricks SQL works fine without Unity enabled and can be accessed by all kinds of tools using ODBC/JDBC.

Re: connect rds from databricks sql editor

luis_herrera — Wed, 03 May 2023 11:41:01 GMT

Hi there,

Yes, you could do federated queries from DB SQL Editor. This is an experimental feature, though. UC is actually not supported.

You can read more here:

https://docs.databricks.com/query-federation/index.html

PS: check out #DAIS2023 talks

Re: connect rds from databricks sql editor

pinaki1 — Wed, 03 May 2023 13:23:39 GMT

rds means AWS rds. Remote postgres server

Re: connect rds from databricks sql editor

pinaki1 — Thu, 04 May 2023 07:27:03 GMT

its not working. getting error like this

Re: connect rds from databricks sql editor

luis_herrera — Thu, 04 May 2023 08:20:17 GMT

Databricks SQL supports read-only query federation to PostgreSQL on serverless and pro SQL warehouses. I would check first you are using the right flavor of SQL warehouse. Could you post the code you are using (without credentials)?

DROP TABLE IF EXISTS postgresql_table;

CREATE TABLE postgresql_table

USING postgresql

OPTIONS (

dbtable '<table-name>',

host '<database-host-url>',

port '5432',

database '<database-name>',

user secret('postgres_creds', 'my_username'),

password secret('postgres_creds', 'my_password')

);