Hello experts. We need to transfer couple of tables from our old system to Databricks through JDBC connection. So, the first step was to create the corresponding table as below:
CREATE TABLE IF NOT EXISTS jdbc_table
USING JDBC
OPTIONS (DRIVER = "DriverX", URL = "jdbc:xxxxxxxx", dbtable="table_name", user = "user1", password="pass" )
Since querying the above table is not efficient, we tried to create a delta table using the jdbc_table:
CREATE OR REPLACE TABLE table_name AS
SELECT * FROM jdbc_table
However, the above process is extremely slow and the table is not created at the end.
Do you have any other suggestions in order to achieve this?
Thank you in advance.