https://community.databricks.com/t5/data-engineering/recommended-redshift-2-delta-migration-path/m-p/20128#M13581 <P>Hello All!</P><P></P><P>My team is previewing Databricks and are contemplating the steps to take to perform one-time migrations of datasets from Redshift to Delta. Based on our understandings of the tool, here are our initial thoughts:</P><P></P><UL><LI>Export data from Redshift-2-S3 (UNLOAD) as compressed (CSV)</LI><LI>Map S3 bucket to Databricks environment</LI><LI>For each table, run CREATE TABLE statements, with the CSV data as the source; also stores in Delta format</LI><LI>Validate and then remove the temporary CSV data files</LI></UL><P></P><P>Has anyone else undertaken this effort (or similar)? Thanks in advance for your thoughts and feedback!</P><P></P> Thu, 19 May 2022 20:17:15 GMT Lonnie 2022-05-19T20:17:15Z https://community.databricks.com/t5/data-engineering/recommended-redshift-2-delta-migration-path/m-p/20128#M13581 <P>Hello All!</P><P></P><P>My team is previewing Databricks and are contemplating the steps to take to perform one-time migrations of datasets from Redshift to Delta. Based on our understandings of the tool, here are our initial thoughts:</P><P></P><UL><LI>Export data from Redshift-2-S3 (UNLOAD) as compressed (CSV)</LI><LI>Map S3 bucket to Databricks environment</LI><LI>For each table, run CREATE TABLE statements, with the CSV data as the source; also stores in Delta format</LI><LI>Validate and then remove the temporary CSV data files</LI></UL><P></P><P>Has anyone else undertaken this effort (or similar)? Thanks in advance for your thoughts and feedback!</P><P></P> Thu, 19 May 2022 20:17:15 GMT https://community.databricks.com/t5/data-engineering/recommended-redshift-2-delta-migration-path/m-p/20128#M13581 Lonnie 2022-05-19T20:17:15Z