Best practices for working with Redshift

nicole_wong — Fri, 29 Oct 2021 17:46:11 GMT

I have a customer with the following question - I'm posting on their behalf to introduce them to the community.

For doing modeling in a python environment what is our best practice for getting the data from redshift? A "load" option seems to leave me with the data still sitting on the Amazon side with credentials required for some basic transformations. Clearly that isn't what we'd like. Do I need to create a table on the Databricks side and then delete it after?

Would love to get some code examples and some best practices.

Re: Best practices for working with Redshift

jose_gonzalez — Tue, 16 Nov 2021 00:16:55 GMT

Hi @Nicole Wong ,

Have you check the docs from here? As far as I know, this might be the only way to read/write data to/from redshift.

topic Re: Best practices for working with Redshift in Data Engineering

Best practices for working with Redshift

Re: Best practices for working with Redshift