https://community.databricks.com/t5/machine-learning/copy-into-command-to-copy-into-delta-table-with-predefined/m-p/64951#M3165 <P>Does your source data have same number of columns as your target Delta tables? In that case, you can do it this way:<BR />COPY INTO my_pipe_data<BR />FROM 's3://my-bucket/pipeData'<BR />FILEFORMAT = CSV<BR />FORMAT_OPTIONS ('mergeSchema' = 'true',<BR />'delimiter' = '|',<BR />'header' = 'true')</P> Thu, 28 Mar 2024 18:10:27 GMT Lakshay 2024-03-28T18:10:27Z https://community.databricks.com/t5/machine-learning/copy-into-command-to-copy-into-delta-table-with-predefined/m-p/64878#M3164 <P>How do i use copy into command to load 200+ tables with 50+ columns into a delta lake table with predefined schema. I am looking for a more generic approach to be handled in pyspark code.</P><P>I am aware that we can pass the column expression into the select clause but passing column name into the select clause seems to be more tedious task.</P><P>any help over this is really appreciated&nbsp;</P> Thu, 28 Mar 2024 07:28:42 GMT https://community.databricks.com/t5/machine-learning/copy-into-command-to-copy-into-delta-table-with-predefined/m-p/64878#M3164 DataInsight 2024-03-28T07:28:42Z https://community.databricks.com/t5/machine-learning/copy-into-command-to-copy-into-delta-table-with-predefined/m-p/64951#M3165 <P>Does your source data have same number of columns as your target Delta tables? In that case, you can do it this way:<BR />COPY INTO my_pipe_data<BR />FROM 's3://my-bucket/pipeData'<BR />FILEFORMAT = CSV<BR />FORMAT_OPTIONS ('mergeSchema' = 'true',<BR />'delimiter' = '|',<BR />'header' = 'true')</P> Thu, 28 Mar 2024 18:10:27 GMT https://community.databricks.com/t5/machine-learning/copy-into-command-to-copy-into-delta-table-with-predefined/m-p/64951#M3165 Lakshay 2024-03-28T18:10:27Z