cancel
Turn on suggestions
Showing results for 
Search instead for 
Did you mean: 
Help
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Turn on suggestions
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Start a conversation
cnjrules
by • New Contributor III
  • 3342 Views
  • 3 replies
  • 0 kudos

Resolved! Reference file name when using COPY INTO?

When using the COPY INTO statement is it possible to reference the current file name in the select staement? A generic example is shown below, hoping I can log the file name in the target table.COPY INTO my_table FROM (SELECT key, index, textData, ...

Data Engineering
Reply
  • 3342 Views
  • 3 replies
  • 0 kudos
View Replies
Latest Reply
cnjrules
New Contributor III
  • 0 kudos

Found the info I was looking for on the page below:https://docs.databricks.com/ingestion/file-metadata-column.html

  • 0 kudos
2 More Replies
arul_parthiban
by • New Contributor
  • 921 Views
  • 0 replies
  • 0 kudos

How to customize the result of COPY INTO command?

COPY INTO statement produces results in following format, which is more similar to INSERT INTO statement results; also it's a summary of all the files loaded. Is there a way to customize in way that it produces the detailed results at file level?

image
Data Engineering
Reply
  • 921 Views
  • 0 replies
  • 0 kudos
Labels
Top