Tags to run S3 lifecycle rules
Hello,Is it possible to utilize S3 tags when writing a DataFrame with PySpark? Or is the only option to write the dataframe and then use boto3 to tag all the files?More information about S3 object tagging is here: Amazon S3 Object Tagging.Thank you.
- 1182 Views
- 1 replies
- 0 kudos
Latest Reply
Hi @andresalvati , The typical approach is to write the DataFrame and then use the AWS SDK, such as boto3 for Python, to set the S3 object tags on the files individually after they have been written. Here's a general outline of how you co...
- 0 kudos