cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

andresalvati
by New Contributor II
  • 1182 Views
  • 1 replies
  • 0 kudos

Tags to run S3 lifecycle rules

Hello,Is it possible to utilize S3 tags when writing a DataFrame with PySpark? Or is the only option to write the dataframe and then use boto3 to tag all the files?More information about S3 object tagging is here: Amazon S3 Object Tagging.Thank you.

  • 1182 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hi @andresalvati ,  The typical approach is to write the DataFrame and then use the AWS SDK, such as boto3 for Python, to set the S3 object tags on the files individually after they have been written. Here's a general outline of how you co...

  • 0 kudos
Labels