Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-16-2025 11:45 PM
The problem was fixed by this import
from pyspark.sql import functions as F
then using F.lit() instead of F.col
.withColumn('ingestion_date', F.lit(folder_date))
Sorry code formatting is not working at the moment.