Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-23-2023 01:11 AM
why do you use a UDF to add columns? You could write a pyspark function without registering it as a UDF.
A UDF will bypass all optimizations and, when you use Python, performance is bad.
Can you share your UDF code?
