Increase Stack Size for Python Subprocess
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-23-2024 09:29 AM
I need to increase the stack size (from the default of 16384) to run a subprocess that requires a larger stack size.
I tried following this: https://community.databricks.com/t5/data-engineering/increase-stack-size-databricks/td-p/71492
And this: https://rangareddy.github.io/SparkStackOverflow/
But that didn't work.
I don't see any other solutions online.
Any ideas what to do? This seems like it should be possible to do.
Labels:
- Labels:
-
Spark
1 REPLY 1
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-27-2024 10:22 AM
Thanks for your question!
Are you referring to a Java stack size (-Xss) or a Python subprocess (ulimit -s)?

