Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-27-2024 08:54 AM
I have a large Notebook and want to divide it into multiple Notebooks and use Databricks jobs to run parallelly. However, one of the notebook is using a dataframe from one of the notebooks, so it has to be run downstream of the other ones. Now, since it is using the values from previous dataframe, how can I use the dataframe from the upstream Notebooks without writing it to a file or Unity Catalog. Thanks.
Labels:
- Labels:
-
Workflows