cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Community Platform Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

What happened to the ephemeral notebook links????? and the job ids????

Benedetta
New Contributor III

Hey Databricks,

      Why did you remove the ephemeral notebook links and job Ids from the parallel runs? This has created a huge gap for us. We can no longer view the ephemeral notebooks, and also the Jobids are missing from the output. Waccha doing? The link that is provided in the output is the link to the notebook that was called.....not the run of the notebook, aka the ephemeral notebook. This is no longer troubleshootable. Please restore the jobids and ephemeral notebooks.

Thank you,

Benedetta

1 REPLY 1

Benedetta
New Contributor III

Hi Kaniz,

    It's funny you mention these things - we are doing some of those - the problem now is that the JobId is obscured from the output meaning we can't tell which ephemeral notebook goes with which JobId.  It looks like the ephemeral notebook is available via the "StartTime" or "EndTime" columns which I had removed from the output due to the fact that I could not view the parameters. If I remove all of the columns, except parameters, I can then view the parameters and using CTRL-F, potentially match the outputs. Without removing the columns, the parameters really can't be seen. I don't know why it was necessary to obscure the JobIds, or even how the parameters are really useful given how difficult they are to see, with respect to many notebook runs in parallel. The JobIds are readily available - why not bring them back??

Thank you,

Benedetta

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group