cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

How to convert entity_id to notebook name or job

ken2
New Contributor II

Hi, Databricks developers!

I use system.access.table_lineage refering to this page.
It's difficult for us to recognize which notebook was indicated by the entity_id.
How do I get the table to convert entity_ids to Job names or Notebook names?

3 REPLIES 3

mlamairesse
Databricks Employee
Databricks Employee

Hi Ken2 

We are still missing the related table to do these lookups ( Workflow/jobs are coming soon ) 

You can still do these lookups by

1. looking up the relevant URL  : 

  • For a JOB : entity_id = job_id 
    => https://{workspace_uRL}/?o={workspace_ID}#job/{job_id/entity_id}

  • For a notebook : entity_id = notebook id
    => https://{workspace_url}/?o={workspace_id}#notebook/{entity_id/notebooks_id}

2. Look-up the job via the UI OR the Jobs API 
For a JOB : entity_id = job_id 
So : for a job owned by me looked up in the lineage table 

mlamairesse_0-1702557259267.png

I can find it in the workflows UI 

mlamairesse_1-1702557699158.png
or via the API : 

mlamairesse_2-1702557982308.png

ken2
New Contributor II

@mlamairesse 
Thank you so much for a very understandable answer!
I'd like to create a list of the linages in a workspace by system tables, at that time I have to convert event id to job id to understands the relations.

I hope someday Databricks provides a feature to lookup the workflow or notebook names via other system tables.

mlamairesse
Databricks Employee
Databricks Employee

Workflows system tables are coming very soon. ๐Ÿ˜ƒ

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group