cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

How to convert entity_id to notebook name or job

ken2
New Contributor II

Hi, Databricks developers!

I use system.access.table_lineage refering to this page.
It's difficult for us to recognize which notebook was indicated by the entity_id.
How do I get the table to convert entity_ids to Job names or Notebook names?

3 REPLIES 3

mlamairesse
New Contributor II
New Contributor II

Hi Ken2 

We are still missing the related table to do these lookups ( Workflow/jobs are coming soon ) 

You can still do these lookups by

1. looking up the relevant URL  : 

  • For a JOB : entity_id = job_id 
    => https://{workspace_uRL}/?o={workspace_ID}#job/{job_id/entity_id}

  • For a notebook : entity_id = notebook id
    => https://{workspace_url}/?o={workspace_id}#notebook/{entity_id/notebooks_id}

2. Look-up the job via the UI OR the Jobs API 
For a JOB : entity_id = job_id 
So : for a job owned by me looked up in the lineage table 

mlamairesse_0-1702557259267.png

I can find it in the workflows UI 

mlamairesse_1-1702557699158.png
or via the API : 

mlamairesse_2-1702557982308.png

ken2
New Contributor II

@mlamairesse 
Thank you so much for a very understandable answer!
I'd like to create a list of the linages in a workspace by system tables, at that time I have to convert event id to job id to understands the relations.

I hope someday Databricks provides a feature to lookup the workflow or notebook names via other system tables.

mlamairesse
New Contributor II
New Contributor II

Workflows system tables are coming very soon. 😃

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!