topic How to convert entity_id to notebook name or job in Data Engineering

How to convert entity_id to notebook name or job

ken2 — Tue, 05 Dec 2023 12:03:25 GMT

Hi, Databricks developers!

I use system.access.table_lineage refering to this page.
It's difficult for us to recognize which notebook was indicated by the entity_id.
How do I get the table to convert entity_ids to Job names or Notebook names?

Re: How to convert entity_id to notebook name or job

mlamairesse — Thu, 14 Dec 2023 12:47:53 GMT

Hi Ken2

We are still missing the related table to do these lookups ( Workflow/jobs are coming soon )

You can still do these lookups by

1. looking up the relevant URL :

For a JOB : entity_id = job_id
=> https://{workspace_uRL}/?o={workspace_ID}#job/{job_id/entity_id}
For a notebook : entity_id = notebook id
=> https://{workspace_url}/?o={workspace_id}#notebook/{entity_id/notebooks_id}

2. Look-up the job via the UI OR the Jobs API
For a JOB : entity_id = job_id
So : for a job owned by me looked up in the lineage table

I can find it in the workflows UI

or via the API :

Re: How to convert entity_id to notebook name or job

ken2 — Fri, 15 Dec 2023 03:09:42 GMT

@mlamairesse
Thank you so much for a very understandable answer!
I'd like to create a list of the linages in a workspace by system tables, at that time I have to convert event id to job id to understands the relations.

I hope someday Databricks provides a feature to lookup the workflow or notebook names via other system tables.

Re: How to convert entity_id to notebook name or job

mlamairesse — Fri, 15 Dec 2023 09:52:34 GMT

Workflows system tables are coming very soon. 😃