Hello,
My company loads a lot of tables into a databricks schema. I would like to build a dashboard on what has been loaded, but SQL commands like select * from information_schema do not work. Instead we have SHOW TABLES {FROM} LIKE {}; And that fails to work in a dashboard, but does work in Queries.
From a Notebook, I can get a list of all tables. When I do display(tables) that can go into a notebook, but I lose all of the widgets. So I can't do anything like count() or create a pivot table, etc.
Are there ideas on how I can start making a dashboard of what is loaded into a schema?
Thank you