topic Display count of records in all tables in hive meta store based on one of the column value. in Data Engineering

Display count of records in all tables in hive meta store based on one of the column value.

DBX-Beginer — Mon, 06 Feb 2023 20:39:53 GMT

I have a DB name called Test in Hive meta store of data bricks. This DB contains around 100 tables. Each table has the column name called sourcesystem and many other columns. Now I need to display the count of records in each table group by source system.

Display the data as bellow.

Tablename, sourceystem, record_count

SQL query for the same for single table:

Select count(*),sourceystem from test.sales GROUP BY sourceystem

Re: Display count of records in all tables in hive meta store based on one of the column value.

Lakshay — Tue, 07 Feb 2023 11:55:06 GMT

Hi @Krish K , You need to run the iteration over the list of tables in "Test" DB. We can't query all the tables at once.

Re: Display count of records in all tables in hive meta store based on one of the column value.

Anonymous — Mon, 10 Apr 2023 08:58:58 GMT

Hi @Krish K

Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help.

We'd love to hear from you.

Thanks!