How do i find total number of input tokens to genie ?

prabbalagilead
New Contributor II

I am calculating usage analytics for my work, where they use genie.

I have given the following for my genie as definition:

(1) instructions (2) example SQL queries (3) Within catalog, i went to those relevant table schema and added comments, descriptions, and any other like "About this table" information.

How do i find total number of input tokens = all LLM required tokens + summarized SQL tokens and any other details  and total number of output tokens for "calculating usage analytics/ cost analysis" etc.

 

prabbalagilead
New Contributor II

Or is there any set of tables and functions to determine the number of input and output tokens per query?