Hi everybody,
I'm using Genie for some time which is really great. In order to improve and before recommending it more users within our company I need to get more insights on Genie including but not limited to:
- Is it correct that the โthinkingโ part is not being executed on the associated Databricks clusters rather than on a VM (or similar runtime) on appropriate Cloud provider resources managed by Databricks?
- If so, is there only one LLM โexecution engineโ as per (Azure) subscription? Or per (Azure) tenant? Or multiple?
- Is the LLM โexecution engineโ the same for Genie Spaces and Genie Code?
Or how many are available within the background? - Performance within our enviroment is decreasing month by month. Currently 20 seconds for response on "WHat can you do for me?" ๐
What can I do to change it? Request change to Databricks account? - Which (customized) LLM is used by Genie? GPT or Claude?
Would be great to get insights on this as otherwise using Genie and Databricks more will be difficult.
