Hello,
Currently I have created databricks tables in the hive_metastore.databases
To read these tables using a select * query inside the databricks notebook, I have to make sure the databrcks cluster is started.
Question is to do with reading the databricks tables from a c# website.
1- should the cluster be on all the time in databricks? so c# can access the tables?
2- is there a way for c# to hit the tables and yet spin-up the cluster if required to read data?
3- do I have to setup a sql warehouse for c# to read the tables?
4- how can I prepare the close to real cost of how much reading these data from c# will cost?

Thank you