I am using the Databricks Community Edition, but the cluster usage is limited to 2 hours and it automatically terminates. So I have to attach the cluster every time to run the notebook again. As I read other discussions, I learned it is not something to fix as I am using the CE. But I am wondering if there is any way to keep the databases at least? because the problem is I also lose access to the data tables I created, but the datasets are very large and it takes a really long time for me to upload over and over again. Even though the cluster is terminated, all the notebooks in the workspace still remain, so I am not sure why it would not work the same way for the data as well. Can anyone suggest to me if there is any way to keep the data in the databases?
To solve this problem, I even joined Azure Databricks and AWS Databricks. but as I ran my notebooks through those, it exceeded the limits and I got charged a lot for that, so I had to quit because I am just using it for my school project as a student (it has been very difficult to work on because of this issue).
So I am trying to figure out if there is a way to use this CE while keeping the databases. Please let me know if you could suggest anything for me.
