Hi,
I have a bunch of scripts in Databricks that perform a decent amount of data-wrangling. All of these scripts contain sensitive information and I have no intention of making them public.
I would like to provide a service to my customers - so they can use all these scripts - but they cannot see their content. My idea was to deploy Databricks in their own subscription but it looks like even with Databricks premium I cannot hide those scripts from my customers. The admin can see everything. (I wouldn't be the admin, obviously)
My second idea was to keep my databricks as is in my own sub and then create databricks clusters in their subscriptions. However, I can't see if there is such an option - if I happen to create a cluster, then it will run in my own subscription.
For obvious reasons, my clients do not want their data leave their subscription.
What's the recommended way of customer deployment, then? All of my scripts are pyspark scripts - so there is no obvious way to compile them given that python is an interpreted language. There are a few libraries out there but I don't trust them 100%.
Please advise,
Tamas