Encapsulate Databricks Pyspark/SparkSql code

[Databricks_7045]

Hi All ,

I have Custom code ( Pyspark & SparkSQL) (notebooks) which I want to deploy at customer location and encapsulate so that end customers don't see the actual code. Currently we have all code in Notebooks (Pyspark/spark sql). Could you please let me know

1) if there is any way to run the code as executables/jars.

2) How to convert the code as executables.

Thanks a lot for the help.

[Kaniz_Fatma]

Hi @ Databricks.70459! My name is Kaniz, and I'm the technical moderator here. Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question first. Or else I will get back to you soon. Thanks.

[-werners- · Accepted solution]

With notebooks that is not possible.

You can write your code in scala/java and build a jar, which you then run with spark-submit.

(example)

Or use python and deploy a wheel.

(example)

This can become quite complex when you have dependencies.

Also: a jar etc can be decompiled rendering your usecase useless.

[Databricks_7045]

Hi , Thanks for the reply . Is it possible to restrict the view access by some premium plan ? please let me know . Thank You

[-werners-]

yes certainly.

You can put permissions on notebooks and folders.

But probably the customer will be admin of the databricks workspace.