Calling exe from notebook

[nkrish]

How to call exe (c-sharp code based) from data bricks notebook?

#csharp exe

[siva-anantha]

@nkrish: Databricks clusters typically run Linux, so a Windows-only executable (.exe) will not run there. 

Even if you port the executable for Linux, it will run in the driver directly and you might miss the distributed computing feature of the Spark. 

Could you please provide the following details?
1) purpose of .exe - what it does?
2) whether you need Spark parallelism

3) your Databricks cloud and runtime version

[nkrish]

@siva-anantha , We are working on some migration project where some core business logics are in c# code as exe. We have 2 options either rewrite the code into pyspark or use the exe as it is. Since we have a very limited timeline, we are thinking of calling the exe as it is from notebook. Please find my response inline below. 

1) purpose of .exe - what it does?

some core business logics like some calculations, filtering and brand scanning all happens in the exe
2) whether you need Spark parallelism

Not very sure as we have not gone through the code fully. 

3) your Databricks cloud and runtime version

Azure Databricks and Databricks Runtime is 17.x

If Parallelism is not needed, is it possible to execute exe if so how to do that?