topic Re: Can we trigger a script from a databricks notebook to the windows remote machine(in VPN)? in Data Engineering

Can we trigger a script from a databricks notebook to the windows remote machine(in VPN)?

Chaitanya_Raju — Fri, 03 Mar 2023 05:53:47 GMT

Re: Can we trigger a script from a databricks notebook to the windows remote machine(in VPN)?

daniel_sahal — Fri, 03 Mar 2023 06:37:16 GMT

@Ratna Chaitanya Raju Bandaru

It's doable.

For example you can use SSH to connect to the windows machine and run your scripts in there (SSH client needs to be installed on the Win machine)

Re: Can we trigger a script from a databricks notebook to the windows remote machine(in VPN)?

Chaitanya_Raju — Fri, 03 Mar 2023 10:44:19 GMT

@Daniel Sahal ,

Thanks for your quick response, if there is any blog or documentation or any stackoverflow link can you please help me with the same, so it can be useful for me.

Re: Can we trigger a script from a databricks notebook to the windows remote machine(in VPN)?

daniel_sahal — Mon, 06 Mar 2023 06:52:30 GMT

@Ratna Chaitanya Raju Bandaru

Here's how to install OpenSSH on WIN:

https://woshub.com/connect-to-windows-via-ssh/

Then you can just simply SSH to your machine from Databricks:

%sh
ssh -p PORT USER@DOMAIN.COM

Re: Can we trigger a script from a databricks notebook to the windows remote machine(in VPN)?

Chaitanya_Raju — Sat, 11 Mar 2023 07:42:24 GMT

@Daniel Sahal , thanks for the update.

Is there any possibility this can be done using PowerShell i.e connect the server by executing Powershell script in databricks notebooks?

Re: Can we trigger a script from a databricks notebook to the windows remote machine(in VPN)?

daniel_sahal — Thu, 30 Mar 2023 05:44:24 GMT

@Ratna Chaitanya Raju Bandaru

You can try to install pwsh on the cluster, but i'm not sure if this will behave same as on Windows machine.

https://learn.microsoft.com/en-us/powershell/scripting/install/installing-powershell-on-linux?view=powershell-7.3

Re: Can we trigger a script from a databricks notebook to the windows remote machine(in VPN)?

Vartika — Fri, 31 Mar 2023 07:25:51 GMT

Hi @Ratna Chaitanya Raju Bandaru

Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best? If not, please tell us so we can help you.

Thanks!

Re: Can we trigger a script from a databricks notebook to the windows remote machine(in VPN)?

KaifKhan — Tue, 08 Aug 2023 05:00:01 GMT

Hi, have you found any way to do it? i have the same requirement and not able to find any meaningful solution.