I'm using the Databricks Connect VS Code plugin. It's cool how it figures out what things need to be run on the cluster vs. run locally. However, is it possible to force it to run specific Python statements remotely instead of locally?
For context, the Databricks cluster has access to some external AWS resources that our developers do not have local access to due to network firewalls. It would be ideal if individual lines of Python could be passed through to the cluster (where they can be run successfully) instead of having to upload the whole program file to Databricks on each run.
Any ideas?
