I want to keep my automation framework outside the data bricks environment.

is there any way where I can update the record to parquet files/Unity catalog/Delta tables from my framework.

Also start the data bricks batch from outside framework as well.

Please suggest