Hiya,
I'm trying to follow the testing workflow of
```
$ dbx deploy test --assets-only
$ dbx launch test --from-assets --trace --include-output stdout
```
But I find the turnaround time is quite long, even with an instance pool.
The `deployment.yaml` looks like
```
environments:
default:
workflows:
- name: "test"
tasks:
- task_key: "main"
new_cluster:
spark_version: "11.3.x-scala2.12"
num_workers: 1
instance_pool_id: "instance-pool://****"
init_scripts:
- dbfs:
destination: dbfs://****/init.sh
python_wheel_task:
package_name: "foo"
entry_point: "bar"
parameters: [
"--conf-file", "file:fuse://conf/tasks/bar.yaml",
]
```
The `init.sh` simply does a `pip install`.
Some excerpts from the logs, to show how long things take
```
[dbx][2023-02-09 10:41:57.487] Launching workflow
[dbx][2023-02-09 10:42:01.389] Run URL: https://dbc-.
[dbx][2023-02-09 10:47:37.229] Finished tracing run with id ....
```
So it takes about 5 minutes setting up a new environment!
Anyone has ideas of how to speed up things?