Hi,
I'm looking at moving from job clusters to serverless environments. Ideally to reduce cost and improve start up time.
I can see that it is now possible to specify a custom environment .yaml file - and specify Python packages to be installed.
Is there any mechanism to 'pre-install' or use a container image for the serverless? As these packages can take a while to install. I read that there is some caching going on - but the details are a bit opaque?
Would appreciate any advice,
Thanks,
Alex