Hey folks,

Can someone please suggest if there is a way to spawn a job cluster of a given size if a parameter of the job invocation (e.g file_name) contains a desired value? I have a job which 90% of the time deals with very small files, but the remaining 10% requires much bigger machines. How can i define job.yml file in such a way? Is this even possible to be done without some pre-process that checks the file name?

Thanks!