Hi,

I am defining the job along with job cluster specification using python sdk. But when the job runs it is using the serverless compute, instead of the defined cluster. I can say the job uses serverless from the job_run log and also from the system.billing.usage table SKU used.  

What I am doing wrong here ? How do I create and use the job cluster in the right way. Thanks for looking.

a) current cluster spec 

b) I can see the job defined along with the cluster details, including the node types. 

c) But when I run the job I see that it is using the Serverless compute.