The default serverless base environment is really only for notebooks, and doesn't apply to pipelines and jobs.
For jobs, you'll have to specify the dependencies in the YAML for the Job DAB.
https://docs.databricks.com/aws/en/dev-tools/bundles/library-dependencies
