Could you please try this instead?import syssys.path.append("/Workspace/Repos/devops/mlhub-mlops-dev/src")You need to do sys.path.append in the udf if the lib need to available on workers.from pyspark.sql.functions import *def move_libs_to_executors(...
