Hi, I'm creating an mlflow pyfunc serving endpoint and I would like to connect to a delta table to retrieve some information within the pyfunc. Is this possible?

I ask because I don't think that serving endpoint environment has access to spark, and we would have to instantiate a spark session which would have an amount of overhead?