Have you tried setting it up in your code as:

from pyspark.sql import SparkSession

# Create a Spark session
spark = SparkSession.builder \
    .appName("YourAppName") \
    .config("spark.files.ignoreCorruptFiles", "true") \
    .getOrCreate()

# Your Spark code here