Let's try the following :

cloudfile_options = {
    "cloudFiles.format": “json”,
    "cloudFiles.schemaLocation": "<path_to_schema_checkpoints_location>",
    "cloudFiles.inferColumnTypes":"true"
}
spark.readStream.format("cloudFiles").options(**cloudfile_options).load("<path_to_source_data>")