kumar_ravi
New Contributor III

yes it is weird , workaround for this

files = dbutils.fs.ls("s3 bucket or azure blob path")
file_paths = [file.path for file in files]
if target_path not in file_paths:
        dbutils.fs.mkdirs(target_path)