And what is the error that you are getting?

Can you do one test, you can filter out the _delta_log directory when listing the files. Here is an example of how you can do this in Python

import os

# List all files in the directory
all_files = dbutils.fs.ls("path/to/your/directory")

# Filter out the _delta_log directory
json_files = [file.path for file in all_files if "_delta_log" not in file.path]

# Now you can iterate over json_files
for file_path in json_files:
# Your code to process each JSON file