Databricks Community

When I run a job using spark2 jar, I then run a python job to report :Multiple sources found for csv (org.apache.spark.sql.execution.datasources.v2.csv.CSVDataSourceV2, org.apache.spark.sql.execution.datasources.csv.CSVFileFormat), please specify the...

"[,\"\{\{job.run_id\}\}\"]" {"error_code": "INVALID_PARAMETER_VALUE","message": "Legacy parameters cannot contain references."}

Hello, how can I enable Databricks to generate a separate spark log for each job run?What parameters should I use in spark configuration? 

Hello, is there an API interface for passing in batches of run_id to obtain job running details?