- 5906 Views
- 3 replies
- 1 kudos
Unable to copy mutiple files from file:/tmp to dbfs:/tmp
I am downloading multiple files by web scraping and by default they are stored in /tmp I can copy a single file by providing the filename and path %fs cp file:/tmp/2020-12-14_listings.csv.gz dbfs:/tmp but when I try to copy multiple files I get an ...
- 5906 Views
- 3 replies
- 1 kudos
- 1 kudos
Thanks DeepakThis is what I have suspected.Hopefully the wild card feature might be available in futureThanks
- 1 kudos
- 4465 Views
- 3 replies
- 0 kudos
How to specify multiple files in --py-files in spark-submit command for databricks job? All the files to be specified in --py-files present in dbfs: .
I have created a databricks in azure. I have created a cluster for python 3. I am creating a job using spark-submit parameters. How to specify multiple files in --py-files in spark-submit command for databricks job? All the files to be specified in ...
- 4465 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @Nandha Kumar,please go through the below docs to pass python files as job,https://docs.databricks.com/dev-tools/api/latest/jobs.html#sparkpythontask
- 0 kudos