Resolved! spark properties files
I am trying to migrate a spark job from an on-premises Hadoop cluster to data bricks on azure. Currently, we are keeping many values in the properties file. When executing spark-submit we pass the parameter --properties /prop.file.txt. and inside t...
- 2726 Views
- 1 replies
- 1 kudos
Latest Reply
I use JSON files and .conf files which reside on the data lake or in the filestore of dbfs.Then read those files using python/scala
- 1 kudos