- 13220 Views
- 11 replies
- 3 kudos
is command stuck?
I created some ETL using DataFrames in python. It used to run 180 sec. But it is not taking ~ 1200 sec. I have been changing it, so it could be something that I introduced, or something in the environment.Part of the process is appending results into...
- 13220 Views
- 11 replies
- 3 kudos
- 3 kudos
I am having a problem very similar. Since yesterday, without a known reason, some commands that used to run daily are now stuck in a "Running command" state. Commands like: dataframe.show(n=1) dataframe.toPandas() dataframe.description() dataframe.wr...
- 3 kudos
- 51116 Views
- 9 replies
- 5 kudos
Resolved! Download a dbfs:/FileStore File to my Local Machine?
Hi all, I am using saveAsTextFile() to store the results of a Spark job in the folder dbfs:/FileStore/my_result. I can access to the different "part-xxxxx" files using the web browser, but I would like to automate the process of downloading all fil...
- 51116 Views
- 9 replies
- 5 kudos
- 5 kudos
works well if the file is stored in FileStore. However if it is stored in the mnt folder, you will need something like this:https://community.cloud.databricks.com/dbfs/mnt/blob/<file_name>.csv?o=<your_number_here>Note that this will prompt you for yo...
- 5 kudos