Learning
Certifications
Learning Discussion
Certifications
Training Offerings
Learning Paths
Discussions
Community Discussions
GenAI Insight Hub
Get Started Discussions
Databricks Platform Discussions
Administration & Architecture
Data Engineering
Data Governance
Machine Learning
Warehousing & Analytics
Resources
Get Started Resources
Databricks TV
Product Related
Virtual Meet-ups
Events
Product Platform Updates
Support FAQs
Technical Blog
What's New in Databricks
Get Started Guides
Knowledge Sharing Hub
Announcements
Groups
Regional and Interest Groups
Americas (AMER)
Asia-Pacific & Japan (APJ)
Europe, Middle East, and Africa (EMEA)
Interest Groups
Technical Councils
Private Groups
Skills@Scale
Community Cove
Databricks Community Champions
Khoros Community Forums Support (Not for Databricks Product Questions)
Databricks Community Code of Conduct
Community Newsletter
Summit 2024
Register to join the community
Databricks
Learning
Learning Discussion
Certifications
Training Offerings
Certifications
Learning Paths
Discussions
Databricks Platform Discussions
Administration & Architecture
Data Engineering
Data Governance
Machine Learning
Warehousing & Analytics
Community Discussions
GenAI Insight Hub
Get Started Discussions
Resources
Databricks TV
Product Related
Virtual Meet-ups
Get Started Resources
Events
Product Platform Updates
Support FAQs
Technical Blog
What's New in Databricks
Get Started Guides
Knowledge Sharing Hub
Announcements
Groups
Regional and Interest Groups
Americas (AMER)
Asia-Pacific & Japan (APJ)
Europe, Middle East, and Africa (EMEA)
Interest Groups
Technical Councils
Private Groups
Skills@Scale
Community Cove
Databricks Community Champions
Khoros Community Forums Support (Not for Databricks Product Questions)
Databricks Community Code of Conduct
Community Newsletter
Summit 2024
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for
Search instead for
Did you mean:
Help
Sign In
JosiahYoder
New Contributor III
since
08-27-2021
06-26-2023
User Stats
5
Posts
0
Solutions
0
Kudos given
1
Kudos received
Databricks
About JosiahYoder
User Activity
Posts
Replies
No posts to display.
Re: Can I run one notebook from another notebook?
08-10-2017
You can now use relative paths, e.g. %run "./PoundInclude (Python)"
Re: how to delete a folder in databricks mnt?
07-27-2017
Or, to be more readable: dbutils.fs.rm(fileprefix+".tmp",recurse=true)
Re: How do I create a single CSV file from multiple partitions in Databricks / Spark?
07-27-2017
See my embellishment of this answer, filling out the ...s in the "...path...":
Re: How do I create a single CSV file from multiple partitions in Databricks / Spark?
07-27-2017
I'm really miffed that my formatting of the code disappears when I commit the edit.
Re: How do I create a single CSV file from multiple partitions in Databricks / Spark?
07-27-2017
If you can fit all the data into RAM on one worker (and thus can use .coalesce(1)), you can use dbfs to find and move the resulting CSV file:val fileprefix= "/mnt/aws/path/file-prefix" dataset .coalesce(1) .write //.mode("overwrite") // I usually...
Kudos from
User
Count
JacekLaskowski
1
View all