java.lang.IllegalArgumentException: 0 - Could not create directory structure: /databricks/spark/work/app-20230224111412-0000/5/exID_5/16463034998783127067093113462199/079A4589-F569-5076-9142-B9B71CC0C7C5/16384469418283127081089124359741/DIM_643/v1/23B76BA
Hi @Parvez Mushaf Maniyar, Check if the directory exists and if it has the correct permissions for the user running the application.
The error message "java.lang.IllegalArgumentException: 0 - Could not create directory structure" usually indicates that the file system cannot create a directory. In this case, the file system seems unable to make the directory "/databricks/spark/work/app-20230224111412-0000/5/exID_5/16463034998783127067093113462199/079A4589-F569-5076-9142-B9B71CC0C7C5/16384469418283127081089124359741/DIM_643/v1/23B76BA".
Does @Kaniz Fatma's response answer your question? If yes, would you be happy to mark it as best so that other members can find the solution more quickly?
Welcome to Databricks Community: Lets learn, network and celebrate together
Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections.