Hi! I am trying to integrate logging into my project. Got the library and logs to work but cant log the file into DBFS directly.
Have any of you been able to save and append the log file directly to dbfs? From what i came across online the best way to do this is log it locally on your cluster and then copy or move the file to dbfs when done.
@DataBricks - it would be great to do this to monitor issues that might occur during the runtime