TF SummaryWriter flush() don't send any buffered data to storage.

Orianh
Valued Contributor II

Hey guys,

I'm training a TF model in databricks, and logging to tensorboard using SummaryWriter.

At the end of each epoch SummaryWriter.flush() is called which should send any buffered data into storage.

But i can't see the tensorboard files while the model is still training, does any one know why i can't view the logs while the model is training?

I created the SummaryWriter using tf.summary.create_file_writer('/dbfs/FileStore/..)

Does it possible to view the data while the model is training? or there is problem to log the data straight to dbfs path? and i should log it into the cluster and then copy the data into dbfs ?

Hope some one can make this more clear for me,

Thanks!