https://community.databricks.com/t5/administration-architecture/spark-event-log-frequently-missing-rollover-logs/m-p/88750#M1720 <P>Hi,</P><P>We are currently using the event log to gain some visibility to what spark is doing under the hood but we frequently find that rollover logs are missing and we are left with a partial set. Is there a reason for this or a bug being tracked? Is there a setting we can configure to turn off rollover or some other setting we might be missing?</P><P>Thanks,</P><P>Sahil</P> Thu, 05 Sep 2024 14:52:50 GMT singhals 2024-09-05T14:52:50Z https://community.databricks.com/t5/administration-architecture/spark-event-log-frequently-missing-rollover-logs/m-p/88750#M1720 <P>Hi,</P><P>We are currently using the event log to gain some visibility to what spark is doing under the hood but we frequently find that rollover logs are missing and we are left with a partial set. Is there a reason for this or a bug being tracked? Is there a setting we can configure to turn off rollover or some other setting we might be missing?</P><P>Thanks,</P><P>Sahil</P> Thu, 05 Sep 2024 14:52:50 GMT https://community.databricks.com/t5/administration-architecture/spark-event-log-frequently-missing-rollover-logs/m-p/88750#M1720 singhals 2024-09-05T14:52:50Z https://community.databricks.com/t5/administration-architecture/spark-event-log-frequently-missing-rollover-logs/m-p/89309#M1746 <P>I'm also having this issue <span class="lia-unicode-emoji" title=":disappointed_face:">😞</span>&nbsp;, it seems to occur much more frequently on azure than aws, but even on aws jobs sometimes some of the logs will be missing</P> Tue, 10 Sep 2024 14:35:27 GMT https://community.databricks.com/t5/administration-architecture/spark-event-log-frequently-missing-rollover-logs/m-p/89309#M1746 alpacas 2024-09-10T14:35:27Z