Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-06-2025 06:37 AM
The commitBatch metric is a part of the overall triggerExecution time, which encompasses all stages of planning and executing the microbatch, including committing the batch data and updating offsets.
The commitBatch metric may not always be present in every example. Its presence depends on the specific implementation and the metrics that are being tracked for that particular streaming query. For instance, in the examples you mentioned:
- The
rate source to Delta Lakeexample does not includecommitBatchbecause it may not be relevant or tracked for that specific query. - The
Kafka-to-Kafkaexample also does not includecommitBatch, possibly due to differences in how metrics are collected or reported for Kafka sinks.