02-23-2023 02:20 PM
I would like to share the following docs with best practices when using kinesis https://docs.databricks.com/structured-streaming/kinesis-best-practices.html please check this doc. it will help you to undertand what does maxFetchDuration does.
