• Databricks Community
  • Data Engineering
  • Re: How to limit number of files in each batch in ...

-werners-
-werners-
Esteemed Contributor III
In response to sanjay
Options
  • Mark as New
  • Bookmark
  • Subscribe
  • Mute
  • Subscribe to RSS Feed
  • Permalink
  • Print
  • Report Inappropriate Content

‎03-30-2023 03:51 AM

here is also a SO topic on how you can test it:

https://stackoverflow.com/questions/70134468/spark-structured-streaming-rate-limit

1 Kudo
Reply
Powered by Khoros