Structured Streaming and Workplace Max Jobs

Dekova — Thu, 27 Jul 2023 12:52:42 GMT

From the documentation:

A workspace is limited to 1000 concurrent task runs. A 429 Too Many Requests response is returned when you request a run that cannot start immediately.
The number of jobs a workspace can create in an hour is limited to 10000 (includes “runs submit”). This limit also affects jobs created by the REST API and notebook workflows.

If I have a structured streaming pipeline that's triggered every 500ms:

It counts as one task of the 1,000 concurrent task limit?
It can't count as 7,200 jobs created in an hour, how does work with the "jobs created" limit?

topic Structured Streaming and Workplace Max Jobs in Get Started Discussions