From the documentation:
- A workspace is limited to 1000 concurrent task runs. A 429 Too Many Requests response is returned when you request a run that cannot start immediately.
- The number of jobs a workspace can create in an hour is limited to 10000 (includes “runs submit”). This limit also affects jobs created by the REST API and notebook workflows.
If I have a structured streaming pipeline that's triggered every 500ms:
- It counts as one task of the 1,000 concurrent task limit?
- It can't count as 7,200 jobs created in an hour, how does work with the "jobs created" limit?
