Found some documentation on Azure Queue throughput which might be the reason.
Any idea how can we maximize the throughput? Is there some spark autoloader configuration which can help increasing the streaming batch size?
Found some documentation on Azure Queue throughput which might be the reason.
Any idea how can we maximize the throughput? Is there some spark autoloader configuration which can help increasing the streaming batch size?