you must have created some resources with public IP addresses in your azure subscription, ie: storage account, etc...
Try to avoid using public IPs as much as possible to secure your tenant/subscription.

try to find which of your Azure resources are using public ips, then modify them: https://techcommunity.microsoft.com/t5/core-infrastructure-and-security/how-to-find-azure-resources-...