Yes, it is possible to query the Delta tables on your data lake with PowerBI using the native Databricks connector available in PowerBI desktop. The connector supports SSO using Azure AD so it's fairly straightforward to set up.
Once you get the connection set up you can query the data on your lake directly in PowerBI using either import or DirectQuery.
More details on the connector can be found in the announcement blog post.