In Azure Data Factory, I have a pipeline defined with Bronze - Silver - Gold layers + the final step 4 entails the refresh of a Power BI semantic model.
This final step is executed via a Databricks notebook and contains the following tasks:
# getting parameters: environment | workspaceID | datasetID
# init client - based on # getting service credentials from Unity Catalog and # getting Azure Key Vault url
# Get access token based on:
- client credentials
# Call Power BI Dataset Refresh API
Executing this final step / notebook works fine - works as expected.
The ADF monitoring related to this pipeline shows on a daily basis all the execution results of the "master pipeline" (which includes the step 4) during the last days.
But... the PBI refresh history does not show the refresh results of the last days. For some reason, the PBI refresh history results are available on a daily basis but the results related to the last six days are missing.
Any suggestions? What might be the reason of this "failure"?
Thank you