You're right to be confused, what's happening is that the dashboard lookup in your bundle only works with legacy dashboards, not the newer Lakeview dashboards. That’s why the lookup fails and databricks dashboards list comes up empty. Unfortunately, ...
The most reliable and efficient approach is to use Azure Data Factory (ADF) with the SharePoint Online List connector to extract data from your M365 SharePoint List and write it to Azure Data Lake Storage, then use Azure Databricks to process the dat...