This seems like where you'd want to use Delta Sharing, rather than going against the table files directly.  I see in a few tutorials Microsoft says to make a shortcut directly to the storage, but you won't have the Unity Catalog management if you connect directly to the tables in the filesystem.  In Databricks documentation, they recommend against accessing table files directly for a number of reasons.

Fabric is still an immature service so I didn't find much on using Delta Sharing with Fabric.  There is a connector for data flow, and Power BI has a connector, so Microsoft does have support.  You may be the first ones to try this, so best I can suggest is let everyone know how it works.