Just wanted to point out that securing all your data+AI assets (ie using the Premium Tier) has a "hidden" value that goes beyond just the per-SKU price change (ie the 35% you alluded to) from standard to premium. Features like RLS/CLM and ABAC and ev...
This is unfortunately an unanswerable question with the lack of information. If you can at least provide the schemas of the tables you're working with and the joins/CTE you may have tried, it would at least be a starting point.
It's not supported unfortunately to register those as Storage Credentials. But the ask seems to be coming up more frequently and I believe Product is in "Discovery" phase to support it in UC. Here are some standard questions that might help with coll...
So from your IoT device you don't have a way to use any of the Unified Authentication mechanisms?
https://docs.databricks.com/aws/en/dev-tools/auth/unified-auth