DLT can't authenticate with kinesis using instance profile
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-15-2024 12:53 AM - edited 01-15-2024 12:57 AM
When running my notebook using personal compute with instance profile I am indeed able to readStream from kinesis. But adding it as a DLT with UC, while specifying the same instance-profile in the DLT pipeline setting - causes a "MissingAuthentication" exception from kinesis...
If I am using the hive_metastore in the DLT - it does work! Why in UC it does not?!