How to write a custom datasource for shared (standard access mode)
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-28-2025 05:06 AM - edited 02-28-2025 05:06 AM
Hello,
I maintain a spark plugin with users who are moving from spark to databricks and want to use shared access mode. My library has a bunch of custom datasources and users are seeing errors when using them. Is there a way to write a custom datasource that works with shared access mode?
Apologies if Im asking dumb questions, Ive got mostly a spark background so learning databricks terminology on the fly. Here's the exception I get when users run their queries
java.lang.SecurityException: Data source V2 relation is not supported on table acl or credential passthrough clusters.