How to write a custom datasource for shared (standard access mode)

bcb44
New Contributor

Hello,

I maintain a spark plugin with users who are moving from spark to databricks and want to use shared access mode. My library has a bunch of custom datasources and users are seeing errors when using them. Is there a way to write a custom datasource that works with shared access mode?

Apologies if Im asking dumb questions, Ive got mostly a spark background so learning databricks terminology on the fly. Here's the exception I get when users run their queries

java.lang.SecurityException: Data source V2 relation is not supported on table acl or credential passthrough clusters.