How to write a custom datasource for shared (standard access mode)

bcb44 — Fri, 28 Feb 2025 13:06:45 GMT

Hello,

I maintain a spark plugin with users who are moving from spark to databricks and want to use shared access mode. My library has a bunch of custom datasources and users are seeing errors when using them. Is there a way to write a custom datasource that works with shared access mode?

Apologies if Im asking dumb questions, Ive got mostly a spark background so learning databricks terminology on the fly. Here's the exception I get when users run their queries

java.lang.SecurityException: Data source V2 relation is not supported on table acl or credential passthrough clusters.

Re: How to write a custom datasource for shared (standard access mode)

Alberto_Umana — Fri, 28 Feb 2025 13:42:00 GMT

Hello @bcb44,

Thanks for your question.

Data Source V2 Relations: These are not supported in clusters that are configured with Table ACL or Credential Passthrough. Can you validate if ACL or Passthrough are enabled on the cluster? Also this should work on single/personal access mode.

topic Re: How to write a custom datasource for shared (standard access mode) in Warehousing & Analytics

How to write a custom datasource for shared (standard access mode)

Re: How to write a custom datasource for shared (standard access mode)