Databricks Community

data-grassroots · 05-21-2024

What information do you know about a share recipient when they access a table shared to them via Delta Sharing?Wondering if we might be able to utilize something along the lines of is_member, is_account_group_member, session_user, etc for ROW and COL...

data-grassroots · 04-16-2024

We have a data feed with files whose filenames stays the same but the contents change over time (brand_a.csv, brand_b.csv, brand_c.csv ....).Copy Into seems to ignore the files when they change.If we set the Force flag to true and run it, we end up w...

data-grassroots · 10-04-2024

Agreed. Any traction on this, Databricks?

data-grassroots · 05-22-2024

Now that I'm looking closer at the share credentials and the recipient entity you would really need a way to know the bearer token and relate that back to various recipient properties - databricks.name and any custom recipient property tags you may h...

data-grassroots · 05-22-2024

Thanks Kaniz.I'll look a little deeper. The idea was to utilize UDFs to limit access a larger dataset. If you're from Org A, you get to see this subset, if you're from Org B, you get to see this other subset, if you're from Org C, you get to see the ...

data-grassroots · 04-22-2024

Thanks for the validation, Werners! That's the path we've been heading down (copy + merge). I still have some DLT experiments planned but - at least for this situation - copy + merge works just fine.

data-grassroots · 04-17-2024

This may be helpful - the bit on allow overwritehttps://docs.databricks.com/en/ingestion/auto-loader/faq.html

Databricks Community

User Stats

User Activity

Delta Sharing - Info about Share Recipient

Ingesting Files - Same file name, modified content

Re: Metabase support

Re: Delta Sharing - Info about Share Recipient

Re: Delta Sharing - Info about Share Recipient

Re: Ingesting Files - Same file name, modified content

Re: Autoloader update table when new changes are made