Databricks Community

Gerhard · 11-25-2022

We do have data stored in HDF5 files in a "proprietary" way. This data needs to be read, converted and transformed before it can be inserted into a delta table.All of this transformation is done in a custom python function that takes the HDF5 file an...

Gerhard · 01-26-2022

What we have:Databricks Workspace Premium on AzureADLS Gen2 storage for raw data, processed data (tables) and files like CSV, models, etc.What we want to do:We have users that want to work on Databricks to create and work with Python algorithms. We d...

Gerhard · 05-10-2022

Hey @Vartika Nain , we are still at the same situation as described above. The Hive Metastore is a weak point.I would love to have the functionality that a mount can be dedicated to a given cluster.Regards, Gerhard

Gerhard · 01-30-2022

Hi Rick, thanks for your answer. I think it would already tremendously help if a mount (with a Service Principal) could be limited to a cluster. Then you could have "backend" and "frontend" clusters.So far my solution is to use credential-passthrough...

Gerhard · 01-27-2022

Hi Hubert, thanks for this link. I was not aware of this new product that is yet to come. In the meantime I hope to find a intermediate solution.

Databricks Community

User Stats

User Activity

Read proprietary files and transform contents to a table - error resilient process needed

Overall security/access rights concept needed (combine Table Access Control and Credential Passthrough), how to allow users the benefits of both worlds

Re: Overall security/access rights concept needed (combine Table Access Control and Credential Passthrough), how to allow users the benefits of both worlds

Re: Overall security/access rights concept needed (combine Table Access Control and Credential Passthrough), how to allow users the benefits of both worlds

Re: Overall security/access rights concept needed (combine Table Access Control and Credential Passthrough), how to allow users the benefits of both worlds