Hi Ayman,

You might want to check Hyperleup project, which is the recommended way to create and manipulate Tableau Hyper files from Databricks. It is fast and can do much of the heavy lifting for you.

There is a demo notebook (dbc format) and even a distributable egg file on GitHub here:

DBC - https://github.com/goodwillpunning/hyperleaup/tree/master/demo

Egg - https://github.com/goodwillpunning/hyperleaup/tree/master/dist

Please give it a try and let us know if you have any feedback.

Thanks,

Huaming