Hi bricklayers,
Originally from a Teradata background and relatively new to Databricks, I was in need of brushing up on my Python and Github CI/CD skills so Iโve spun up a repo for a project Iโm calling Terabricks.
The aim is to provide a space for making things that are useful in Teradata but donโt yet exist in bricks, available in bricks. Starting with a port of Teradataโs temporal functions and operators using Databricks UC UDFs written in Python.
These functions are designed to make your life easier if youโre working with type-2, 4 and 6 SCD data structures, or any scenario where you have periods of time that are bookended by a start and end date. For example, you can easily compare such periods for overlap, chronological order, and contiguousness.
If that sounds like it might be of use to you, please do head on over to the repo to find out more and let me know what you think. What awaits is an initial MVP with room for improvement - it needs some work to enhance scalability for example - and things like that can be prioritised if there is demand. If there are any other recovering Teradata-holics out there with ideas for other stuff they would like to see on bricks then I would love to hear it, and as a relative novice to CI/CD workflows, any contributions or advice in this space are also welcome.
Happy hunting!
Rob
