My issue has been resolved. So I was supposed to make one of my columns as a UUID data type. But then I decided to make it as a STRING data type and insert uuid's directly from the code and I am currently using that approach.
Welcome to Databricks Community: Lets learn, network and celebrate together
Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections.