@deepak prasad :
Yes, you can run regression tests to ensure that your changes do not break existing functionality. Databricks supports a number of testing frameworks like PyTest, which can be used to automate regression testing. You can write test cases that cover different scenarios and use cases of your application and run them automatically after each code change.
To make production data available in non-production, you can use a number of techniques such as database replication, backup and restore, or data cloning. One approach could be to take regular backups of your production databases and restore them in non-production environments. You can also use data masking and obfuscation techniques to protect sensitive data in non-production environments. Another approach is to use a data virtualization platform that can create a virtualized copy of the production data on demand, without actually copying the data. This can help reduce the storage requirements in non-production environments.
