Databricks Community

Good luck. You can continue to improve your skills by helping other community members on this platform.

Follow these alternate solutions. https://community.databricks.com/t5/data-engineering/databricks-community-edition-dbfs-alternative-solutions/td-p/94933

You can use https://github.com/mlflow/mlflow-export-import  utility. The example given below doesn't use Python but uses CLI and CICD pipeline to do the same.  https://medium.com/@gchandra/databricks-copy-ml-models-across-unity-catalog-metastores-188...

As szymon mentioned, dynamic parameter values exist, but the functionality is still far from what Data Factory has to offer.I am pretty sure though that this will be extended.So for the moment I suggest you do the value derivation in data factory, an...

Hi @oleprince ,As far as I know, it's not possible yet to create tables with Identity columns using pyspark (DeltaTable api). You can create generated columns, but Identity columns are not allowed.The only way to achieve this is through Spark Sql.  

Well, that's a superb article! Thank you for this great information, you write very well which I like very much. I am really impressed by your post. run 3

this feature please

Hi @DW ,I have replicated your scenario and encountered the same error when applying a column mask to a column named 1Y in Databricks SQL.In short, it makes sense simply to follow Databricks documentation and use the SQL naming conventions, so that c...

Hi @abueno ,As I understand the logic you want to implement is:1. For every pair of columns:First Column (DX_i): Must be in dx_list1Second Column (DX_{i+1}): Must be in dx_list22. The condition for each pair is:col('DX_i').isin(dx_list1) OR col('DX_{...

Thanks for the update, I will try it too.