I have a Databricks Asset Bundle proyect running and when the MLFlow library released the 3.4.0 version it happened this error:When restricting the MLFlow version to < 3.4.0 it works.The libraries got stuck installing and the process finished in erro...
If you need to access tables that are in a volume of Unity Catalog (UC), with the following configuration will work:targets:
dev:
mode: development
default: true
workspace:
host: https://<workspace>.azuredatabricks.net/
run_as...
Hello, I'm having this issue with job-computes:The snippet of the code is as follows: 84 if self.conf["persist_to_sql"]:
85 # persist to sql
86 df_parsed.write.format(
87 "com.microsoft.sqlserver.jdbc.spark"
88...
Nice review, a question, when it comes to debugging, is there a way to move to the spark context to see how it works step by step when using distributed compute?For example using applyInPandas with an UDF into a grouped Spark DataFrame the execution ...