- 1728 Views
- 3 replies
- 0 kudos
Resolved! MlFlow and Feature Store: mlflow.spark.autolog, using feature store on Databricks, FeatureStoreClient.log_model()?
As I am moving my first steps within the Databricks Machine Learning Workspace, I am getting confused by some features that by "documentation" seem to overlap. Does autolog for spark on mlflow provide different tracking than using a training set crea...
- 1728 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @Edmondo Porcu​ , FeatureStoreClient.log_model() logs an MLflow model packaged with feature lookup information.Sourcemlflow.spark.autolog(disable=False, silent=False) enables (or disables) and configures logging of Spark data source paths, versio...
- 0 kudos
- 907 Views
- 1 replies
- 0 kudos
difference between optimize and auto optimize and Optimize in delta
What would be good for me , if I should use Optimize every time or should I be using auto-optimize?
- 907 Views
- 1 replies
- 0 kudos
- 0 kudos
Optimize: Bin-packing/Compaction. Idempotent and IncrementalOptimize + Z-Order: Helps in Data Skipping; Use Range PartitioningOptimize write: Improve the write operation to the Delta table. optimization is performed before the write/during the writ...
- 0 kudos