Feature Discovery
How would one discover features here and also know how to make sense of these features?Ideally, we can trace the usage of features in code as well.
- 1721 Views
- 0 replies
- 0 kudos
How would one discover features here and also know how to make sense of these features?Ideally, we can trace the usage of features in code as well.
You can find the MLflow version in the runtime release notes, along with a list of every other library provided. E.g., for DBR 8.3 ML, you can look at the release notes for AWS, Azure, or GCP.The MLflow client API (i.e., the API provided by installi...
.where((col('state')==state) & (col('month')>startmonth)I can do the where conditions both ways. I think the one below add readability. Is there any other difference and which is the best?.where(col('state')==state).where(col('month')>startmonth)
You can use explain to see what type of physical and logical plans are getting created . This is the best way to see difference , but as mentioned in the question , it should give the same physical plan
How do I efficiently read image data for a deep learning model?
Our documentation provides nice examples of preparing image data for training and inference.Training: See docs for AWS, Azure, GCPInference: See reference solution for AWS, Azure, GCP
How do you govern the cost of running clusters in Databricks so you're not sticker shocked?
Less use of Interactive cluster and more use of job cluster can one of the way above others
Follow the instruction at Share models across workspaces.
Looking at the docs we see both options, can we use both e.g.?
Online store is for real time inferencing, in most case you will use the offline store.
How do you do deploy a model in Databricks.
The following resources provide more detail on this:Databricks model registry example notebook: https://docs.databricks.com/_static/notebooks/mlflow/mlflow-model-registry-example.htmlDatabricks model lifecycle - https://docs.databricks.com/applicatio...
https://databricks.com/blog/2017/05/18/taking-apache-sparks-structured-structured-streaming-to-production.html
Is there a way to change the limit to the length of strings that can be shown using the display() function in notebooks? If I'm noticing truncation, what can I do?
There is a 500 character limit to strings in columns which is non-configurable. To see the full contents of the column, you can either use the tooltip to expand the cell or download the full results.
| User | Count |
|---|---|
| 90 | |
| 41 | |
| 38 | |
| 28 | |
| 25 |