- 2449 Views
- 1 replies
- 3 kudos
Feature Store - Feature Lookup with Filter
I am working with feature store to save the engineered features. However, for the specific case we have lots of feature table and lot of separate target variables on which we want to train separate models. Now for each of these model, we can leverage...
- 2449 Views
- 1 replies
- 3 kudos
- 3 kudos
Thanks for taking the time to let us know how to make Databricks even better! @Mayank Srivastava​ I love that you included a real-life example as well. I think I know the right PM at Databricks that will be interested in this input. Thanks again for...
- 3 kudos
- 1756 Views
- 1 replies
- 0 kudos
hi Team, I am facing an issue when deploying the databricks model into AWS Sagemaker. Kindly check the below error and advice me on this. Traceback (...
hi Team, I am facing an issue when deploying the databricks model into AWS Sagemaker. Kindly check the below error and advice me on this.Traceback (most recent call last): File "<string>", line 1, in <module> File "/miniconda/lib/python3.9/site-pack...
- 1756 Views
- 1 replies
- 0 kudos
- 0 kudos
Any update on the above issue?
- 0 kudos
- 1495 Views
- 0 replies
- 2 kudos
Unity Catalog Webinar: Join us to learn what's new, and what’s coming in Unity Catalog Governance for Data and AI is complex. Databricks Unity Cat...
Unity Catalog Webinar: Join us to learn what's new, and what’s coming in Unity CatalogGovernance for Data and AI is complex. Databricks Unity Catalog provides a unified governance solution for all data and AI assets on any cloud, empowering data team...
- 1495 Views
- 0 replies
- 2 kudos
- 2962 Views
- 0 replies
- 0 kudos
How to identify S3 object type (directory or file) created by Databricks?
The issue context is Delta Lake connector in Trino https://github.com/trinodb/trino/issues/13017Trino identifies S3 object as a directory or a file using Content-Type header. Other query engines set application/x-directory in case of directories, bu...
- 2962 Views
- 0 replies
- 0 kudos
- 3715 Views
- 1 replies
- 2 kudos
Resolved! Store a secret only accessible to the current user
During an interactive notebook session, I want a user to be able to retrieve a secret specific to that user. I haven't decided on storage mechanisms, but I'm open to storage mechanisms that can scalably authorize access to a single user and that I ca...
- 3715 Views
- 1 replies
- 2 kudos
- 2 kudos
I ended up using Databricks Secrets as the storage mechanism after learning from my account rep that the limit is soft and we can request a higher scope limit. In this case, each user gets a dedicated scope and no other users have access.
- 2 kudos
- 5185 Views
- 4 replies
- 1 kudos
Resolved! ML Practioner | ml 09 - automl notebook | error on importing databricks.automl
executing the following code...from databricks import automlsummary = automl.regress(train_df, target_col="price", primary_metric="rmse", timeout_minutes=5, max_trials=10)generates the error...ImportError: cannot import name 'automl' from 'databricks...
- 5185 Views
- 4 replies
- 1 kudos
- 3269 Views
- 2 replies
- 1 kudos
How to input initial centroids to K-Means or GMM Clustering in SparkML ?
Hi, I want to use KMeans Model or Gaussian Mixture Model algorithm for clustering using the SparkML library, in which I want to specify the initial centroids. The option of giving initial centroids is there in the Spark MLlib (RDD based APIs) however...
- 3269 Views
- 2 replies
- 1 kudos
- 9486 Views
- 4 replies
- 7 kudos
Resolved! No Module named 'mlflow'
I new to the scalable machine learning with apache spark course. I am in the notebook ML 00a - Install Datasets it includes one cell (attached) which throws an error 'no module named 'mlflow''. It attempts to run the Classroom-Setup file. Error is th...
- 9486 Views
- 4 replies
- 7 kudos
- 7 kudos
@Myles Pember​ I hope the suggestions above helped out! If so, please select one as 'best' for us!If you still need assistance, let us know!
- 7 kudos
- 4094 Views
- 2 replies
- 3 kudos
Resolved! ML Practioner | ML 10 - Feature Store notebook | feature_store import error
the following code...from pyspark.sql.functions import monotonically_increasing_id, lit, expr, randimport uuidfrom databricks import feature_storefrom pyspark.sql.types import StringType, DoubleTypefrom databricks.feature_store import feature_table, ...
- 4094 Views
- 2 replies
- 3 kudos
- 3 kudos
Hope that was an easy fix - @Tobias Cortese​ ! Thanks for marking the "best answer"!
- 3 kudos
- 7452 Views
- 4 replies
- 5 kudos
Getting Py4J "Could not find py4j jar" error when trying to use pypmml, solution doesn't work
I'm trying to use pypmml in a DB notebook, but I'm getting the known `Error : Py4JError: Could not find py4j jar at` error. I've followed the solution here: https://kb.databricks.com/libraries/pypmml-fail-find-py4j-jar.html. However, this has not wor...
- 7452 Views
- 4 replies
- 5 kudos
- 5 kudos
I've been struggling myslef with it, but after installing pypmml for spark, I can use the other library, maybe it will work for you:runtime 10.4 LTS MLinstall pypmml-spark (https://github.com/autodeployai/pypmml-spark)install pmml4s-spark (org.pmml4s...
- 5 kudos
- 3057 Views
- 2 replies
- 1 kudos
Is it possible to load MLFlow artifacts and models from local diretory to databricks DBFS?
I have been working locally and created a few models and now I want to move those to databricks/DBFS. Is it possible to do that?
- 3057 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Direo Direo​, can you check these docs and see if it helps-https://docs.databricks.com/applications/mlflow/access-hosted-tracking-server.html#access-the-mlflow-tracking-server-from-outside-databrickshttps://docs.databricks.com/applications/mlflow...
- 1 kudos
- 3666 Views
- 3 replies
- 1 kudos
ML Model serving cluster tags?
Is there a way to add tags automatically to ML Model serving clusters? I see we can add tags to the model itself which persist but any tags I add to the cluster serving it do not after the endpoint is stopped. This would be important to track billing...
- 3666 Views
- 3 replies
- 1 kudos
- 1 kudos
Hey there @Deep Kalra​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you....
- 1 kudos
- 1991 Views
- 0 replies
- 3 kudos
Java Error for installation rasterframes
Hi all,I have followed the steps in this notebook to install rasterframes on my databricks cluster.Eventually I am able to import the following:from pyrasterframes import rf_ipython from pyrasterframes.utils import create_rf_spark_session from pyspar...
- 1991 Views
- 0 replies
- 3 kudos
- 1217 Views
- 0 replies
- 1 kudos
I should the same issue about this: https://community.databricks.com/s/topic/0TO3f000000CjVqGAK/py4jjavaerror
Could you pls help take a look at it? Thanks!
- 1217 Views
- 0 replies
- 1 kudos
- 5281 Views
- 4 replies
- 0 kudos
Model serving keep relaunching
Hello, I tried to serve my model realtime. Model process keeps relaunching.I am getting this error in the logs, TypeError: Descriptors cannot not be created directly. If this call came from a _pb2.py file, your generated code is out of date and must ...
- 5281 Views
- 4 replies
- 0 kudos
- 0 kudos
Hey there @Hulma Abdul Rahman​ Hope you are well. Just wanted to see if you were able to find an answer to your question and would you like to mark an answer as best? It would be really helpful for the other members too.Cheers!
- 0 kudos
