- 12137 Views
- 10 replies
- 12 kudos
Resolved! Delete feature tables through the Python API
The documentation explains how to delete feature tables through the UI. Is it possible to do the same using the Python FeatureStoreClient? I cannot find anything in the docs: https://docs.databricks.com/_static/documents/feature-store-python-api-refe...
- 12137 Views
- 10 replies
- 12 kudos
- 12 kudos
from databricks import feature_store fs = feature_store.FeatureStoreClient() fs.drop_table(FEATURE_TABLE_NAME)As of Databricks Runtime 10.5 for ML. Docs
- 12 kudos
- 3664 Views
- 1 replies
- 2 kudos
py4j.security.Py4JSecurityException: Constructor public com.databricks.backend.daemon.dbutils.FSUtilsParallel(org.apache.spark.SparkContext) is not whitelisted. - DBR 10.4 LTS Shared mode
We're trying to update permission in Unity Catalog using spark sql statetment spark.sql("ALTER TABLE %s.%s OWNER TO `%s`;" % (raw_schema, table_name, 'Metastore_Admins'))But we're running into following error We're facing issues like these in DBR 10....
- 3664 Views
- 1 replies
- 2 kudos
- 2 kudos
I have seen this beforeso there is one file in the DBFS where we have to write the whitelisted file , so you have to find out where is your whitelisted file location after that you have to add that "com.databricks.....parallel" line in that file and ...
- 2 kudos
- 3672 Views
- 1 replies
- 4 kudos
Databricks MLOps Best Practices
Where to find the best practices on MLOps on DatabricksWe recommend checking out the Big Book of MLOps for detailed guidance on MLOps best practices on Databricks including reference architectures.For a deep dive on the Databricks Feature store, we r...
- 3672 Views
- 1 replies
- 4 kudos
- 4 kudos
you can check here https://docs.databricks.com/machine-learning/mlops/mlops-workflow.html
- 4 kudos
- 1961 Views
- 2 replies
- 6 kudos
Weekly Release Notes RecapHere’s a quick recap of the latest release notes updates from the past one week. Databricks platform release notes December ...
Weekly Release Notes RecapHere’s a quick recap of the latest release notes updates from the past one week.Databricks platform release notes December 5 - 16, 2022Databricks JDBC driver 2.6.32Version 2.6.32 of the Databricks JDBC driver (download and M...
- 1961 Views
- 2 replies
- 6 kudos
- 2254 Views
- 0 replies
- 1 kudos
parallel run in job pipeline
I am trying to build a pipeline which deploys a ML model, and I want to build the pipeline in Workflow/jobs. In task of prediction of the model, I have hundreds of groups of input features, I use a for loop to get one group of input features and do ...
- 2254 Views
- 0 replies
- 1 kudos
- 1859 Views
- 1 replies
- 0 kudos
Resolved! MLflow API return Description of a run
Is there a way to get the description of a run using MLflow API?
- 1859 Views
- 1 replies
- 0 kudos
- 0 kudos
Ok, just found it, it's called 'tags.mlflow.note.content'
- 0 kudos
- 5467 Views
- 4 replies
- 4 kudos
conda-env: error: unrecognized arguments: 'virtualenv': 'python_env.yaml'
I have registered an experiment as model in the model registry and when I start serving the model I get the following error:usage: conda-env [-h] {create,export,list,remove,update,config} ...conda-env: error: unrecognized arguments: 'virtualenv': 'py...
- 5467 Views
- 4 replies
- 4 kudos
- 4 kudos
Hi Follks, Is there any new on this?.What should I do?ThanksBestPablo
- 4 kudos
- 1519 Views
- 0 replies
- 0 kudos
PYSPARK - Can't run DecisionTreeClassifier everytime
Hello community,It's my first time here and i have a poor english so sorry for the mistakes I want to make a decision tree in pyspark on a training data (then i would like to evaluate it on a testing data). My target is a variable with 2 values ("one...
- 1519 Views
- 0 replies
- 0 kudos
- 1390 Views
- 0 replies
- 2 kudos
Curbing toxic players with data and machine learning  A Unity study paints a grim picture of the g@ming community’s propensity for toxicity. It found ...
Curbing toxic players with data and machine learningA Unity study paints a grim picture of the g@ming community’s propensity for toxicity. It found seven out of 10 players have experienced some form of frequent toxic behavior — nearly half of players...
- 1390 Views
- 0 replies
- 2 kudos
- 6240 Views
- 7 replies
- 13 kudos
Resolved! Getting started with Databricks Machine Learning
hello all,I am fairly new to Databricks technologies and I have taken the Lakehouse Fundamentals course but I am interested in Machine Learning technologies. I will appreciate any help with materials and curated free study paths and packs that can he...
- 6240 Views
- 7 replies
- 13 kudos
- 13 kudos
https://pages.databricks.com/rs/094-YMS-629/images/LearningSpark2.0.pdf is a free book and has some machine learning examples. The way I learned was mostly from the docs, which are good and have good coding examples.
- 13 kudos
- 4407 Views
- 2 replies
- 1 kudos
MLflow stopped working after one a few successful runs
Both the mlflow.log_metrics() call and the web UI worked in the first few days but started failing at some point. The log doesn't give any clue why this is happening. It's suspicious but is there a limit of mlflow requests? It's quite annoying that t...
- 4407 Views
- 2 replies
- 1 kudos
- 7955 Views
- 3 replies
- 15 kudos
Resolved! Do One-Hot-Encoding (OHE) before or after split data to train and test dataframe
Hi,I wonder that I should do OHE before or after I split data to build up a ML model.Please give some advise.
- 7955 Views
- 3 replies
- 15 kudos
- 15 kudos
Hi @Nhat Hoang​ ,While not Databricks-specific, here's a good answer:"If you perform the encoding before the split, it will lead to data leakage (train-test contamination). In this sense, you will introduce new data (integers of Label Encoders) and u...
- 15 kudos
- 934 Views
- 0 replies
- 0 kudos
Databricks-hosted MLFlow ignores the `mlflow.user` tag when set in the "runs/create" REST API call and doesn't let me change it after a ...
Databricks-hosted MLFlow ignores the `mlflow.user` tag when set in the "runs/create" REST API call and doesn't let me change it after a run is created.Open source MLFlow respects the tag.Could you please change the server to respect this field when i...
- 934 Views
- 0 replies
- 0 kudos
- 6694 Views
- 7 replies
- 15 kudos
What programming frameworks and languages can be used with Databricks Feature Store
To leverage Databricks feature store, can only Python be utilized? If otherwise, what other language frameworks are supported. Below is my question in 2 partsPart 1) What languages can be utilized to write data frames as feature tables in the Feature...
- 6694 Views
- 7 replies
- 15 kudos
- 2868 Views
- 3 replies
- 10 kudos
I am Avi, a Solutions Architect at Databricks. We have built an application to demonstrate how AI-capabilities could be easily integrated to deliver n...
I am Avi, a Solutions Architect at Databricks. We have built an application to demonstrate how AI-capabilities could be easily integrated to deliver novel user experiences. The application allows users to submit images and text, and uses these inputs...
- 2868 Views
- 3 replies
- 10 kudos
