cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results for 
Search instead for 
Did you mean: 
Data + AI Summit 2024 - Data Science & Machine Learning

Forum Posts

anu_sh
by New Contributor II
  • 2170 Views
  • 2 replies
  • 6 kudos
  • 2170 Views
  • 2 replies
  • 6 kudos
Latest Reply
-werners-
Esteemed Contributor III
  • 6 kudos

Here are the supported data types for the Feature Store:https://docs.databricks.com/applications/machine-learning/feature-store/feature-tables.html#supported-data-typesAs you can see, image is not between them, but you could use BinaryType.

  • 6 kudos
1 More Replies
Mohit_m
by Valued Contributor II
  • 2230 Views
  • 2 replies
  • 3 kudos

Resolved! How to enable and disable Model Serving using Rest API

ML flow model serving in Databricks docs details the options to enable and disable from the UIhttps://docs.databricks.com/applications/mlflow/model-serving.html

  • 2230 Views
  • 2 replies
  • 3 kudos
Latest Reply
Mohit_m
Valued Contributor II
  • 3 kudos

Please find below the REST APIs to enable and disable Model-ServingBelow are the examples in PythonYou need to use the token to interact with Rest APItoken = "dxxxxxx"instance = "https://<workspacexxx>.cloud.databricks.com"headers = {'Authorization':...

  • 3 kudos
1 More Replies
MadelynM
by Databricks Employee
  • 1766 Views
  • 1 replies
  • 7 kudos

2021-07-Webinar--Hassle-Free-Data-Ingestion-Social-1200x628

Thanks to everyone who joined the Hassle-Free Data Ingestion webinar. You can access the on-demand recording here. We're sharing a subset of the phenomenal questions asked and answered throughout the session. You'll find Ingestion Q&A listed first, f...

  • 1766 Views
  • 1 replies
  • 7 kudos
Latest Reply
Emily_S
New Contributor III
  • 7 kudos

Check out Part 2 of this Data Ingestion webinar to find out how to easily ingest semi-structured data at scale into your Delta Lake, including how to use Databricks Auto Loader to ingest JSON data into Delta Lake.

  • 7 kudos
MadelynM
by Databricks Employee
  • 1447 Views
  • 0 replies
  • 2 kudos

2021-08-Best-Practices-for-Your-Data-Architecture-v3-OG-1200x628

Thanks to everyone who joined the Best Practices for Your Data Architecture session on Optimizing Data Performance. You can access the on-demand session recording here and the pre-run performance benchmarks using the Spark UI Simulator. Proper cluste...

  • 1447 Views
  • 0 replies
  • 2 kudos
Raghav1
by New Contributor II
  • 726 Views
  • 0 replies
  • 0 kudos

I have created a key in Azure Key Vault to store my secrets in it. In order to use it securely in Azure DataBricks, have created the secret scope and ...

I have created a key in Azure Key Vault to store my secrets in it. In order to use it securely in Azure DataBricks, have created the secret scope and configured the Azure Key Vault properties. Out of curiosity, just wanted to check whether my key is ...

databricks issue
  • 726 Views
  • 0 replies
  • 0 kudos
Dan_Z
by Databricks Employee
  • 666 Views
  • 0 replies
  • 0 kudos

spark.apache.org

mapInPandas is one of the most powerful Spark functions. It uses an arrow-like in-memory data structure to split up Spark Data Frames into chunks and feeding them to a function that takes a Pandas DF as input and output. Check it out here:https://spa...

  • 666 Views
  • 0 replies
  • 0 kudos
User16835756816
by Valued Contributor
  • 971 Views
  • 0 replies
  • 6 kudos

Ready to get hands-on? Explore the collaborative notebook environment: This gallery showcases some of the possibilities through Notebooks focused on ...

Ready to get hands-on? Explore the collaborative notebook environment: This gallery showcases some of the possibilities through Notebooks focused on technologies and use cases which can easily be imported into your own Databricks environment or the f...

  • 971 Views
  • 0 replies
  • 6 kudos
Joseph_B
by Databricks Employee
  • 1137 Views
  • 0 replies
  • 1 kudos

mlflow.org

2021-09 webinar: Automating the ML Lifecycle With Databricks Machine Learning (Post 2 of 2)Thank you to everyone who joined! You can access the on-demand recording here and the code in this Github repo.We're sharing a subset of the questions asked an...

  • 1137 Views
  • 0 replies
  • 1 kudos
Joseph_B
by Databricks Employee
  • 842 Views
  • 0 replies
  • 1 kudos

docs.databricks.com

2021-09 webinar: Automating the ML Lifecycle With Databricks Machine Learning (post 1 of 2)Thank you to everyone who joined the Automating the ML Lifecycle With Databricks Machine Learning webinar! You can access the on-demand recording here and the ...

  • 842 Views
  • 0 replies
  • 1 kudos
Joseph_B
by Databricks Employee
  • 1198 Views
  • 1 replies
  • 0 kudos

What does it mean if an MLflow run is "UNFINISHED?"

The run has a model logged to it already, but the "Status" field says "UNFINISHED."

  • 1198 Views
  • 1 replies
  • 0 kudos
Latest Reply
Joseph_B
Databricks Employee
  • 0 kudos

The MLflow run was probably created either (a) via notebook autologging or (b) via a call to `mlflow.start_run()`. With (a), when the notebook first logs something to MLflow, it starts a run. But if the notebook is still active and attached to a clu...

  • 0 kudos
MCosta
by New Contributor III
  • 1570 Views
  • 1 replies
  • 1 kudos

Delta Lake as source of images to train a classification model on a local computer

Hi Folks, I'm evaluating Delta Lake to store image / data version control to be used to train models. I looked at a session explaining how to do this and also using MLflow to manage training (https://databricks.com/session_na21/image-processing-on-d...

  • 1570 Views
  • 1 replies
  • 1 kudos
Latest Reply
-werners-
Esteemed Contributor III
  • 1 kudos

I can think of 3 ways for doing this:using the web UI (the create table option or upload data into DBFS)using databricks-connect, which bridges your local machine with the remote databricks clustersusing the databricks-cli to copy local files to dbfs...

  • 1 kudos
User15787040559
by Databricks Employee
  • 2395 Views
  • 2 replies
  • 0 kudos

Is there a way to add an instance profile to a Databricks group using REST API?

Please seehttps://docs.databricks.com/dev-tools/api/latest/scim/scim-groups.htmlAn examplecurl -X PATCH -n 'https://test-fw-us-1.cloud.databricks.com/api/2.0/preview/scim/v2/Groups/4062877510650442' -d \ "{ \"schemas\":[\"urn:ietf:params:scim:api:mes...

  • 2395 Views
  • 2 replies
  • 0 kudos
Latest Reply
Cary
Databricks Employee
  • 0 kudos

Without knowing all that you are trying to do, the answer is yes, with the Instance Profile API. https://docs.databricks.com/dev-tools/api/latest/instance-profiles.html. You might also check out the SCIM APIs to associate the Instance Profile to a g...

  • 0 kudos
1 More Replies

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Labels