cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

StephanieRivera
by Valued Contributor II
  • 540 Views
  • 1 replies
  • 2 kudos

How do I move the template files into my own repo when cloning the MLflow recipes templates into Databricks?

Here https://mlflow.org/docs/latest/recipes.html#model-development-workflow, there are directions to add the repo. Is this best practice in Databricks? I tried exporting the repo code (inside of a Databricks notebook).. My DBC export was successful. ...

  • 540 Views
  • 1 replies
  • 2 kudos
Latest Reply
Anonymous
Not applicable
  • 2 kudos

Hi @Stephanie Rivera​ Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.

  • 2 kudos
Anonymous
by Not applicable
  • 925 Views
  • 1 replies
  • 7 kudos

Train machine learning models: How can I take my ML lifecycle from experimentation to production?

Note: the following guide is primarily for Python users. For other languages, please view the following links: • Table batch reads and writes • Create a table in SQL • Visualizing data with DBSQLThis step-by-step guide will get your data...

Image Image Image Image
  • 925 Views
  • 1 replies
  • 7 kudos
Latest Reply
Priyag1
Honored Contributor II
  • 7 kudos

I got good knowledge by your post . It is very clear . Thank you . Keep sharing like this posts .It will be helpful

  • 7 kudos
KVNARK
by Honored Contributor II
  • 829 Views
  • 2 replies
  • 4 kudos

Implementation of best practices in authorization to a service application

we are working on authentication mechanism for our model service application using python framework fastAPI deployed on azure cloud, Need help on end to end auth mechanism(either through inbuild mechanism in python like jwt etc., or with azure).kindl...

  • 829 Views
  • 2 replies
  • 4 kudos
Latest Reply
Debayan
Esteemed Contributor III
  • 4 kudos

Could you please explain it a little more?For authentication, please refer: https://learn.microsoft.com/en-us/azure/databricks/dev-tools/api/latest/authenticationhttps://learn.microsoft.com/en-us/azure/databricks/security/security-overview-azure#--au...

  • 4 kudos
1 More Replies
isaac_gritz
by Valued Contributor II
  • 953 Views
  • 1 replies
  • 4 kudos

Databricks MLOps Best Practices

Where to find the best practices on MLOps on DatabricksWe recommend checking out the Big Book of MLOps for detailed guidance on MLOps best practices on Databricks including reference architectures.For a deep dive on the Databricks Feature store, we r...

  • 953 Views
  • 1 replies
  • 4 kudos
Latest Reply
sher
Valued Contributor II
  • 4 kudos

you can check here https://docs.databricks.com/machine-learning/mlops/mlops-workflow.html

  • 4 kudos
wchen
by New Contributor II
  • 5615 Views
  • 7 replies
  • 2 kudos

Resolved! In Databricks, the Python kafka consumer app in notebook to Confluent Cloud having the issue captured in the Body of question: SASL/PLAIN authentication being used

kafkashaded.org.apache.kafka.common.KafkaException: Failed to construct kafka consumer at kafkashaded.org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:823) at kafkashaded.org.apache.kafka.clients.consumer.KafkaConsumer.<init>...

  • 5615 Views
  • 7 replies
  • 2 kudos
Latest Reply
bigdata70
New Contributor III
  • 2 kudos

@Kaniz Fatma​ I am having the same issue.%python import pyspark.sql.functions as fn from pyspark.sql.types import StringType   binary_to_string = fn.udf(lambda x: str(int.from_bytes(x, byteorder='big')), StringType())   df = spark.readStream.format("...

  • 2 kudos
6 More Replies
trkrishnan
by New Contributor III
  • 1305 Views
  • 2 replies
  • 6 kudos

Resolved! Spark nlp on Databricks - looking for known issues/best practices

I m currently looking for information on whether Spark NLP can run fine on Databricks platform.Can someone please share - known issues/bugs encountered- any fixes or config settings required in environment- best practices to follow

  • 1305 Views
  • 2 replies
  • 6 kudos
Latest Reply
trkrishnan
New Contributor III
  • 6 kudos

Thanks a lot for the quick response

  • 6 kudos
1 More Replies
MadelynM
by New Contributor III
  • 1129 Views
  • 0 replies
  • 2 kudos

2021-08-Best-Practices-for-Your-Data-Architecture-v3-OG-1200x628

Thanks to everyone who joined the Best Practices for Your Data Architecture session on Optimizing Data Performance. You can access the on-demand session recording here and the pre-run performance benchmarks using the Spark UI Simulator. Proper cluste...

  • 1129 Views
  • 0 replies
  • 2 kudos
User16789201666
by Contributor II
  • 2415 Views
  • 0 replies
  • 0 kudos

When to use uniform vs log-uniform in Hyperopt?

Hyperopt offers hp.uniform and hp.loguniform, both of which produce real values in a min/max range. hp.loguniform is more suitable when one might choose a geometric series of values to try (0.001, 0.01, 0.1) rather than arithmetic (0.1, 0.2, 0.3). Wh...

  • 2415 Views
  • 0 replies
  • 0 kudos
Labels