cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Anonymous
by Not applicable
  • 1382 Views
  • 0 replies
  • 1 kudos

 Hello Everyone, I am thrilled to announce that we have our 3rd winner for the raffle contest - @Jogeswara​. Please join me in congratulating him on t...

 Hello Everyone,I am thrilled to announce that we have our 3rd winner for the raffle contest - @Jogeswara​. Please join me in congratulating him on this remarkable achievement!Jogesswara, your dedication and hard work have paid off, and we are deligh...

Winner3
  • 1382 Views
  • 0 replies
  • 1 kudos
Howard_w
by New Contributor
  • 6052 Views
  • 2 replies
  • 1 kudos

Resolved! Study material ML associate certification

Hi, is there an officially recommended book for the machine learning associate/professional certification? Or any sort of study guide or even third party course? I really struggle to find some study material for this activity.

  • 6052 Views
  • 2 replies
  • 1 kudos
Latest Reply
Priyag1
Honored Contributor II
  • 1 kudos

hello, to get an overview you may find out ML certification course from data bricks academy and refer the related concepts

  • 1 kudos
1 More Replies
Anonymous
by Not applicable
  • 2262 Views
  • 1 replies
  • 7 kudos

Train machine learning models: How can I take my ML lifecycle from experimentation to production?

Note: the following guide is primarily for Python users. For other languages, please view the following links: • Table batch reads and writes • Create a table in SQL • Visualizing data with DBSQLThis step-by-step guide will get your data...

Image Image Image Image
  • 2262 Views
  • 1 replies
  • 7 kudos
Latest Reply
Priyag1
Honored Contributor II
  • 7 kudos

I got good knowledge by your post . It is very clear . Thank you . Keep sharing like this posts .It will be helpful

  • 7 kudos
rohi
by New Contributor II
  • 1832 Views
  • 1 replies
  • 3 kudos
  • 1832 Views
  • 1 replies
  • 3 kudos
Latest Reply
Priyag1
Honored Contributor II
  • 3 kudos

@Rohini Singh​ what is your question exactly about program and code , be clear about what u wanna know

  • 3 kudos
qwerty1
by Contributor
  • 3535 Views
  • 1 replies
  • 1 kudos

Resolved! What is the disadvantage of using multiple Z-Order columns?

The documentation statesYou can specify multiple columns for  ZORDER BY as a comma-separated list. However, the effectiveness of the locality drops with each extra columnWhat does it mean for "effectiveness of the locality to drop" with each extra co...

  • 3535 Views
  • 1 replies
  • 1 kudos
Latest Reply
Anonymous
Not applicable
  • 1 kudos

@Ashwin Bhaskar​ :Z-ordering is a technique to improve the performance of queries that involve filtering and grouping on specific columns in a large distributed database. When a table is z-ordered on a certain column or set of columns, the data is so...

  • 1 kudos
khh2023
by New Contributor
  • 2775 Views
  • 1 replies
  • 0 kudos

Optimize operation with big increase in numRemovedFiles/numRemovedBytes/numAddedFiles/numAddedBytes

Hello, I have a daily loading process for a delta table and has a ‘optimize table’ step at the end. The optimize operation used to take about 5 minutes, but now takes about 3.5 hours. One thing I noticed from 'describe history' is the operationMetric...

image.png
  • 2775 Views
  • 1 replies
  • 0 kudos
Latest Reply
mathan_pillai
Databricks Employee
  • 0 kudos

This is most likely because more files became eligible for compaction (optimize). By default there is a limit of 50 files or so per partition, below which the partition doesn't qualify for optimize. Only if there are 50+ files within a partition the...

  • 0 kudos
Anonymous
by Not applicable
  • 4252 Views
  • 3 replies
  • 1 kudos

www.dbdemos.ai

Hurray!! Dolly demo is live now Build your Chat Bot with Dolly now. Experiment and let us know how do you feel about it.https://www.dbdemos.ai/demo.html?demoName=llm-dolly-chatbot

  • 4252 Views
  • 3 replies
  • 1 kudos
Latest Reply
David_K93
Contributor
  • 1 kudos

Hello,I've been working through the demo. I keep running into an error saying 'chromadb is not defined' when trying to run Chroma functions. See the example below. Seems to be an embedded object name? Thanks!

  • 1 kudos
2 More Replies
vittal
by New Contributor
  • 2133 Views
  • 1 replies
  • 0 kudos

Getting errors in DLT Pipeline while using ML Model

I am getting the following error when I try to run ML Models in Delta live Table Pipeline File "/local_disk0/.ephemeral_nfs/repl_tmp_data/ReplId-55c61-9b898-2c4b6-d/mlflow/envs/virtualenv_envs/mlflow-888f8c9b966409e6bddca3894244b4df9d1f94c1/lib/pyth...

  • 2133 Views
  • 1 replies
  • 0 kudos
Latest Reply
shan_chandra
Databricks Employee
  • 0 kudos

@Vittal Pai​  - In general, please follow the below steps for the mlflow CLI error,Step 1: set up API token and create secrets as mentioned in the below documenthttps://docs.databricks.com/machine-learning/manage-model-lifecycle/multiple-workspaces.h...

  • 0 kudos
Vaadee
by New Contributor
  • 2633 Views
  • 1 replies
  • 0 kudos

How to include additional feature columns in Databricks AutoML Forecast?

I'm using Databricks AutoML for time series forecasting, and I would like to include additional feature columns in my model to improve its performance. The available parameters in the databricks.automl.forecast() function primarily focus on the targ...

  • 2633 Views
  • 1 replies
  • 0 kudos
Latest Reply
shyam_9
Databricks Employee
  • 0 kudos

Hi @Vaadeendra Kumar Burra​, I am checking internally, will update you on this.

  • 0 kudos
prem_raj
by New Contributor II
  • 7499 Views
  • 2 replies
  • 0 kudos

AutoMl Forecasting - Query via REST (Issue with input date field)

Hi , Used automl forecasting model with sample data and the model is trained successfully. But when i was to serve the model over REST endpoint, i'm getting the error while querying via the inbuilt browser and postman. (Error seems to be with the dat...

  • 7499 Views
  • 2 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

@prem raj​ :Based on the error message, it seems that the input date format is not compatible with the model for inference. The error message suggests that the input date format is timezone-aware, while the model expects a timezone-naive format.To fi...

  • 0 kudos
1 More Replies
notsure
by New Contributor
  • 3995 Views
  • 2 replies
  • 1 kudos

Error with calling a machine learning serving endpoint

Hi!I have registered a spark model and generated a serving endpoint based on that.I am calling the endpoint with the relevant dataframe, somehow I got below errors. Could anyone show me how to tackle it, please? "Exception: Request failed with status...

  • 3995 Views
  • 2 replies
  • 1 kudos
Latest Reply
Anonymous
Not applicable
  • 1 kudos

Hi @mavis chen​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers yo...

  • 1 kudos
1 More Replies
Saeid_H
by Databricks Partner
  • 5643 Views
  • 2 replies
  • 0 kudos

Logging spark pipeline model using mlflow spark , leads to PythonSecurityException

Hello,I am currently using a simple pyspark pipeline to transform my training data, fit model and log the model using mlflow.spark. But I get this following error (with mlflow.sklearn it works perfectly fine but due to size of my data I need to use p...

  • 5643 Views
  • 2 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @Saeid Hedayati​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answer...

  • 0 kudos
1 More Replies
ACP
by New Contributor III
  • 1944 Views
  • 2 replies
  • 0 kudos

Didn't receive badges / points upon courses completion

Hi @Juliet Wu​ ,I have completed a few courses but didn't receive any badges or points. I also did an accreditation but also didn't receive anything.

  • 1944 Views
  • 2 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @Juliet Wu​ Thank you for reaching out! Please submit a ticket to our Training Team here: https://help.databricks.com/s/contact-us?ReqType=training  and our team will get back to you shortly. 

  • 0 kudos
1 More Replies
sridhar0109
by New Contributor
  • 2185 Views
  • 2 replies
  • 0 kudos

Tracking changes in data distribution by using pyspark

Hi All,I'm working on creating a data quality dashboard. I've created few rules like checking nulls in a column, checking for data type of the column , removing duplicates etc.We follow medallion architecture and are applying these data quality check...

  • 2185 Views
  • 2 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @Sridhar Varanasi​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.T...

  • 0 kudos
1 More Replies
hulma
by New Contributor II
  • 1682 Views
  • 2 replies
  • 1 kudos

dbfs file reference in pyfunc model for serverless inference

Hi, I was trying to migrate model serving from classic to serverless realtime inference.My model is currently being logged as pyfunc model and part of model script is to read dbfs file for inference. Now, with serverless i have error which it not abl...

  • 1682 Views
  • 2 replies
  • 1 kudos
Latest Reply
Anonymous
Not applicable
  • 1 kudos

Hi @Hulma Abdul Rahman​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best an...

  • 1 kudos
1 More Replies
Labels