Databricks Community

***Understanding Databricks Machine Learning Workspace - 1***Databricks Machine Learning helps you simplify and standardize your ML development proce...

***Understanding Databricks Machine Learning Workspace - 1***Databricks Machine Learning helps you simplify and standardize your ML development processes. It is helpful to :Train models either manually or with AutoML.Track training parameters and mo...

XGBModel' object has no attribute 'feature_types'

I saved an xgboost boost model in filetstore as a pkl file.I call the model by the commands belowmodel = pickle.load(open('/.../model.pkl', 'rb'))model.predict_proba(df[features])The model has been running for sometime with the above commands but I n...

Introducing the new databricks UI: a sleek and intuitive data science and engineering interface. Don’t miss this opportunity to experience the power a...

Introducing the new databricks UI: a sleek and intuitive data science and engineering interface. Don’t miss this opportunity to experience the power and simplicity of Databricks. Try it out today! 

 Hello Everyone, I am thrilled to announce that we have our 3rd winner for the raffle contest - @Jogeswara​. Please join me in congratulating him on t...

 Hello Everyone,I am thrilled to announce that we have our 3rd winner for the raffle contest - @Jogeswara​. Please join me in congratulating him on this remarkable achievement!Jogesswara, your dedication and hard work have paid off, and we are deligh...

Train machine learning models: How can I take my ML lifecycle from experimentation to production?

Note: the following guide is primarily for Python users. For other languages, please view the following links: • Table batch reads and writes • Create a table in SQL • Visualizing data with DBSQLThis step-by-step guide will get your data...

program and code

Optimize operation with big increase in numRemovedFiles/numRemovedBytes/numAddedFiles/numAddedBytes

Hello, I have a daily loading process for a delta table and has a ‘optimize table’ step at the end. The optimize operation used to take about 5 minutes, but now takes about 3.5 hours. One thing I noticed from 'describe history' is the operationMetric...

www.dbdemos.ai

Hurray!! Dolly demo is live now Build your Chat Bot with Dolly now. Experiment and let us know how do you feel about it.https://www.dbdemos.ai/demo.html?demoName=llm-dolly-chatbot

Getting errors in DLT Pipeline while using ML Model

I am getting the following error when I try to run ML Models in Delta live Table Pipeline File "/local_disk0/.ephemeral_nfs/repl_tmp_data/ReplId-55c61-9b898-2c4b6-d/mlflow/envs/virtualenv_envs/mlflow-888f8c9b966409e6bddca3894244b4df9d1f94c1/lib/pyth...

How to include additional feature columns in Databricks AutoML Forecast?

I'm using Databricks AutoML for time series forecasting, and I would like to include additional feature columns in my model to improve its performance. The available parameters in the databricks.automl.forecast() function primarily focus on the targ...

AutoMl Forecasting - Query via REST (Issue with input date field)

Hi , Used automl forecasting model with sample data and the model is trained successfully. But when i was to serve the model over REST endpoint, i'm getting the error while querying via the inbuilt browser and postman. (Error seems to be with the dat...

Error with calling a machine learning serving endpoint

Hi!I have registered a spark model and generated a serving endpoint based on that.I am calling the endpoint with the relevant dataframe, somehow I got below errors. Could anyone show me how to tackle it, please? "Exception: Request failed with status...

Logging spark pipeline model using mlflow spark , leads to PythonSecurityException

Hello,I am currently using a simple pyspark pipeline to transform my training data, fit model and log the model using mlflow.spark. But I get this following error (with mlflow.sklearn it works perfectly fine but due to size of my data I need to use p...