Databricks

Slalom_Tobias · 08-30-2022

I'm attempting to use MLFlow to register models in Databricks and am following the recipe at...https://nlp.johnsnowlabs.com/docs/en/licensed_serving_spark_nlp_via_api_databricks_mlflowwhen i execute...mlflow.spark.log_model(pipeline, "lemmatizer", co...

Slalom_Tobias · 08-22-2022

I'm getting the error...AttributeError: 'SparkSession' object has no attribute '_wrapped'---------------------------------------------------------------------------AttributeError Traceback (most recent call last)<command-2311820097584616> in <cell li...

Slalom_Tobias · 08-01-2022

the following code...from pyspark.sql.functions import monotonically_increasing_id, lit, expr, randimport uuidfrom databricks import feature_storefrom pyspark.sql.types import StringType, DoubleTypefrom databricks.feature_store import feature_table, ...

Slalom_Tobias · 08-01-2022

the following code...from sparkdl.xgboost import XgboostRegressorfrom pyspark.ml import Pipelineparams = {"n_estimators": 100, "learning_rate": 0.1, "max_depth": 4, "random_state": 42, "missing": 0}xgboost = XgboostRegressor(**params)pipeline = Pipel...

Slalom_Tobias · 08-01-2022

executing the following code...from databricks import automlsummary = automl.regress(train_df, target_col="price", primary_metric="rmse", timeout_minutes=5, max_trials=10)generates the error...ImportError: cannot import name 'automl' from 'databricks...

Slalom_Tobias

Seems like this thread has died, but for posterity, databricks provides the following code for installing poppler on a cluster. The code is sourced from the dbdemos accelerators, specifically the "LLM Chatbot With Retrieval Augmented Generation (RAG)...

Slalom_Tobias · 09-25-2022

I haven't found a solution within the documentation.

Slalom_Tobias · 08-01-2022

Thanks Prabakar!The root issue is that my company's sandbox didn't have an ML cluster available so I was trying to import the required libraries, which don't seem to be publicly available. I'm now guessing that's done purposefully to protect the code...

Databricks

User Stats

User Activity

Cannot serialize this model error when attempting MLFlow for SparkNLP

AttributeError: 'SparkSession' object has no attribute '_wrapped' when attempting CoNLL.readDataset()

ML Practioner | ML 10 - Feature Store notebook | feature_store import error

ML Practioner | ML 11 - XGBoost notebook | cannot import keras.applications.resnet50

ML Practioner | ml 09 - automl notebook | error on importing databricks.automl

Re: Trying to use pdf2image on databricks

Re: Cannot serialize this model error when attempting MLFlow for SparkNLP

Re: ML Practioner | ml 09 - automl notebook | error on importing databricks.automl