Databricks Community is an open-source platform for data enthusiasts and professionals to discuss, share insights, and collaborate on everything related to Databricks. Members can ask questions, share knowledge, and support each other in an environment that ensures respectful interactions.
Hi, I have deployed an endpoint in Databricks using legacy serving. I am using the custom pyfunc in mlflow to deploy the custom code. This code uses Machine Learning to parse out the table of conten...
I am looking for the more detailed resources comparing RAG to fine-tuning methods in AI models to processing text data with LLM in laymen notes. I have found one resource but looking for the mor...
Hi! Had really interesting results from some endpoint performance tests I did. I set up the non-optimized endpoint with zero-cluster scaling and optimized had this feature disabled. 1) Why ...
I am new to databricks. and trying to debug my python application with variable-explore by following the instruction from: https://www.databricks.com/blog/new-debugging-features-databricks-noteb...
how i can import : import com.microsoft.ml.spark.{LightGBMClassifier,LightGBMClassificationModel} import ml.dmlc.xgboost4j.scala.spark.{XGBoostEstimator, XGBoostClassificationModel} ...
I am trying to get a prediction by querying the ML Endpoint on Azure Databricks with R. I'm not sure what is the format of the expected data. Is there any other problem with this code?   ...
I am getting the following error while saving a delta table in the feature store WARNING databricks.feature_store._catalog_client_helper: Failed to record data sources in the catalog. Exception: {'e...
Hello community, i have the following problem: I am using automl to solve a regression model, but in the preprocessing my dataset is sampled to ~30% of the original amount. I am using runtime 14.2 ...
I've signed up for the module for certification on Large Language Models: Application through Production. Follow the Github instructions and install the notebooks provided. Unfortunately none of th...