Databricks Community is an open-source platform for data enthusiasts and professionals to discuss, share insights, and collaborate on everything related to Databricks. Members can ask questions, share knowledge, and support each other in an environment that ensures respectful interactions.
I created an online table for feature serving based on an existing delta table (used as the source table). This source table contains a struct column and an array column, but when the online table i...
I want to get the LightGBM built-in variable importance values from a model that was generated by AutoML. That's not logged in the metrics by default - can I change a setting so that it will be...
Hi - I'm trying to upload a file, so that I can use the same in my notebook to try ML experiments with Databricks. From my workspace, I created a folder. But the option 'Create -> File' does not d...
Hi, I am trying to create a simple langgraph agent in Databricks, the agent also uses lanngraph memory checkpoint which enables to store the state of the graph. This is working fine when I am trying...
...ax_evals=8,
trials=spark_trials,
) which invokes the defined function train_model(): def train_model(params):
mlflow.xgboost.autolog()
with mlflow.start_run(nested=True):
train = x...
We are trying to train a predictive ML model using the XGBoost Classifier. Part of the requirements we have gotten from our business team is to implement feature weighting as they have defined certai...
Databricks Online Feature Table is in public preview , And we have some questions on this 1) What storage is being used for Online Feature table's Data. Our offline feature table is stored in ...
Hi, Is it possible to have a Spark session, that can be to used query the Unity Catalog etc, available within a Model Serving? I have an MLFlow Pyfunc model that needs to get data from a Feature Ta...
I am trying to create a vector search index for a table, but it stops at 45406 rows. I can see that the writeback table has all the records but the indexing stops. Is there a hard limit on index?