- 51 Views
- 1 replies
- 1 kudos
Using Machine Learning to Improve Emulator Compatibility Predictions
Hi everyone,I'm working on a personal project and would appreciate some advice from people who have experience with machine learning on Databricks.Imagine having a dataset containing thousands of game compatibility records collected from different em...
- 51 Views
- 1 replies
- 1 kudos
- 1 kudos
This is a classification problem, not a recommendation system. Recommenders are for "which item does this user prefer among many," but what you're describing is "does this game run on this config," which is a label you're predicting from a se...
- 1 kudos
- 163 Views
- 1 replies
- 0 kudos
Serving endpoint - automatic system updates
Dear Community I need some support with investigation related to Serving Endpoints. Recently some of endpoints with deployed ML models display message:This endpoint is out of compliance because it is too old and automatic system updates have failed.P...
- 163 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi, Could you provide a workspaceID and endpointID and any other details such as screenshots? Will check to see what I can find based on those details, ~Mo.
- 0 kudos
- 158 Views
- 1 replies
- 0 kudos
Can't select Serverless GPU on notebooks
When trying to use serverless gpu on a notebook, I get this error. Serverless CPU works fine though.Can you help me understand why I get this?
- 158 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @LPBigot, Since Serverless CPU is working but Serverless GPU is failing when the notebook tries to attach compute, could you confirm a couple of things so we can narrow this down? Is this a paid/Premium+ workspace, or is it a free/trial-style setu...
- 0 kudos
- 209 Views
- 1 replies
- 0 kudos
Free Edition CrossValidator not working because of internal caching
Hi all,I am getting the following error when using CrossValidator in Databricks Free Edition v5 (see attachment):In shared or serverless cluster, SPARK_ML_TMP_DFS_PATH environmental variable must be set to a UC volume path like '/Volumes/...' in orde...
- 209 Views
- 1 replies
- 0 kudos
- 0 kudos
What you are encountering is an expected behavior on Databricks serverless. Because CrossValidator (along with other Spark ML tuning estimators) relies heavily on internal DataFrame caching to optimize iterative model training, Databricks enforces st...
- 0 kudos
- 3216 Views
- 4 replies
- 2 kudos
How to use Databricks secrets on MLFlow conda dependencies?
Hi!Do you know if it's correct to use the plain user and token for installing a custom dependency (an internal python package) in a mlflow registered model? (it's the only way I get it working because if not it can't install the dependency) It works,...
- 3216 Views
- 4 replies
- 2 kudos
- 2 kudos
The dynamic conda.yaml generation trick doesn't actually fix this, and you already found that out yourself. Whatever ends up in the final logged conda.yaml is what gets read at environment build time, so if a plaintext credential has to be in that fi...
- 2 kudos
- 500 Views
- 2 replies
- 0 kudos
AutoML on Azure Databricks as of June 2026
Hello everybody,My team and I are facing a sudden and unexpected issue with training Forecasting models utilizing AutoML on Azure Databricks. As of two weeks ago, we privatized our Azure Databricks environment behind a private network, accessible onl...
- 500 Views
- 2 replies
- 0 kudos
- 0 kudos
Databricks AutoML is still around and actively used as of mid-2026, so nothing's wrong on that front, but there's a nuance worth knowing: starting with Databricks Runtime 18.0 ML, AutoML was removed as a built-in library on classic compute. It's stil...
- 0 kudos
- 199 Views
- 1 replies
- 0 kudos
Notebooks for Labs
Hello can someone tell me where do I find the notebooks in the demo sessions of Associate ML pathways?
- 199 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @ShaRKS, If you are taking the Associate ML pathway, the notebooks are typically available through the course's lab environment rather than as separate downloadable assets. Databricks course pages for the ML curriculum note that lecture notebooks ...
- 0 kudos
- 335 Views
- 4 replies
- 0 kudos
what is the GPU quota limit for free edition?
what is the GPU quota limit for free edition? I used 5 minutes few days back now can not attach GPU cluster, it showing quota exceeded
- 335 Views
- 4 replies
- 0 kudos
- 0 kudos
I have opened the 14 days trial version , still not able to do this .. have not used any compute yet..
- 0 kudos
- 622 Views
- 4 replies
- 2 kudos
Resolved! Serverless ML
Hello,I'm trying to set up a DAB job that runs an ML job. For this it would be useful to use a serverless ML environment, that I can select in notebooks. Anyway, I do not find a meaningful way to define the base environment as ML.I do not want to giv...
- 622 Views
- 4 replies
- 2 kudos
- 2 kudos
You can create the environment in the DABenvironments: - environment_key: default spec: environment_version: "5" dependencies: - xgboost # AddYou can also create a file with packag...
- 2 kudos
- 551 Views
- 1 replies
- 1 kudos
Resolved! Can Databricks Jobs Run on Kubernetes Clusters?
Context: We're exploring using Kubernetes (EKS) as our compute infrastructure instead of Databricks managed clusters. We want to understand if Databricks can orchestrate, deploy, and monitor jobs that run on a Kubernetes cluster.Questions:Is it possi...
- 551 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @ASH1243434 ,Unfortunately, the Databricks cannot natively route job execution into your EKS cluster. There is no "external compute" or "bring your own Kubernetes" option in Databricks Jobs configuration. If my answer was helpful, please consider ...
- 1 kudos
- 632 Views
- 1 replies
- 2 kudos
Resolved! Models failing in tutorial
Hello,I am following the "Get started: Build your first machine learning model on Databricks" tutorial, and am getting stuck on "Parallel training using Optuna".When I Search runs to retrieve the best model, the following code fails as there are no m...
- 632 Views
- 1 replies
- 2 kudos
- 2 kudos
You can change the objective trial code to use optuna & follow the other steps in the tutorial & run the full code seamlessly.Modify objective trial - use optuna in Free edition for serverless auth accommodation.def objective(trial): # Enable autol...
- 2 kudos
- 434 Views
- 1 replies
- 0 kudos
Resolved! Whether MCP server support for Genie is available in our workspace/region for free version.
We are building a production support agent that requires seamless integration between:Genie spaces (for analytics queries)Vector search Custom tools The MCP protocol provides a standardized interface for this multi-tool architecture.i am using free t...
- 434 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Anvy, This depends on whether you are on a standard Databricks workspace or on Databricks Free Edition. The public docs show that Databricks managed MCP servers are currently in Public Preview, and the managed Genie MCP server itself is still lis...
- 0 kudos
- 1197 Views
- 3 replies
- 1 kudos
Resolved! AutoML on Databricks as of May 2026
On Azure Databricks, I have been creating AutoML experiments on May 15th 2026, using a Single User compute with Databricks runtime 17.3 LTS for ML, which I have assigned to myself.I try to register one of the trained ML models in a schema, under a un...
- 1197 Views
- 3 replies
- 1 kudos
- 1 kudos
Update: Today, May 19th 2026, the issue seems to have been resolved.I suppose some bug fix has been released.
- 1 kudos
- 16887 Views
- 7 replies
- 3 kudos
Resolved! How to PREVENT mlflow's autologging from logging ALL runs?
I am logging runs from jupyter notebook. the cells which has `mlflow.sklearn.autlog()` behaves as expected. but, the cells which has .fit() method being called on sklearn's estimators are also being logged as runs without explicitly mentioning `mlflo...
- 16887 Views
- 7 replies
- 3 kudos
- 3 kudos
Good question—mlflow autologging can easily capture more runs than expected if not configured properly. Managing it carefully improves experiment tracking. Similar control and optimization are important in bussid mod workflows, where users fine-tune ...
- 3 kudos
- 759 Views
- 2 replies
- 0 kudos
Memory error in LightGBM training data processing
I am developing a LightGBM model on Databricks, and I am using the Native API because it offers the widest range of options and allows me to try various approaches.The training data is loaded from a table in the Catalog as a Spark DataFrame. However,...
- 759 Views
- 2 replies
- 0 kudos
