cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

KailashLohar
by Databricks Partner
  • 5025 Views
  • 5 replies
  • 1 kudos

DatabricksApiException Error in Microsoft Azure Databricks

I am doing a course on Machine Learning Associate course , at the starting itseld i am getting error while running in Azure Databricks.Can somebody help me in solving this error.

Screenshot 2024-09-07 at 9.37.57 AM.png
  • 5025 Views
  • 5 replies
  • 1 kudos
Latest Reply
usmankhan36
New Contributor II
  • 1 kudos

The error message indicates that Workspace Feature Store has been deprecated in your Azure Databricks workspace. The error occurs because the Feature Store API is no longer supported in your environment.How to Fix It:Check If Your Databricks Workspac...

  • 1 kudos
4 More Replies
ncparab13
by New Contributor II
  • 1925 Views
  • 2 replies
  • 1 kudos

deploy, train and monitor AI/ML model in databricks in automated way.

Hi Team, I have my databricks environment where I want to deploy, train and monitor ML model in automated way(github action). How I can do that?

  • 1925 Views
  • 2 replies
  • 1 kudos
Latest Reply
ashraf1395
Honored Contributor
  • 1 kudos

Hi there @ncparab13,- https://docs.databricks.com/aws/en/dev-tools/bundles/mlops-stacks ,- https://docs.databricks.com/aws/en/machine-learning/mlops/ci-cd-for-ml , - https://docs.databricks.com/aws/en/repos/ci-cd-techniques-with-reposHere are some li...

  • 1 kudos
1 More Replies
roman_belkin
by New Contributor II
  • 4680 Views
  • 3 replies
  • 1 kudos

Gemini though Mosaic Gateway

I am trying to configure the Gemini Vertex API in Databricks. In simple Python code, everything works fine, which indicates that I have correctly set up the API and credentials. Error message: {"error_code":"INVALID_PARAMETER_VALUE","message":"INVALI...

  • 4680 Views
  • 3 replies
  • 1 kudos
Latest Reply
sam-p
New Contributor II
  • 1 kudos

With support from a helpful Databricks employee, we found out that the problem was that the `private_key` / `private_key_plaintext` field needs to be the entire JSON object that GCP creates for the service account not just the private key string from...

  • 1 kudos
2 More Replies
Saty1
by New Contributor
  • 968 Views
  • 1 replies
  • 0 kudos

unable to Publish Notebook

Hi,I am unable to publish Notebook from my workspace in community editionIt just give me blank error message  

  • 968 Views
  • 1 replies
  • 0 kudos
Latest Reply
JissMathew
Valued Contributor
  • 0 kudos

Hi @Saty1 Publishing a notebook in Databricks Community Edition can sometimes encounter issues due to various reasons, such as browser compatibility, network issues, or limitations within the Community Edition itself. Here are some steps you can take...

  • 0 kudos
Paddy_chu
by New Contributor III
  • 1690 Views
  • 2 replies
  • 0 kudos

Unable to convert R dataframe to spark dataframe

Hi All, Does anyone knows how to convert R dataframe to spark dataframe to Pandas dataframe? I wanted to get a Pandas dataframe ultimately but I guess I need to convert to spark first. I've been using this sparklyr library but my code did not work. T...

  • 1690 Views
  • 2 replies
  • 0 kudos
Latest Reply
Alberto_Umana
Databricks Employee
  • 0 kudos

Hello @Paddy_chu, Here's an updated version of the R code: %r   library(sparklyr) library(SparkR)   sc <- spark_connect(method = "databricks") matched_rdf <- psm_tbl %>% select(c(code_treat, code_control)) %>% data.frame()   # Write the R dataframe t...

  • 0 kudos
1 More Replies
thushar
by Databricks Partner
  • 12568 Views
  • 4 replies
  • 2 kudos

MetadataChangedException Exception in databricks

Reading around 20 text files from ADLS, doing some transformations, and after that these files are written back to ADLS as a single delta file (all operations are in parallel through the thread pool). Here from 20 threads, it is writing to a single f...

  • 12568 Views
  • 4 replies
  • 2 kudos
Latest Reply
jkb7
New Contributor III
  • 2 kudos

How can we import the exception "MetadataChangedException"?Or does Databricks recommend to catch / except Exception and parse the string?

  • 2 kudos
3 More Replies
rubenteixeira
by Databricks Partner
  • 11748 Views
  • 4 replies
  • 1 kudos

Permission denied: Lightning Logs

I'm doing parameter tuning for a NeuralProphet model (you can see in the image the parameters and code for training)When I try to parallelize the training, it gives me Permission Error.Why can't I access the folder '/databricks/spark/work/*'? Do I ne...

altri1 MicrosoftTeams-image
  • 11748 Views
  • 4 replies
  • 1 kudos
Latest Reply
susanameiras
New Contributor II
  • 1 kudos

Hi Ruben!I am facing exactly the same error running a similar approach when using runtime 16.2 ML. I didn't have this issue when using runtime 12.2 LTS ML or 13.3 ML. Did you find a solution?Many thanks!

  • 1 kudos
3 More Replies
User15787040559
by Databricks Employee
  • 3454 Views
  • 2 replies
  • 0 kudos

Can we retrieve experiment results via MLflow API or is this only possible using UI?

Yes, you can use the API https://www.mlflow.org/docs/latest/python_api/index.html

  • 3454 Views
  • 2 replies
  • 0 kudos
Latest Reply
diogo_vieira
New Contributor II
  • 0 kudos

And how about tracing data? Do you know how to read likespark.read.format("mlflow-experiment").load() ?

  • 0 kudos
1 More Replies
AntonDBUser
by New Contributor III
  • 7253 Views
  • 6 replies
  • 1 kudos

Hosting R apps and models

Hello!Has anyone tried to host an R Shiny app using Databricks apps? It is very useful for Python apps, but it would be nice to know if anyone have any workaround to make it work with R Shiny Apps.We also wonder about Databricks model hosting for R m...

  • 7253 Views
  • 6 replies
  • 1 kudos
Latest Reply
AntonDBUser
New Contributor III
  • 1 kudos

Hi @parthSundarka!We tried, but had some problems making it work. Do you have a more complete code example? That would be very helpfull!BR, Anton

  • 1 kudos
5 More Replies
ledsouza
by New Contributor
  • 2581 Views
  • 5 replies
  • 0 kudos

Community Edition workspace not found

Suddenly got logout from my account in the Community Edition. When I tried to login again, I received this error message: "We were not able to find a Community Edition workspace with this email. Please login to accounts.cloud.databricks.com to find t...

  • 2581 Views
  • 5 replies
  • 0 kudos
Latest Reply
parzival
New Contributor III
  • 0 kudos

Hi @all,I solved the issue by signing up for a new Community Edition account using the same email.The only downside is I lost all my notebooks :(.

  • 0 kudos
4 More Replies
kishan_
by New Contributor II
  • 3976 Views
  • 4 replies
  • 2 kudos

Resolved! Facing issues with passing memory checkpointer in lanngraph agents

Hi,I am trying to create a simple langgraph agent in Databricks, the agent also uses lanngraph memory checkpoint which enables to store the state of the graph. This is working fine when I am trying it in Databricks notebook, but when I tried to log t...

Machine Learning
langgraph
mlflow
  • 3976 Views
  • 4 replies
  • 2 kudos
Latest Reply
sebascardonal
Databricks Partner
  • 2 kudos

Hi all. I have the same issue, could you deploy the graph with the MemorySaver?

  • 2 kudos
3 More Replies
kbmv
by Contributor
  • 8578 Views
  • 2 replies
  • 2 kudos

Resolved! Understanding compute requirements for Deploying Deepseek-R1-Distilled-Llama Models on databricks

Hi I have read the blog Deploying Deepseek-R1-Distilled-Llama Models on Databricks at https://www.databricks.com/blog/deepseek-r1-databricksI am new to using custom models that are not available as part of foundation models.According to the blog, I n...

kbmv_0-1738846938736.png
  • 8578 Views
  • 2 replies
  • 2 kudos
Latest Reply
kbmv
Contributor
  • 2 kudos

Thanks @Isi, For in-detail explanation. Things are clear now.

  • 2 kudos
1 More Replies
yhyhy3
by New Contributor III
  • 2535 Views
  • 2 replies
  • 0 kudos

Foundation Model APIs HIPAA compliance

I saw that Foundation Model API  is not HIPAA compliant. Is there a timeline in which we could expect it to be HIPAA compliant? I work for a healthcare company with a BAA with Databricks.

  • 2535 Views
  • 2 replies
  • 0 kudos
Latest Reply
User16776430979
Databricks Employee
  • 0 kudos

It is now HIPAA compliant: Provisioned throughput endpoints are available with compliance certifications like HIPAA, Model Serving is HIPAA compliant in all regions

  • 0 kudos
1 More Replies
SDN
by New Contributor II
  • 3335 Views
  • 2 replies
  • 1 kudos

Resolved! Feature store and medallion data location

Hello Folks,If we have 3 environments (dev/preprod/prod) and would like to have medallion data shared among them - I guess delta share is a good way to go. Now if we want to use "Feature Store (FS)" then I am a bit confused and seeking some clarity. ...

Machine Learning
azure
Feature Store
Medallion
  • 3335 Views
  • 2 replies
  • 1 kudos
Latest Reply
SDN
New Contributor II
  • 1 kudos

Thank you so much for the detailed answer!

  • 1 kudos
1 More Replies
Anonymous
by Not applicable
  • 225203 Views
  • 70 replies
  • 16 kudos

Community Edition Login Issues Below is a list of troubleshooting steps for failing to login with email/password at community.cloud.databricks.com:   ...

Community Edition Login Issues   Below  is a list of troubleshooting steps for failing to login with email/password at community.cloud.databricks.com:       Troubleshooting Tips If this is your first time logging in, ensure that you did indeed sign u...

Image Image Image
  • 225203 Views
  • 70 replies
  • 16 kudos
Latest Reply
saital
New Contributor II
  • 16 kudos

same problem I have, would you please help to solution ?

  • 16 kudos
69 More Replies
Labels