- 4154 Views
- 4 replies
- 2 kudos
Accessing Unity Catalog's MLFlow model registry from outside Databricks
Hello EveryoneWe are integrating Unity Catalog in our Organisation's Databricks. In our case we are planning to move our inference from Databricks to Kubernetes. In order to make the inference code use the latest registered model we need to query the...
- 4154 Views
- 4 replies
- 2 kudos
- 2 kudos
You can use the MLflow client (in various language specific SDKs) to download model artifacts. For example, see here: https://docs.databricks.com/en/mlflow/models.html#download-model-artifactsWe leverage this pattern to serve models in our K8s stack ...
- 2 kudos
- 10407 Views
- 6 replies
- 3 kudos
Salesforce connection with Databricks
How can we connect with salesforce from databricks without using any third party jar files?
- 10407 Views
- 6 replies
- 3 kudos
- 3 kudos
You can connect to Salesforce from Databricks without using third-party JAR files by leveraging Python and the Salesforce REST API using the simple-salesforce library. Since simple-salesforce is a Python package, you can install it within your Databr...
- 3 kudos
- 2737 Views
- 3 replies
- 0 kudos
Resolved! Statsmodel OLS.fit generates "Error displaying widget: undefined"
Hi,I am running some code which fits a linear model via Statsmodel. Everytime I run the .fit function it generates the error: "Error displaying widget: undefined".I can reproduce the error via the simple code below.I am not sure what is causing this ...
- 2737 Views
- 3 replies
- 0 kudos
- 4770 Views
- 1 replies
- 0 kudos
Model serving endpoint creation failed
I have a logged pyfunc mlflow model that runs without issues in a databricks notebook using "mlflow.pyfunc.load_model()". I can deploy it without issues as a model serving endpoint with "workload_type" set to GPU, but when i try to update the endpoin...
- 4770 Views
- 1 replies
- 0 kudos
- 0 kudos
The error encountered when updating the endpoint to a CPU-only configuration could be due to several reasons related to dependency and environment configuration mismatches: • Dependency Mismatch: The error may be related to mismatched dependencies...
- 0 kudos
- 6470 Views
- 4 replies
- 1 kudos
Error 401: "Missing authorization details for accessing model serving endpoints" with OAuth Token on
I am trying to generate an OAuth token for my Azure Databricks workspace to access a model serving API in production. The code I’m using generates a token successfully, but I keep receiving a 401 error with the message "Missing authorization details ...
- 6470 Views
- 4 replies
- 1 kudos
- 1 kudos
I managed to retrieve the access token but when i call the served endpoint i get the same error as the user above. my code is below. As for the SP in databricks workspace, it was given the manage permission on the served endpoint. Any suggestions?
- 1 kudos
- 9037 Views
- 2 replies
- 0 kudos
Error: "[REQUIRES_SINGLE_PART_NAMESPACE] sparkcatalog requires a single-part namespace"
Hi, In my code I am creating a Spark session, that can be to used query the Unity Catalog delta tables.I have an MLFlow Pyfunc model that uses these table to retrieve information. Things work well from my cluster but getting below error from model se...
- 9037 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Alberto_Umana ,But I am not getting exception as "Exception: No SparkSession Available!" ,probably because I am installing that as part of conda environment creation. Spark session is available. Exception is "[REQUIRES_SINGLE_PART_NAMESPACE] spar...
- 0 kudos
- 9970 Views
- 4 replies
- 3 kudos
Resolved! Using variables with Databricks Asset Bundles not working
Hi EveryoneI am using the default Databricks Asset Bundle. All is good except i can get stage dependt variables to work.i have a bundle config file that looks like the below, where i have defined variables for each stage.bundle: name: xxxxx includ...
- 9970 Views
- 4 replies
- 3 kudos
- 3 kudos
yes this worked, you need to add the variables at both places i.e. the top level and set default values, and then add them again to the target as a mapping ( non default values).bundle: # Required. name: string # Required. databricks_cli_version:...
- 3 kudos
- 1839 Views
- 2 replies
- 0 kudos
Resolved! Online tables schema only contains string (varchar) columns
I created an online table for feature serving based on an existing delta table (used as the source table).This source table contains a struct column and an array column, but when the online table is created, those two columns show up as strings colum...
- 1839 Views
- 2 replies
- 0 kudos
- 0 kudos
Hello @obitech01, The behavior you are observing with the struct and array columns being converted to string (or varchar) columns in the online table is indeed the default behavior. An online table is a read-only copy of a Delta Table that is stored ...
- 0 kudos
- 18655 Views
- 3 replies
- 0 kudos
Permission Issue
I want learn about Machine Learning operations but I can't access this page.https://www.databricks.com/training/catalog/advanced-machine-learning-operations-3508 Access deniedYou do not have permission to access this page, please contact your admini...
- 18655 Views
- 3 replies
- 0 kudos
- 0 kudos
Hello, @ash1127!Please file a ticket with the Databricks support team to get assistance with this issue.Thank you.
- 0 kudos
- 908 Views
- 2 replies
- 0 kudos
Model from code approach
Hi Databricks Team,I am trying to understand the "model from code" approach. I am reading your Big Book of MLOps.Is it correct that when using this approach I need to train the model twice - in development and in production?I am asking because in thi...
- 908 Views
- 2 replies
- 0 kudos
- 0 kudos
Thank you for your answer. You said:initially in the development environment as part of model developmentWhat does this mean?Usually, I take a model, run a lot of training experiments with different hyperparameters. And when I find the best parameter...
- 0 kudos
- 693 Views
- 0 replies
- 0 kudos
Data practitioner in AI Era
As the AI revolution takes off in 2025, there is a renewed emphasis on adopting a Data-First approach. Organizations are increasingly recognizing the need to establish a robust data foundation while preparing a skilled fleet of Data Engineers to tack...
- 693 Views
- 0 replies
- 0 kudos
- 5101 Views
- 2 replies
- 0 kudos
How do we log without a dbfs for MLFlow models.
Hi Databricks Team,We are planning a UC Migration for a customer who currently has around 500 experiments, each with multiple runs. These experiments are registered and MLflow is logging to DBFS locations. However, we have not found any documentation...
- 5101 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @rahuja / @Djay101, Do you have any account team contact for your Databricks subscription? I think this kind of migration requires more analysis based on your use-case. I could not find a straight-forward way to perform this migration, perhaps the...
- 0 kudos
- 31973 Views
- 3 replies
- 0 kudos
Resolved! Upload a file
Hi - I'm trying to upload a file, so that I can use the same in my notebook to try ML experiments with Databricks. From my workspace, I created a folder. But the option 'Create -> File' does not do anything. So not able to add any file. From a notebo...
- 31973 Views
- 3 replies
- 0 kudos
- 0 kudos
Can you try the approach mentioned in https://ganeshchandrasekaran.com/databricks-how-to-load-data-from-google-drive-github-c98d6b34d1b5
- 0 kudos
- 2199 Views
- 2 replies
- 0 kudos
Retrieve data from multiple .mdb files using Python.
Hello,I'm interested in accessing several .mdb Access files stored in either Azure Data Lake Storage (ADLS) or the Databricks File System using Python. Could you provide guidance on how to accomplish this? It would be immensely helpful if you could a...
- 2199 Views
- 2 replies
- 0 kudos
- 0 kudos
These are a couple of blogs and docs too https://docs.databricks.com/en/connect/storage/azure-storage.html
- 0 kudos
- 4737 Views
- 1 replies
- 0 kudos
UDF LLM DataBrick pickle error
Hi there,I am trying to parellize a text extraction via the Databrick foundational model.Any pointers to suggestions or examples are welcomeThe code and error below.model = "databricks-meta-llama-3-1-70b-instruct" temperature=0.0 max_tokens=1024 sch...
- 4737 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @llmnerd , Hope you are doing well! Upon reviewing the details provided, we have identified several observations regarding the SparkContext serialization error encountered. Please find a detailed analysis and our recommendations below:==== ANALYS...
- 0 kudos
