- 2090 Views
- 2 replies
- 3 kudos
www.databricks.com
Hello Dolly: Democratizing the magic of ChatGPT with open modelsDatabricks has just released a groundbreaking new blog post exploring ChatGPT, an open-source language model with the potential to transform the way we interact with technology. From cha...
- 2090 Views
- 2 replies
- 3 kudos
- 3 kudos
Lets get candid! Let me know your initial thoughts about LLM Models, ChatGpt, Dolly.
- 3 kudos
- 4697 Views
- 2 replies
- 1 kudos
Using code_path in mlflow.pyfunc models on Databricks
We are using Databricks over AWS infra, registering models on mlflow. We write our in-project imports as from src.(module location) import (objects).Following examples online, I expected that when I use mlflow.pyfunc.log_model(...code_path=['PROJECT_...
- 4697 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Idan Reshef​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers y...
- 1 kudos
- 3838 Views
- 3 replies
- 0 kudos
Not able to configure cluster settings instance type using mlflow api 2.0 to enable model serving.
I'm able to enable model serving by using the mlflow api 2.0 with the following code...instance = f'https://{workspace}.cloud.databricks.com' headers = {'Authorization': f'Bearer {api_workflow_access_token}'} # Enable Model Serving import request...
- 3838 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @Shane Piesik​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feedback...
- 0 kudos
- 8144 Views
- 5 replies
- 3 kudos
Sample Datasets URL in Azure Databricks / access sample datasets when NPIP and Firewall is enabled
Hi,I have an Azure Databricks instance configured to use VNet injection with secure cluster connectivity. I have an Azure Firewall configured and controlling all traffic ingress and egress locations as per this article: https://learn.microsoft.com/en...
- 8144 Views
- 5 replies
- 3 kudos
- 3 kudos
Hi @Alex Bush​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we ...
- 3 kudos
- 18624 Views
- 7 replies
- 8 kudos
What are the practical advantage of Feature Store compared to Delta Lake?
Could someone explain the practical advantages of using a feature store vs. Delta Lake. apparently they both work in the same manner and the feature store does not provide additional value. However, based on the documentation on the databricks page, ...
- 18624 Views
- 7 replies
- 8 kudos
- 8 kudos
Hi @Saeid Hedayati​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answer...
- 8 kudos
- 2903 Views
- 3 replies
- 0 kudos
SAP engineer wants to convert
I am looking for direction and input: I am an SAP data architect, with around 20 years of expossure to the data model itself, plus I’ve installed the SAP Data Warehouse some 6, or 7 times. I am certified in SAP’s newest analytics Tool, SAP Analytics ...
- 2903 Views
- 3 replies
- 0 kudos
- 7258 Views
- 5 replies
- 5 kudos
How to change the feature store delta table default path on DBFS?
Hi everyone,Would it be possible to change the default storage path of deature store, during creation and/or after creation? If you could also provide the python script to that I would appreciate. The current default path is:"dbfs/user/hive/warehouse...
- 7258 Views
- 5 replies
- 5 kudos
- 5 kudos
Hi @Saeid Hedayati​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us s...
- 5 kudos
- 2045 Views
- 1 replies
- 0 kudos
Resolved! What's TorchDistributor ?
- 2045 Views
- 1 replies
- 0 kudos
- 0 kudos
TorchDistributor is an open-source module in PySpark that helps users do distributed training with PyTorch on their Spark clusters, so it lets you launch PyTorch training jobs as Spark jobs.With Databricks Runtime 13.0 ML and above, you can perform d...
- 0 kudos
- 8693 Views
- 6 replies
- 6 kudos
Resolved! MLFlow is throwing error for the shape of input
I am running the code for prediction which will take the model from mlflow deployment. Code I have copied from the example given by mlflow experiment tab.import mlflow logged_model = 'runs:/id/model' # Load model as a PyFuncModel. loaded_model = ml...
- 8693 Views
- 6 replies
- 6 kudos
- 6 kudos
Hi @Koushik Deb​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers y...
- 6 kudos
- 7573 Views
- 3 replies
- 0 kudos
How to call a python function from displayHTML javascript code?
python - How to use IPython.notebook.kernel.execute in Azure databricks? - Stack OverflowIn standard jupyter notebook, we could use IPython.notebook.kernel.execute to call a python function, in Azure databricks IPython seems to be not exposed in brow...
- 7573 Views
- 3 replies
- 0 kudos
- 0 kudos
@hariprasad T​ :In Azure Databricks, which is a cloud-based service for Apache Spark and big data processing, the notebook environment does not expose IPython directly in the browser DOM global scope as it is done in standard Jupyter notebooks. Howev...
- 0 kudos
- 5869 Views
- 4 replies
- 3 kudos
Your workspace is not currently supported for model serving because your workspace region does not match your control plane region.
Getting an error msg when creating API from Data brick for MRV(Media Rights Valuation)Your workspace is not currently supported for model serving because your workspace region does not match your control plane region. See https://docs.databricks.com/...
- 5869 Views
- 4 replies
- 3 kudos
- 3 kudos
Hi @jk vadivel​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers yo...
- 3 kudos
- 1729 Views
- 2 replies
- 0 kudos
Automating model history with multiple downstream elements
Hey, We got two models A and BModel A is fed from raw data that is firstly Clean / enriched and forecasted The results from model A are what are fed into model Bthe processes for cleaning, enriching, forecasting, model A and model B are all under ver...
- 1729 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @polly halton​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers ...
- 0 kudos
- 2134 Views
- 1 replies
- 0 kudos
Partial Dependency Plots from AutoML
I have built an AutoML model, and I would like for it to add Partial Dependency Plots for the final/best model. I am trying to add this to the code generated, but not having any luck. This is the code I attempted.from sklearn.inspection import Part...
- 2134 Views
- 1 replies
- 0 kudos
- 0 kudos
@brandon.vaughn brandon.vaughn​ :It looks like you are trying to use the PartialDependenceDisplay module from the sklearn.inspection module to create partial dependency plots for your AutoML model. Here are some suggestions to ensure that the code wo...
- 0 kudos
- 4548 Views
- 4 replies
- 0 kudos
Resolved! History of code executed on Data Science & Engineering service clusters
I want to be able to view a listing of any or all of the following:When Notebooks were attached / detached to and from a DS&E clusterWhen Notebook code was executed on a DS&E clusterWhat Notebook specific cell code was executed on a DS&E clusterIs th...
- 4548 Views
- 4 replies
- 0 kudos
- 0 kudos
From the UI https://docs.databricks.com/notebooks/notebooks-code.html#version-control best way to check is version control.BTW, do you see this helps https://www.databricks.com/blog/2022/11/02/monitoring-notebook-command-logs-static-analysis-tools.ht...
- 0 kudos
- 15443 Views
- 5 replies
- 4 kudos
Register mlflow custom model, which has pickle files
Dear community,I want to basically store 2 pickle files during the training and model registry with my keras model. So that when I access the model from another workspace (using mlflow.set_registery_uri()) , these models can be accessed as well. The ...
- 15443 Views
- 5 replies
- 4 kudos
