- 1888 Views
- 1 replies
- 0 kudos
AI
Today there is trending AI more than other technology and we know that it can go vast so that human get benefits fom this like in EV | Smart homes | Highly Optimized PC and in Robotics which is growing rapidly because of bbom in AI.
- 1888 Views
- 1 replies
- 0 kudos
- 0 kudos
Yes, I agreed with you.
- 0 kudos
- 2527 Views
- 2 replies
- 0 kudos
Resolved! Inquiry About Free Voucher or 75% off Voucher Availability
I am interestd in the Databricks Machine Learning Associate Certification Examination. Any ongoing event vouchers, discounts, or free voucher opportunities available for the Databricks Machine Learning Associate Examination?I would greatly appreciate...
- 2527 Views
- 2 replies
- 0 kudos
- 4044 Views
- 5 replies
- 4 kudos
Resolved! How can I save a keras model from a python notebook in databricks to an s3 bucket?
I have a trained model on Databricks python notebook. How can I save this to an s3 bucket.
- 4044 Views
- 5 replies
- 4 kudos
- 4 kudos
Hi @manupmanoos,Please check the below code on how to load the saved model back from the s3 bucketimport boto3 import os from keras.models import load_model # Set credentials and create S3 client aws_access_key_id = dbutils.secrets.get(scope="<scope...
- 4 kudos
- 1468 Views
- 1 replies
- 1 kudos
Expose low latency APIs from Deltalake for mobile apps and microservices
My company is using Deltalake to extract customer insights and run batch scoring with ML models. I need to expose this data to some microservices thru gRPC and REST APIs. How to do this? I'm thinking to build Spark pipelines to extract teh data, stor...
- 1468 Views
- 1 replies
- 1 kudos
- 1 kudos
Hey everyone It's awesome that your company is utilizing Deltalake for extracting customer insights and running batch scoring with ML models. I can totally relate to the excitement and challenges of dealing with data integration for microservices and...
- 1 kudos
- 678 Views
- 1 replies
- 0 kudos
ML for personal use
Will I be able yo use the new LakeHouse products like IQ for personal use like portfolio’s and websites?
- 678 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @aishashok,Thank you for posting your question in the Databricks community.Yes, Databricks' new Lakehouse products like Databricks SQL Analytics, SQL Runtime, and Delta Lake can be used for a variety of data engineering and analytics use cases, in...
- 0 kudos
- 1880 Views
- 2 replies
- 3 kudos
Databricks assistant not enabling
Hi,I have gone thru the databricks assistant article by Databricks https://docs.databricks.com/notebooks/notebook-assistant-faq.htmlIt clearly states that :Q: How do I enable Databricks Assistant?An account administrator must enable Databricks Assis...
- 1880 Views
- 2 replies
- 3 kudos
- 3 kudos
Hi @Rajaniesh,Databricks assistant is available now live. Please check the below blog for more details.More_details
- 3 kudos
- 2896 Views
- 3 replies
- 3 kudos
Load a pyfunc model logged with Feature Store
Hi, I'm using Databricks Feature Store to register a custom model using a model wrapper as follows: # Log custom model to MLflow fs.log_model( artifact_path="model", model = production_model, flavor = mlflow.pyfunc, training_set = training_s...
- 2896 Views
- 3 replies
- 3 kudos
- 3 kudos
Hi @SOlivero Make sure that the model was in fact saved with the provided URI.The latest keyword will retrieve the latest version of the registered model when mlflow.pyfunc.load_model('models:/model_name/latest') is executed, not the highest version....
- 3 kudos
- 1459 Views
- 2 replies
- 3 kudos
Resolved! Hyperopt Ray integration
Hello,Is there a way to integrate Hyperopt with Ray parallelisation? I have a simulation framework which I want to optimise, and each simulation run is set up to be a Ray process, however I am calling one simulation run in the objective function. Thi...
- 1459 Views
- 2 replies
- 3 kudos
- 3 kudos
Hi @EmirHodzic Thank you for posting your question in the Databricks community. You can use Ray Tune, a tuning library that integrates with Ray, to parallelize your Hyperopt trials across multiple nodes.Here's a link to the documentation for HyperOpt...
- 3 kudos
- 3159 Views
- 3 replies
- 0 kudos
Provisioned concurrency of serving endpoints scales to zero
Hi, We provisioned the endpoint with 4 DBUs and also disabled the scale_to_zero option. For some reason, it randomly drops to 0 provisioned concurrency. Logs available in the serving endpoint service are not insightful. Currently, we are provisioning...
- 3159 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi,I apologize if my question wasn't clear; let me clarify it.We are not using the scale_to_zero option and we are not doing any warmup requests so it should never scale to zero despite traffic or zero traffic right?
- 0 kudos
- 1880 Views
- 4 replies
- 1 kudos
Unable to access python variables in-between shells in same notebook
Unable to access Python variables in-between shells in the same notebook even if the entire code is written in Python. Getting error that unable to identify variable in the new cell
- 1880 Views
- 4 replies
- 1 kudos
- 1 kudos
Hi, thanks for your message. Can you sent a screenshot of your notebook maybe?This makes it hard to debug what could be the cause of it?Also which runtime are you using, this could might be the issue. With my experience loading the pandas library sho...
- 1 kudos
- 3253 Views
- 4 replies
- 0 kudos
Not able to log xgboost model to mlflow
I have been trying to log mlflow model but seems to be not working. It logs only the last(which is also the worst run).#-------------------------------------------------------13.0 ML XGBOost------------------------------------------------------------...
- 3253 Views
- 4 replies
- 0 kudos
- 0 kudos
@Kumaran Ran this code, but any specific log that I should be looking for?
- 0 kudos
- 821 Views
- 1 replies
- 0 kudos
MlflowException: Unsupported Databricks profile key prefix: ''. Key prefixes cannot be empty.
I am trying to fetch data from mlflow model registry in Databricks and to use it in my local notebook. But I don't find any resource in internet to do so. I want to configure my mlflow in such a way i can fetch model registry values from databricks w...
- 821 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @AnnamalaiVR,Thank you for posting the question in Databricks Community.In your Python code, import the MLflow library and create a client object to access your Model Registry. %pythonimport mlflow# Set the Databricks tracking URIdatabricks_host =...
- 0 kudos
- 3412 Views
- 2 replies
- 2 kudos
Resolved! Differences between Feature Store and Unity Catalog
Our small team has just finished the data preparation phase of our project and started data analysis in Databricks. As we go deeper into this field, we're trying to understand the distinctions and appropriate uses for a Feature Store versus a Unity C...
- 3412 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi @Northp Good day!1.) A Feature Store is a centralized repository that enables data scientists to find and share features, ensuring that the same code used to compute the feature values is used for model training and inference. It is particularly...
- 2 kudos
- 3051 Views
- 5 replies
- 9 kudos
Azure - Databricks - account storage gen 2
Hello Every one, i am really new to databricks, just passed my apache developer certification on it.i also have a certification on data engineering with Azure.some fancy words here but i only started doing real deep work on them as i started a person...
- 3051 Views
- 5 replies
- 9 kudos
- 9 kudos
Hi,If we go by the error , Invalid configuration value detected for fs.azure.account.keyStorage account access key to access data using the abfssprotocol cannot be used. Please refer this https://learn.microsoft.com/en-us/azure/databricks/storage/azu...
- 9 kudos
- 3490 Views
- 6 replies
- 1 kudos
CUDA out of memory
I am trying out the new Meta LLama2 model.Following the databricks provided notebook example: https://github.com/databricks/databricks-ml-examples/blob/master/llm-models/llamav2/llamav2-13b/01_load_inference.py I keep getting CUDA out of memory. My G...
- 3490 Views
- 6 replies
- 1 kudos
- 1 kudos
Hi @Kumaran Hope you are well. Just wanted to see if you were able to find an answer to your question and would you like to mark an answer as best? It would be really helpful for the other members too. Cheers!
- 1 kudos
