- 13404 Views
- 5 replies
- 2 kudos
Run one workflow dynamically with different parameter and schedule time.
Can we run one workflow for different parameters and different schedule time. so that only one workflow can executed for different parameters we do not have to create that workflow again and again. or we can say Is there any possibility to drive work...
- 13404 Views
- 5 replies
- 2 kudos
- 2 kudos
Update / Solved: Using CLI on Linux/MacOS: Send in the sample json with job_id in it. databricks jobs run-now --json '{ "job_id":<job-ID>, "notebook_params": { <key>:<value>, <key>:<value> }}' Using CLI on Windows: Send in the sample json w...
- 2 kudos
- 4237 Views
- 6 replies
- 1 kudos
Run a Databricks notebook from another notebook with ipywidget
0I am trying to run a notebook from another notebook using the dbutils.notebook.run as follows:import ipywidgets as widgetsfrom ipywidgets import interactfrom ipywidgets import Boxbutton = widgets.Button(description='Run model')out = widgets.Output()...
- 4237 Views
- 6 replies
- 1 kudos
- 1 kudos
As I could see the pyspark stream is not supporting this setContext, ideally it should have alternative approach. please suggest what is approach where pyspark stream is internally calling to another notebook parallel
- 1 kudos
- 1946 Views
- 1 replies
- 0 kudos
Mlflow Error in Databricks notebooks
Getting this error in experiments tab of databricks notebook.There was an error loading the runs. The experiment resource may no longer exist or you no longer have permission to access it. here is the code I am usingmlflow.tensorflow.autolog() with m...
- 1946 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @AmanJain1008,Thank you for posting your question in the Databricks Community.Could you kindly check whether you are able to reproduce the issue with the below code examples: # Import Libraries import pandas as pd import numpy as np import mlflow ...
- 0 kudos
- 5484 Views
- 4 replies
- 2 kudos
Resolved! How to load data using Sparklyr
Databricks Community New to Databricks, and R User and trying to figure out how to load a hive table via Sparklyr. The path to the file is https://databricks.xxx.xx.gov/#table/xxx_mydata/mydata_etl (right clicking on the file). I trieddata_tbl <- tb...
- 5484 Views
- 4 replies
- 2 kudos
- 2 kudos
Hi @JefferyReichman,Not sure that I completely understood your last question about "where I can read up on this for getting started". However, you can start by running this code in the Databricks community edition notebook.For more details: Link
- 2 kudos
- 7078 Views
- 1 replies
- 1 kudos
Resolved! Importing TensorFlow is giving an error when running ML model
Error stack trace:TypeError: Descriptors cannot not be created directly. If this call came from a _pb2.py file, your generated code is out of date and must be regenerated with protoc >= 3.19.0. If you cannot immediately regenerate your protos, some o...
- 7078 Views
- 1 replies
- 1 kudos
- 1 kudos
Please find the below resolution:Install a protobuf version >3.20 on the cluster. pinned the protobuf==3.20.1 on the Cluster librariesReference: https://github.com/tensorflow/tensorflow/issues/60320
- 1 kudos
- 1576 Views
- 3 replies
- 0 kudos
Databricks Feature stores
After exploring the feature store and how it works I have some concerns1. With each data refresh, there are possibilities for a change in feature values. Does Databricks feature store allow to alter the feature table in case the feature values have c...
- 1576 Views
- 3 replies
- 0 kudos
- 0 kudos
Hello @Ariane,Could you check the same by downloading the ebook : The Comprehensive Guide to Feature Stores here ?
- 0 kudos
- 2312 Views
- 1 replies
- 0 kudos
AI
Today there is trending AI more than other technology and we know that it can go vast so that human get benefits fom this like in EV | Smart homes | Highly Optimized PC and in Robotics which is growing rapidly because of bbom in AI.
- 2312 Views
- 1 replies
- 0 kudos
- 0 kudos
Yes, I agreed with you.
- 0 kudos
- 6813 Views
- 3 replies
- 0 kudos
Data + AI summit
thanks for an awesome event!
- 6813 Views
- 3 replies
- 0 kudos
- 3406 Views
- 2 replies
- 0 kudos
Resolved! Inquiry About Free Voucher or 75% off Voucher Availability
I am interestd in the Databricks Machine Learning Associate Certification Examination. Any ongoing event vouchers, discounts, or free voucher opportunities available for the Databricks Machine Learning Associate Examination?I would greatly appreciate...
- 3406 Views
- 2 replies
- 0 kudos
- 5623 Views
- 5 replies
- 4 kudos
Resolved! How can I save a keras model from a python notebook in databricks to an s3 bucket?
I have a trained model on Databricks python notebook. How can I save this to an s3 bucket.
- 5623 Views
- 5 replies
- 4 kudos
- 4 kudos
Hi @manupmanoos,Please check the below code on how to load the saved model back from the s3 bucketimport boto3 import os from keras.models import load_model # Set credentials and create S3 client aws_access_key_id = dbutils.secrets.get(scope="<scope...
- 4 kudos
- 2302 Views
- 1 replies
- 1 kudos
Expose low latency APIs from Deltalake for mobile apps and microservices
My company is using Deltalake to extract customer insights and run batch scoring with ML models. I need to expose this data to some microservices thru gRPC and REST APIs. How to do this? I'm thinking to build Spark pipelines to extract teh data, stor...
- 2302 Views
- 1 replies
- 1 kudos
- 1 kudos
Hey everyone It's awesome that your company is utilizing Deltalake for extracting customer insights and running batch scoring with ML models. I can totally relate to the excitement and challenges of dealing with data integration for microservices and...
- 1 kudos
- 967 Views
- 1 replies
- 0 kudos
ML for personal use
Will I be able yo use the new LakeHouse products like IQ for personal use like portfolio’s and websites?
- 967 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @aishashok,Thank you for posting your question in the Databricks community.Yes, Databricks' new Lakehouse products like Databricks SQL Analytics, SQL Runtime, and Delta Lake can be used for a variety of data engineering and analytics use cases, in...
- 0 kudos
- 6711 Views
- 2 replies
- 3 kudos
Databricks assistant not enabling
Hi,I have gone thru the databricks assistant article by Databricks https://docs.databricks.com/notebooks/notebook-assistant-faq.htmlIt clearly states that :Q: How do I enable Databricks Assistant?An account administrator must enable Databricks Assis...
- 6711 Views
- 2 replies
- 3 kudos
- 3 kudos
Hi @Rajaniesh,Databricks assistant is available now live. Please check the below blog for more details.More_details
- 3 kudos
- 4412 Views
- 3 replies
- 3 kudos
Load a pyfunc model logged with Feature Store
Hi, I'm using Databricks Feature Store to register a custom model using a model wrapper as follows: # Log custom model to MLflow fs.log_model( artifact_path="model", model = production_model, flavor = mlflow.pyfunc, training_set = training_s...
- 4412 Views
- 3 replies
- 3 kudos
- 3 kudos
Hi @SOlivero Make sure that the model was in fact saved with the provided URI.The latest keyword will retrieve the latest version of the registered model when mlflow.pyfunc.load_model('models:/model_name/latest') is executed, not the highest version....
- 3 kudos
- 2009 Views
- 2 replies
- 3 kudos
Resolved! Hyperopt Ray integration
Hello,Is there a way to integrate Hyperopt with Ray parallelisation? I have a simulation framework which I want to optimise, and each simulation run is set up to be a Ray process, however I am calling one simulation run in the objective function. Thi...
- 2009 Views
- 2 replies
- 3 kudos
- 3 kudos
Hi @EmirHodzic Thank you for posting your question in the Databricks community. You can use Ray Tune, a tuning library that integrates with Ray, to parallelize your Hyperopt trials across multiple nodes.Here's a link to the documentation for HyperOpt...
- 3 kudos
