- 2541 Views
- 2 replies
- 3 kudos
Resolved! Can i change the Managed Mlflow to work with a postgresql server?
We are using the managed mlflow, but we want to access the metadata of the models and show it in another application. There is already a server that I can query?Can I re-create/configure the databricks workspace to make the managed mlflow use a post...
- 2541 Views
- 2 replies
- 3 kudos
- 3 kudos
Ideas which I have is:periodically export/import mlflow models and experiments https://github.com/mlflow/mlflow-export-import#why-use-mlflow-export-importget metadata through API https://docs.databricks.com/dev-tools/api/latest/mlflow.html#operation/...
- 3 kudos
- 1751 Views
- 1 replies
- 2 kudos
MLflow
How determine exact date & time that an MLflow run was executed? Thank you so much!@
- 1751 Views
- 1 replies
- 2 kudos
- 2 kudos
Hi, you can view the job run. please refer: https://docs.databricks.com/mlflow/projects.html#step-3-view-the-databricks-job-run
- 2 kudos
- 17793 Views
- 5 replies
- 6 kudos
Resolved! Security exception while using Feature Store. How can I get this whitelisted?
I was following the Databricks Academy "New Capabilities Overview: Feature Store" module. However when I try to run the code in the example notebook I get a security exception as explained below. When I try to run the example notebook "01-Populate a ...
- 17793 Views
- 5 replies
- 6 kudos
- 6 kudos
Hi @Daniel Barrundia​ - please select "No isolation shared" Access mode, it should resolve this problem.
- 6 kudos
- 1452 Views
- 0 replies
- 0 kudos
Azure Databricks notebook reachs EventHub that doesn't consume messages
Hi everyone,While sending data to EventHub a Databricks notebook remains stucked and continue to work until goes to timeout (without error and without get messages). I tried the solution on an Azure Account without any restriction and it worked fine....
- 1452 Views
- 0 replies
- 0 kudos
- 1531 Views
- 0 replies
- 4 kudos
Hello Databricks Community!  We are getting really excited about the upcoming event of the year Data & AI Summit 2023! The world’s largest data, a...
Hello Databricks Community! We are getting really excited about the upcoming event of the year Data & AI Summit 2023!The world’s largest data, analytics and AI conference returns live, to San Francisco and virtually. Four days (June 26–29, 2023) pack...
- 1531 Views
- 0 replies
- 4 kudos
- 1521 Views
- 0 replies
- 1 kudos
Not able to create jobs via jobs API in databricks
I am not able to create jobs via jobs API in databricks.Error=INVALID_PARAMETER_VALUE: Job settings must be specified.I simply copied the JSON file and saved it. Loaded the same JSON file and tried to create the job via API but the got the above erro...
- 1521 Views
- 0 replies
- 1 kudos
- 6230 Views
- 5 replies
- 2 kudos
When running structured streaming jobs in production, what are the general best practices to reduce cost?
Consider a basic structured streaming use case of aggregating the data, perform some basic data cleaning transformation, and merge into a historical aggregate dataset.
- 6230 Views
- 5 replies
- 2 kudos
- 2 kudos
I second the recommendations: auto load with trigger, batch processing instead of continuous streaming where use case permits. In addition, test with a small batch firstfavor fewer larger workers over more smaller workersadjust your job cluster over...
- 2 kudos
- 2570 Views
- 2 replies
- 3 kudos
Streaming Source for Feature Store (and outputMode)
To save computing resource and time, can I use streaming source in a batch mode (similar to Auto Loader) to update my feature store as my source table receives row update or is appended with new rows?
- 2570 Views
- 2 replies
- 3 kudos
- 17467 Views
- 2 replies
- 39 kudos
Delta lake Vs Data lake in Databricks Delta Lake is an open-source storage layer that sits on top of existing data lake storage, such as Azure Data La...
Delta lake Vs Data lake in DatabricksDelta Lake is an open-source storage layer that sits on top of existing data lake storage, such as Azure Data Lake Store or Amazon S3. It provides a more robust and scalable alternative to traditional data lake st...
- 17467 Views
- 2 replies
- 39 kudos
- 39 kudos
this data is very much informative and i understood much in it so thank you @Aviral Bhardwaj​ sir
- 39 kudos
- 7060 Views
- 2 replies
- 6 kudos
Azure-core or AzureML version packages incompatibility
I'm running the BigBook of DS from Databricks on an Azure Databricks environment and I'm having a problem with a package in the first notebook inside the Integrating Azure Databricks and Azure Machine Learning folder. To be exact, this is the problem...
- 7060 Views
- 2 replies
- 6 kudos
- 3247 Views
- 2 replies
- 2 kudos
Model Serving Status Failed
I'm trying to enable serving for my model but I keep getting Pending into Failed Status.Here are the model event logs.2022-11-15 15:43:13ENDPOINT_UPDATEDFailed to create model 3 times2022-11-15 15:43:03ENDPOINT_UPDATEDFailed to create cluster 3 times...
- 3247 Views
- 2 replies
- 2 kudos
- 14633 Views
- 10 replies
- 12 kudos
Resolved! Delete feature tables through the Python API
The documentation explains how to delete feature tables through the UI. Is it possible to do the same using the Python FeatureStoreClient? I cannot find anything in the docs: https://docs.databricks.com/_static/documents/feature-store-python-api-refe...
- 14633 Views
- 10 replies
- 12 kudos
- 12 kudos
from databricks import feature_store fs = feature_store.FeatureStoreClient() fs.drop_table(FEATURE_TABLE_NAME)As of Databricks Runtime 10.5 for ML. Docs
- 12 kudos
- 4333 Views
- 1 replies
- 2 kudos
py4j.security.Py4JSecurityException: Constructor public com.databricks.backend.daemon.dbutils.FSUtilsParallel(org.apache.spark.SparkContext) is not whitelisted. - DBR 10.4 LTS Shared mode
We're trying to update permission in Unity Catalog using spark sql statetment spark.sql("ALTER TABLE %s.%s OWNER TO `%s`;" % (raw_schema, table_name, 'Metastore_Admins'))But we're running into following error We're facing issues like these in DBR 10....
- 4333 Views
- 1 replies
- 2 kudos
- 2 kudos
I have seen this beforeso there is one file in the DBFS where we have to write the whitelisted file , so you have to find out where is your whitelisted file location after that you have to add that "com.databricks.....parallel" line in that file and ...
- 2 kudos
- 5498 Views
- 1 replies
- 4 kudos
Databricks MLOps Best Practices
Where to find the best practices on MLOps on DatabricksWe recommend checking out the Big Book of MLOps for detailed guidance on MLOps best practices on Databricks including reference architectures.For a deep dive on the Databricks Feature store, we r...
- 5498 Views
- 1 replies
- 4 kudos
- 4 kudos
you can check here https://docs.databricks.com/machine-learning/mlops/mlops-workflow.html
- 4 kudos
- 3034 Views
- 2 replies
- 6 kudos
Weekly Release Notes RecapHere’s a quick recap of the latest release notes updates from the past one week. Databricks platform release notes December ...
Weekly Release Notes RecapHere’s a quick recap of the latest release notes updates from the past one week.Databricks platform release notes December 5 - 16, 2022Databricks JDBC driver 2.6.32Version 2.6.32 of the Databricks JDBC driver (download and M...
- 3034 Views
- 2 replies
- 6 kudos
