- 1772 Views
- 2 replies
- 0 kudos
Resolved! Databricks Certified Associate Developer for Apache Spark 3 Got Suspended. Require Immediate support
Hello @Cert-Team @Certificate Team,Request Id# 00544837I encountered a pathetic experience while attempting my Databricks Certified Associate Developer for Apache Spark 3 certification exam. I had answered more than 44 questions I applied for Data...
- 1772 Views
- 2 replies
- 0 kudos
- 1869 Views
- 3 replies
- 0 kudos
Unable to install databricks free trial on AWS
I was trying to install databricks on AWS using these instructions "https://docs.databricks.com/en/admin/workspace/quick-start.html#use-aws-quickstart-to-create-a-databricks-workspace". But when CloudFormation Template stack executed "createCredentia...
- 1869 Views
- 3 replies
- 0 kudos
- 0 kudos
I am facing the same error when installing the Databricks in AWS, Please find attached the error below and help [ERROR] 2024-10-08T12:11:56.458Z ad8dd24a-67ec-4941-8096-3f8d883994b2 Exception: Expecting value: line 1 column 1 (char 0)Traceback (most ...
- 0 kudos
- 3068 Views
- 2 replies
- 1 kudos
Private Python Package in Serverless Job
I am trying to create a Databricks Job using Serverless Compute. I am using wheel file to run the Python Job.The wheel file has setup.py file using which all dependencies are installed. One of the package dependency is a private package hosted on Git...
- 3068 Views
- 2 replies
- 1 kudos
- 20808 Views
- 9 replies
- 5 kudos
How to disable task in databricks job workflow
I don't see any option to disable the task. I have created one workflow which contains multiple tasks.sometime i need to disable some task for my experiment. but there is no straightforward way for this. I feel "disable" button is must have option ...
- 20808 Views
- 9 replies
- 5 kudos
- 5 kudos
I know this post was a while ago, but I've hit this issue, and come up with using if/else conditions between the tasks with a Job parameter of "IsActiveTask2" with a True or False, and then I can have the Task2 dependant on the success of this condit...
- 5 kudos
- 3367 Views
- 1 replies
- 0 kudos
how to configure EC2 instance connection in databricks
I would like to know how to configure to be aws instance connection, a VPC and an EC2 instance were configured and allowed IP ping ping server onpremise, how would it be possible to make connection in Databricks so that it can make a connection?
- 3367 Views
- 1 replies
- 0 kudos
- 1749 Views
- 1 replies
- 0 kudos
Automating the Migration of ML Models and Metadata to Unity Catalog
Hello everyone,I am currently working on a project where I need to migrate ML models from the Model Registry of one Databricks workspace to the Unity Catalog (schema/catalog) of another workspace. This migration needs to include not only the models t...
- 1749 Views
- 1 replies
- 0 kudos
- 0 kudos
Deploy as Code is recommended. https://learn.microsoft.com/en-us/azure/databricks/machine-learning/mlops/deployment-patterns#deploy-code If you need to copy the model as a Pickle file then use https://github.com/mlflow/mlflow-export-import CICD imple...
- 0 kudos
- 2089 Views
- 1 replies
- 0 kudos
Unable to clone delta live table
Hello Team,In order to avoid any cost of running workflow for historical data, i am trying DEEP clone in order to copy data of streaming table from PROD workspace to QA workspace but it is giving below error. Please suggest some efficient data copy m...
- 2089 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Anish_2 ,This is well known limitation of DLT. You can read about it at limitation section in documentation. Conclusion is following. If you want to have ability to use all feature of delta protocol, it's better not to use dlt framework. It's gre...
- 0 kudos
- 1417 Views
- 1 replies
- 0 kudos
Price of UCX assessment and migration
Hi,I am planning to migrate few tables and workflows from Hive metastore to Unity catalog( For example 8 tables and 2 small) workflows. What is the cost of using UCX (Unity Catalog Upgrade eXperience) for assessment and migration of artifacts from a ...
- 1417 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @satya1206 ,There is no place involved when it comes to using ucx. It's free tool, open source tool created by databricks labs. More info you can find on below: https://github.com/databrickslabs/ucx
- 0 kudos
- 3403 Views
- 1 replies
- 0 kudos
Issues Migrating Hive Metastore Tables to Unity Catalog
I am in the process of migrating tables from Hive Meta store to Unity Catalog using the Databricks Labs UCX tool. After completing the assessment phase, the dashboard indicates that while external tables are ready to migrate, the managed tables are m...
- 3403 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @vidyaKothavale , What is the cost associated for UCX assessment and migration
- 0 kudos
- 824 Views
- 0 replies
- 0 kudos
Scheduled Dashboard Email
Hi community! I'm wondering if there is an option to personalize the email body of an scheduled dashboard. I'm specially interested in any way that allows me to change the attached dashboard snapshot to an excel file or make it available a table with...
- 824 Views
- 0 replies
- 0 kudos
- 5485 Views
- 6 replies
- 5 kudos
PowerApps + Delta Lake
Is there any native way to Insert data from PowerApps directly into Delta Lake?I can of course create a workflow - and push the data via API, but is there any alternative ?
- 5485 Views
- 6 replies
- 5 kudos
- 5 kudos
I have started creating solution for that: Here is initial version with PAT https://github.com/lakime/powerappstodelta
- 5 kudos
- 1210 Views
- 0 replies
- 0 kudos
Best Tools for API Design? SwaggerHub Alternatives?
Curious if anyone has moved from SwaggerHub to other platforms for API design, especially within data projects. Tools like Apidog, Postman, or Insomnia have been mentioned to me – does anyone have thoughts on how they compare for efficiency and colla...
- 1210 Views
- 0 replies
- 0 kudos
- 3736 Views
- 7 replies
- 1 kudos
Coursera Apache SQL Course
Hi, I have enrolled into Databricks Apache Spark SQL for Data Analysts course on Coursera.I am in Module 3, I imported the file through given url in course material. In 3.2Basic Queries I ran the first block which contains following command "%run ....
- 3736 Views
- 7 replies
- 1 kudos
- 1 kudos
Hi, I enrolled in the same coursera "databricks" course, and met the same issue. I unmounted and re-run the classroom set up as following However, when I move forward to list the mounted dirctory, the same issue happened.
- 1 kudos
- 562 Views
- 0 replies
- 0 kudos
Enterprise chatbot ml model, from datalake parquet data.
I want to create a chatbot ml model, to answer questions about the data, my organization have in the datalake. It should answer comprehension questions about the data.example: what do you understand from the data received from yesterday and today.
- 562 Views
- 0 replies
- 0 kudos
- 4805 Views
- 2 replies
- 0 kudos
File size upload limit through CLI
Does anyone know the size limit for uploading files through the CLI? I'm not finding it in the documentation.
- 4805 Views
- 2 replies
- 0 kudos
