- 2774 Views
- 4 replies
- 3 kudos
Resolved! Did not receive a badge upon completing databricks fundamentals assessment
Team,I completed the training and assessment on databricks assesment and passed with 80% and received a certificate of completion but did not receive a badge as mentioned in the description of the course. Could you please help.​
- 2774 Views
- 4 replies
- 3 kudos
- 3 kudos
I find the badge usually comes the next day with a link to https://credentials.databricks.com/ where you can download a certificate and share a badge in social media.
- 3 kudos
- 1449 Views
- 1 replies
- 0 kudos
Connecting Sharepoint to AWS Databricks
Hi, I need to connect to Sharepoint and read data to a spark dataframe in databricks. The Databricks account is based on AWS.
- 1449 Views
- 1 replies
- 0 kudos
- 0 kudos
@anujlathi Please go through the below doc links. They have detailed instructions for establishing connectivity and it has worked for few customers. https://www.cdata.com/kb/tech/sharepoint-jdbc-azure-databricks.rst https://community.databricks.com/...
- 0 kudos
- 1988 Views
- 1 replies
- 0 kudos
Table shared via Delta sharingschema not shown in Unity-Catalog
Hello dear community,I use the following command to register the provider including shares to unity-catalog:databricks unity-catalog create-provider --name company --recipient-profile-json-file ~/Develop/profile.jsonOnce it is registered, I could see...
- 1988 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello Maaax, thanks for pointing this issue you are facing, let's recap this issue in sections: Error description:The error you are encountering, "Failed to request /ajax-api/2.1/unity-catalog/tables/company.patient_schema2.patient_table2?include_bro...
- 0 kudos
- 633 Views
- 2 replies
- 1 kudos
DLT issue while implemeting pipeline
i'm using pay - as you go subscription and using multi node with shared access cluster , still facing this issue
- 633 Views
- 2 replies
- 1 kudos
- 1 kudos
It looks like a cluster CPU core quota limit issue. Please reach out to the Azure support and they can look into your options to increase the quota and review your current usage.
- 1 kudos
- 979 Views
- 2 replies
- 0 kudos
Databricks Workflow duration issues
There is a discrepancy in the Databricks Workflow . Currently, the start and end times printed are when the workflow is triggered, not when the actual workflow execution begins. Ideally, it should log the task execution time. The issue is that the cu...
- 979 Views
- 2 replies
- 0 kudos
- 0 kudos
This is already reported on a feature request to make sure we set a difference in between the queue time and the execution time in the job UI page, this can be tracked with id DB-I-8963
- 0 kudos
- 1823 Views
- 1 replies
- 0 kudos
Cannot install libraries to cluster
Getting the following error when trying to install libraries to all purpose compute using the Library tab in Cluster details. We had vendor setup the cluster and they have since dropped off. I have switched the owner to an active AD user however stil...
- 1823 Views
- 1 replies
- 0 kudos
- 0 kudos
Have you managed to find a solution for this?
- 0 kudos
- 1583 Views
- 2 replies
- 1 kudos
[DATATYPE_MISMATCH.DATA_DIFF_TYPES] Cannot resolve "coalesce(VALUE, false)"
Hi All,i got the error below using a compute instance with any of the runtime but not with sql warehouse xsmall. How could we explain it ?Runtime Error in model sics_business_recon_unpivoted (models\Engineering\Business\sics_business_recon_unpivoted....
- 1583 Views
- 2 replies
- 1 kudos
- 1 kudos
can you try to run this on DBSQL and see if that errors out: coalesce(CAST(VALUE AS BOOLEAN), false)? What's the DBR version for your cluster?
- 1 kudos
- 3600 Views
- 9 replies
- 1 kudos
how to use rest api to find long running query in databricks
how to use rest api to find long running query in databricks from sql/queries/all
- 3600 Views
- 9 replies
- 1 kudos
- 1 kudos
@Ajay-Pandey Thanks. This API works fine. But it is showing only the current day queries. How can we get the all queries which is currently running.
- 1 kudos
- 2862 Views
- 2 replies
- 2 kudos
Resolved! Can not set Service Principal User role to a service principal
Hi!I'm trying to assign `Service Principal Users` role to a newly create Service Principal using terraform.For that I use following block of code:```resource "databricks_service_principal_role" "sp_job_runner_user_role" { service_principal_id = data...
- 2862 Views
- 2 replies
- 2 kudos
- 877 Views
- 3 replies
- 0 kudos
Coursera Applied Data Science for Data Analysts - Classroom Setup Failed
I tried to run the lab in the Coursera Applied Data Science for Data Analysts Classroom Setup and failed with the following error: Is there any fix for this?
- 877 Views
- 3 replies
- 0 kudos
- 2202 Views
- 1 replies
- 0 kudos
Merge Databricks customer and partner account
I have created my customer academy account with databricks accidentally, but I had to create it with partner one as my company has partnership with it. I need to take certification exam urgently, please help me in merging these two accounts as I am a...
- 2202 Views
- 1 replies
- 0 kudos
- 0 kudos
Is your issue resolved as I am also need to merge my accounts
- 0 kudos
- 2297 Views
- 2 replies
- 0 kudos
Cost Optimization for serverless Delta Live Table Implementation
I am currently using serverless Delta Live Tables for our silver layer, specifically leveraging the apply changes API method for SCD Type 2. However, we have observed that the costs are higher than initially anticipated, and I would like to seek your...
- 2297 Views
- 2 replies
- 0 kudos
- 0 kudos
To optimize DBU consumption and reduce costs while using serverless Delta Live Tables (DLT) for your silver layer, particularly with the apply changes API method for Slowly Changing Dimension (SCD) Type 2, consider the following options: - Instead o...
- 0 kudos
- 2692 Views
- 10 replies
- 0 kudos
why latestOffset and getBatch takes so long time
Hi team,Kinesis -> delta table raw -> job with trigger=availableNow -> delta table target. The Kinesis->delta table raw is running continuously. The job is daily with trigger=availableNow. The job reads from raw, do some transformation, and run a MER...
- 2692 Views
- 10 replies
- 0 kudos
- 0 kudos
@VZLA , thanks for the input and suggestion. Will create a support ticket.
- 0 kudos
- 778 Views
- 2 replies
- 0 kudos
Can I have sequence guarantee when replicate with CDF
Hi team,I have a delta table src, and somehow I want to replicate it to another table tgt with CDF, sort of (spark .readStream .format("delta") .option("readChangeFeed", "true") .table('src') .writeStream .format("delta") ...
- 778 Views
- 2 replies
- 0 kudos
- 0 kudos
Thanks. If the replicated table can have the _commit_version in strict sequence, I can take it as a global ever-incremental col and consume the delta of it (e.g. in batch way) with select * from replicated_tgt where _commit_version > ( selecct la...
- 0 kudos
- 7117 Views
- 10 replies
- 2 kudos
Delta Live Tables: Too much time to do the "setting up"
Hello community!Recently I have been working in delta live table for a big project. My team and me have been studying so much and finally we have built a good pipeline with CDC that load 608 entities (and, therefore, 608 delta live tables and 608 mat...
- 7117 Views
- 10 replies
- 2 kudos
- 2 kudos
Increase the worker and driver to higher configuraion on the pipeline. It will take initially for setting up but once the setup is completed, the ingestion would be faster. Here you can save the one hour took for ingestion..
- 2 kudos
| User | Count |
|---|---|
| 1619 | |
| 790 | |
| 493 | |
| 349 | |
| 287 |
