- 3293 Views
- 2 replies
- 4 kudos
How to get Cost Per Job on a Single Cluster?
How will you get the granular information for cost per job for a single cluster in Azure Databricks? I know we can give Tags for Jobs as well Only Cluster we have. But I can only see Cluster Tag but not the Job TAGs in Cost Analysis on Azure Portal. ...
- 3293 Views
- 2 replies
- 4 kudos
- 4 kudos
Hi @Sainath Nagare​ Job tags will be propagated on the job clusters. If you are using an interactive cluster for your job then you won't be able to see the Job tag.
- 4 kudos
- 6143 Views
- 4 replies
- 0 kudos
Databricks S3A error - java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.s3a.commit.S3ACommitterFactory not found
We are getting the below error for runtime 10.x and 11.x when writing to s3 via saveAsNewAPIHadoopFile function. The same jobs are running fine on runtime 9.x and 7.x. The difference betwen 9.x and 10.x is the former has hadoop 2.7 bindings with sp...
- 6143 Views
- 4 replies
- 0 kudos
- 0 kudos
We have resolved this issue by using s3 scheme instead of s3a i.e. pairRDD.saveAsNewAPIHadoopFile("s3://bucket/testout.dat",
- 0 kudos
- 5091 Views
- 5 replies
- 2 kudos
azure databricks notebook cannot load the difference
I am trying to commit and push my change to the branch, I cannot load the difference. I haven't changed many cells and each cells doesn't exceed the 500 lines in the notebook file. I am wondering why this happens and how to solve it?
- 5091 Views
- 5 replies
- 2 kudos
- 2 kudos
Hey there @z yang​ Hope all is well! Just wanted to check in if you were able to resolve your issue, and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Th...
- 2 kudos
- 1642 Views
- 3 replies
- 0 kudos
- 1642 Views
- 3 replies
- 0 kudos
- 0 kudos
Hey there @Jim Carlson​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you...
- 0 kudos
- 1622 Views
- 2 replies
- 0 kudos
How to do python within sql query in Databricks ?
How to do python within sql query in Databricks ?
- 1622 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Ya Gao​ Hope you are well. Just wanted to see if you were able to find an answer to your question and would you like to mark an answer as best? It would be really helpful for the other members too.Cheers!
- 0 kudos
- 3917 Views
- 2 replies
- 3 kudos
Issues pushing repos on Gitlab with Databricks
Our company uses Gitlab enterprise edition and we link our repos up to databricks through this. Randomly we will get errors when trying to push the repo and we have to spend hours debugging trying to figure out what is causing the push error on datab...
- 3917 Views
- 2 replies
- 3 kudos
- 3 kudos
Hey there @Mark Patrick​ Hope you are well. Just wanted to see if you were able to find an answer to your question and would you like to mark an answer as best? It would be really helpful for the other members too.Cheers!
- 3 kudos
- 2134 Views
- 3 replies
- 0 kudos
Why sometimes autoloader lose the checkpoint path and break the streaming?
Why sometimes autoloader lose the checkpoint path and break the streaming?
- 2134 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @Vittorio Antonacci​ Hope all is well! Just wanted to check in if you were able to resolve your issue, and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from y...
- 0 kudos
- 1298 Views
- 0 replies
- 3 kudos
Why is this simple numerical operation not precise?
I was experimenting with beginner tutorial and saw this strange output ...Why is this so ? And why is the behavior not consistent for ALL rows updated by the same statement?8.8 - 1 = 7.800000000000001See screenshot ...
- 1298 Views
- 0 replies
- 3 kudos
- 7851 Views
- 6 replies
- 4 kudos
Issue with .dbc in the Advanced Data Engineering course in Databricks Academy
The very first notebook of the dbc notebook which is a setup cell fails.
- 7851 Views
- 6 replies
- 4 kudos
- 4 kudos
Hi Riyaz,Please find the snippet of the error below--:"AnalysisException: Path does not exist: dbfs:/user/nniha9188@gmail.com/dbacademy/machine_learning/datasets/airbnb/sf-listings/sf-listings-2019-03-06-clean.parquet"Source-The source for this datas...
- 4 kudos
- 5918 Views
- 2 replies
- 10 kudos
- 5918 Views
- 2 replies
- 10 kudos
- 10 kudos
Hey there @Shakti Chand​ Hope all is well! Just wanted to check in if you were able to resolve your issue, and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from y...
- 10 kudos
- 2268 Views
- 3 replies
- 0 kudos
Move a GCP Project with Databricks in it to new Organization
We are trying to move a GCP project to a Newly created Org and new billing account. We have a Databricks instance from GCP Marketplace with licensing As per the docs when we change a billing account for a Project the license on the first billing acco...
- 2268 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @Ankit K​ Hope you are well. Just wanted to see if you were able to find an answer to your question and would you like to mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Cheers!
- 0 kudos
- 3079 Views
- 2 replies
- 2 kudos
Can you manage Workspaces using Terraform on an AWS Standard Tier account.
Background: I am looking to migrate a small PoC Databricks workspace in Azure over to a productionised deployment in AWS.I need to deploy all the Workspaces and all the notebooks etc code in those workspaces using a CI/CD pipeline, using Terraform to...
- 3079 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi @ALAN COOPER​ I hope all is well! I just wanted to check in if you were able to resolve your issue would you be happy to mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks!
- 2 kudos
- 1446 Views
- 0 replies
- 2 kudos
Azure Databricks Tenant/Directory Swicth
HelloWe are looking to move a PAYG subscription to a new tenant. We've got Azure Databricks deployed. There are a few questions:Will Databricks continue to function properly (aside from the RBAC list which we will re-apply to all resources)Since Data...
- 1446 Views
- 0 replies
- 2 kudos
- 8682 Views
- 12 replies
- 6 kudos
Resolved! Attended 27th July 2022 webinar but have not recieved voucher,even uploaded Lakehouse certificate
@Kaniz Fatma​ @Samantha Menot​ This is Arindam Bose.Actually I attended Databricks webinar on 27th July for (Databricks Certification Exam Overview Training: Databricks Certified Data Analyst Associate).I was expecting vouchers for Databricks Certifi...
- 8682 Views
- 12 replies
- 6 kudos
- 6 kudos
Hello Team, I am also facing the same issue. I met all the needs to qualify for a certificate voucher but have not received yet - Attended 3 days webinar Data Analysis With Databricks SQL Training & Certification Overview as part of Databricks Eleva...
- 6 kudos
- 2627 Views
- 1 replies
- 6 kudos
Versions of Spark, Python, Scala, R in each Databricks Runtime
What version of Spark, Python, Scala, R are included in each Databricks Runtime? What libraries are pre-installed?You can find this info at the Databricks runtime releases page (AWS | Azure | GCP).Let us know if you have any additional questions on t...
- 2627 Views
- 1 replies
- 6 kudos
- 6 kudos
Wow! Thanks for the help @Isaac Gritz​ !
- 6 kudos
| User | Count |
|---|---|
| 1644 | |
| 793 | |
| 553 | |
| 349 | |
| 287 |
