- 6661 Views
- 12 replies
- 6 kudos
Resolved! Attended 27th July 2022 webinar but have not recieved voucher,even uploaded Lakehouse certificate
@Kaniz Fatma​ @Samantha Menot​ This is Arindam Bose.Actually I attended Databricks webinar on 27th July for (Databricks Certification Exam Overview Training: Databricks Certified Data Analyst Associate).I was expecting vouchers for Databricks Certifi...
- 6661 Views
- 12 replies
- 6 kudos
- 6 kudos
Hello Team, I am also facing the same issue. I met all the needs to qualify for a certificate voucher but have not received yet - Attended 3 days webinar Data Analysis With Databricks SQL Training & Certification Overview as part of Databricks Eleva...
- 6 kudos
- 2044 Views
- 1 replies
- 6 kudos
Versions of Spark, Python, Scala, R in each Databricks Runtime
What version of Spark, Python, Scala, R are included in each Databricks Runtime? What libraries are pre-installed?You can find this info at the Databricks runtime releases page (AWS | Azure | GCP).Let us know if you have any additional questions on t...
- 2044 Views
- 1 replies
- 6 kudos
- 6 kudos
Wow! Thanks for the help @Isaac Gritz​ !
- 6 kudos
- 2711 Views
- 3 replies
- 0 kudos
Accessing Workspace?
Trying to follow along with the instructions for the 'AWS and Databricks' training yet the documentation gives no indication of how to access the workspace that is ostensibly generated in AWS. I subscribed through the marketplace and cloud formation...
- 2711 Views
- 3 replies
- 0 kudos
- 0 kudos
Unfortunately by the time I received a response my trial had long lapsed so I had already unsubscribed in aws.
- 0 kudos
- 1112 Views
- 1 replies
- 3 kudos
What’s the USP? DB SQL serverless? When is it coming to Azure?
What’s the USP? DB SQL serverless? When is it coming to Azure?
- 1112 Views
- 1 replies
- 3 kudos
- 3 kudos
Hi @Chandana Basani​ DB SQL Serverless in Azure is planned for GA on the Release quarter FY23 Q1 in the release month 2023-01Best,Akash
- 3 kudos
- 3557 Views
- 3 replies
- 0 kudos
Migrate workspaces to another AWS account
Hi everyone,I have a Databricks workspace in an AWS account that I have to migrate to a new AWS accountDo you know how I can do it ? Or it's better to recreate a new one and move all the workbooks and if I choose to create one new how can you export ...
- 3557 Views
- 3 replies
- 0 kudos
- 0 kudos
@AMADOU THIOUNE​ Can you check the below link to export the run jobs? https://docs.databricks.com/jobs.html#export-job-runs. Try to reuse the same job_id with the /update and /reset endpoints, it should allow you much better access to previous run re...
- 0 kudos
- 1790 Views
- 2 replies
- 0 kudos
RPC Disassociate error due to container threshold exceeding and garbage collector error when reading 23 gb multiline JSON file.
I am reading 23 gb multi line json file and flattening it using udf and writing datframe as parquet using psypark.Cluster I am using is 3 node (8 core) 64gb memory with limit to go upto 8 nodes.I am able to process 7gb file with no issue and takes ar...
- 1790 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Ravi Dobariya​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Than...
- 0 kudos
- 7663 Views
- 8 replies
- 1 kudos
Resolved! BAD_REQUEST:Failed to get oauth access token.Please try logout and login again
We deployed a test databricks workspace cluster on GCP. A single cluster got spinned up.Later we deleted the workspace.Now when we are trying to create a new one.It is giving this error"BAD_REQUEST:Failed to get oauth access token.Please try logout ...
- 7663 Views
- 8 replies
- 1 kudos
- 1 kudos
@Azeez Sayyad​ you can try this workaround.Remove the Databricks App from your Google account. In Google account settings, go to "Manage third-paarty access", and remove Databricks from both Third-Paarty app with account access and Sign-in with Googl...
- 1 kudos
- 1618 Views
- 0 replies
- 1 kudos
Github workflow integration error
Hi,We have a working Github integration in place for our production workspace which is running 14 different jobs that are scheduled during different intervals, but throughout the entire day.The issue over the past 3-4 weeks that we have encountered i...
- 1618 Views
- 0 replies
- 1 kudos
- 930 Views
- 0 replies
- 0 kudos
How to get notebookid programmatically using R
Hi, I would like to log the notebook id programmatically in R, Is there any command that exists in R so that I can leverage to grab the notebook id, I tried with python using the below command and grab it without any issues, and looking for similar f...
- 930 Views
- 0 replies
- 0 kudos
- 9164 Views
- 6 replies
- 1 kudos
Using Thread.sleep in Scala
We need to hit REST web service every 5 mins until success message is received. The Scala object is inside a Jar file and gets invoked by Databricks task within a workflow.Thread.sleep(5000) is working fine but not sure if it is safe practice or is t...
- 9164 Views
- 6 replies
- 1 kudos
- 1 kudos
Hey there @Sundeep P​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.C...
- 1 kudos
- 7894 Views
- 4 replies
- 3 kudos
Resolved! Connecting with Azure AD token in PowerBI
Hello,We are trying to connect Databricks SQL endpoint from PowerBi using Azure AD service principal, which has been added to Databricks workspace using SCIM APIs. Now, when we open connection to Databricks in powerbi desktop and provide Azure AD acc...
- 7894 Views
- 4 replies
- 3 kudos
- 3 kudos
At the moment I do not think that is possible.The help page mentions:An Azure Active Directory token (recommended), an Azure Databricks personal access token, or your Azure Active Directory account credentials.These methods are all user bound, so no ...
- 3 kudos
- 9860 Views
- 6 replies
- 1 kudos
How do I downgrade my subscription from Premium to Standard?
Hello,I have tried getting in touch with the support and sales but I still have no answer. I tried Databricks and I wish to continue but with a Standard subscription. However, It won't let me do it by myself since I need to reach out to the sales tea...
- 9860 Views
- 6 replies
- 1 kudos
- 1 kudos
Hello @Mohan Mathews​, Have you received any news from the support team?I canceled the previous subscription and acquired a new one on a standard plan. However, when signing into my Databricks account my plan still shows up as "Premium".Is there a wa...
- 1 kudos
- 1705 Views
- 2 replies
- 1 kudos
Query on DBFS migration
We are doing DBFS migration. In that we have a folder 'user' in Root DBFS having data 5.8 TB in legacy workspace. We performed AWS CLi Sync/cp between Legacy to Target and again performed the same between Target bucket to Target dbfs While implemen...
- 1705 Views
- 2 replies
- 1 kudos
- 1 kudos
Thanks for the quick response.Regarding the suggested AWS data sync approach, we have tried data sync in multiple ways, it is creating folders in s3 bucket itself not on DBFS. As our task is to copy from bucket to DBFS.It seems that it only supports ...
- 1 kudos
- 1247 Views
- 0 replies
- 0 kudos
Want to extract the start time and end time of tasks under particular job.
I have one job that reran multiple times which took 101 hours. Ideally the execution of that job is 8 hours. Using jobs 2.1 API I am able to extract the start and end time of job ID and run ID. This only helps me to get the duration of 101 hours , bu...
- 1247 Views
- 0 replies
- 0 kudos
- 1299 Views
- 0 replies
- 1 kudos
Not able to install the AIRBNB dataset when trying to run in the notebook-"Scalable ML". I am getting the error as below-:AnalysisException: Path does not exist:
file_path = f"{datasets_dir}/airbnb/sf-listings/sf-listings-2019-03-06-clean.parquet/"2airbnb_df = spark.read.format("parquet").load(file_path)3​4display(airbnb_df)AnalysisException: Path does not exist: dbfs:/user/nniha9188@gmail.com/dbacademy/machi...
- 1299 Views
- 0 replies
- 1 kudos
| User | Count |
|---|---|
| 1611 | |
| 768 | |
| 348 | |
| 286 | |
| 252 |
