- 482 Views
- 1 replies
- 0 kudos
Exam got suspended
Hi Team,In this morning i was taking the exam suddenly proctor asked me to show the room and walls i showed him then he suspended my exam no one was there. I dont understand why he suspended the exam. Kindly reschedule the exam i need the certificati...
- 482 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi Team,Could you please atleast reschedule the exam. i will take it from the prometric centerthanks
- 0 kudos
- 1551 Views
- 2 replies
- 1 kudos
R Package Installation Best Practices
Hello,We are new to databricks and are wondering what the best practices are for R package installation. We currently have cluster spin up wait times of more than 20 minutes with our init scripts. We have tried the following:1. Libraries tab in the c...
- 1551 Views
- 2 replies
- 1 kudos
- 1 kudos
@Retired_mod Thank you for your detailed response! I think we would like to use Docker if we can because we are not using RStudio but R directly in the databricks notebooks and workflows. So, anymore information about R and Docker and Databricks woul...
- 1 kudos
- 4258 Views
- 6 replies
- 2 kudos
data quality check in data engineering
Can we use deequ library with azure databricks ? if yes Please provide some support material or examplesIs there any similar data quality library or suggestion to achieve automatic data quality check during data engineering (Azure databricks)Thanks i...
- 4258 Views
- 6 replies
- 2 kudos
- 2 kudos
Hi there! You could also take a look at Rudol, it enables no-code Data Quality validations to enable non-technical roles such as Business Analysts or Data Stewards to configure quality checks by themselves.
- 2 kudos
- 1665 Views
- 5 replies
- 3 kudos
Resolved! Unable to upload files from DBFS
When clicked on upload i am seeing below errorStorageContext com.databricks.backend.storage.StorageContextType$DbfsRoot$@2f3c3220 for workspace 1406865167171326 is not set in theCustomerStorageInfo.
- 1665 Views
- 5 replies
- 3 kudos
- 3 kudos
same issue at my end since yesterday.. does anyone know the reason and what needs to be done from our side (if any) to fix this.
- 3 kudos
- 718 Views
- 2 replies
- 2 kudos
Resolved! I am facing issue with DBFS File server
Hi,I am facing the issue DBFS File server, anyone guide me how to resolve the issue. what steps should I take to resolve storage issue ?
- 718 Views
- 2 replies
- 2 kudos
- 878 Views
- 3 replies
- 3 kudos
Unablet to Install Python Wheel Library
Hello Team,Can someone let me know if there has been some changes to Databricks Community Edition such that it's no longer possible to install Python Wheel libraries? I was able to install Python Wheel libraries as recently as a few days ago, but now...
- 878 Views
- 3 replies
- 3 kudos
- 3 kudos
Hi there, Check your runtime version to check you are using a version that supports that and I think nowadays the recommended pattern (don’t quote me) is to store your wheel files on the workspace tree
- 3 kudos
- 1245 Views
- 3 replies
- 4 kudos
Resolved! How does AutoLoader works when triggered via Azure Data Factory?
Hi,I am currently creating an AutoLoader in databricks and will be using ADF as an orchestrator.I am quite confused how this will handle my data so please clarify if I misunderstood it.First, I will run my ADF pipeline which includes an activity to c...
- 1245 Views
- 3 replies
- 4 kudos
- 4 kudos
Auto loader will process files incrementally. Let's say you have a files in existing directory called /input_filesFirst time you run autoloader, it will read all files in that directory (unless you set an option includeExsistingFiles to false, like y...
- 4 kudos
- 1284 Views
- 3 replies
- 2 kudos
How can I deduplicate data from my stream?
Hi,I'm new to databricks and I'm trying to use stream for my incremental data. This data has duplicates which can be solved using a window function. Can you check where my code goes wrong?1-------#Using Auto Loader to read new files schema = df1.sche...
- 1284 Views
- 3 replies
- 2 kudos
- 2 kudos
Hi @zll_0091 ,Change the output mode to update. Other than that, your code looks fine, but I would rename variable microdf to windowSpec, because now it's little confusing.
- 2 kudos
- 1947 Views
- 1 replies
- 0 kudos
Easy GIF Animator 7.4.8 Crack + License Key 2024
Easy GIF Animator 7.4.8 Crack + License Key 2024Easy GIF Animator Crack is popular ever for animation creation and editing purpose there are sufficient modules that works in moderate session and also upgrade the further styles which available here to...
- 1947 Views
- 1 replies
- 0 kudos
- 0 kudos
Download Easy GIF Animator
- 0 kudos
- 1099 Views
- 3 replies
- 0 kudos
Error Creating Primary Key Constraint in DLT
Hello There!Greetings!!I am getting the following error when trying to Create a DLT table in my Gold Layer..com.databricks.sql.managedcatalog.PrimaryKeyColumnsNullableException: Cannot create the primary key `x_key` because its child column(s) `x_key...
- 1099 Views
- 3 replies
- 0 kudos
- 0 kudos
Thank you @szymon_dybczak for the response.As you can see I have already defined the not null constraint in my definition for the primary key x_keyCONSTRAINT pk_key_not_null EXPECT (x_key IS NOT NULL) But still I am getting the same error.Also I chec...
- 0 kudos
- 3965 Views
- 2 replies
- 1 kudos
Oracle datawarehous Replacement With Databricks Using DeltaLake
I am new to Spark and DataBricks and exploring these to understand to replace Oracle DataWarehouse by DataBricks(deltalake) and to use Spark to improve the ELT/ETL performance of existing DW.Now, I have done some lookups in databricks blogs, spark do...
- 3965 Views
- 2 replies
- 1 kudos
- 470 Views
- 0 replies
- 1 kudos
registration and certification of databricks certification course regarding
I have a doubt only working personal are register for certification or student who studying data bricks course can register for exam because in some steps of registration ask for company and company email.
- 470 Views
- 0 replies
- 1 kudos
- 19323 Views
- 6 replies
- 0 kudos
Error "Root storage credential for metastore does not exist"While creating the Databricks Volume in
Hi, I tried to create the databricks volume in unity catalog but it threw this error:Root storage credential for metastore XXXXXX does not exist. Please contact your Databricks representative or consider updating the metastore with a valid storage cr...
- 19323 Views
- 6 replies
- 0 kudos
- 0 kudos
I had a similar issue, that was resolved by assigning storage credential to the metastore using REST API call.- make sure that you are metastore or account admin- make sure that the storage credential is correctly configured, its access corrector ide...
- 0 kudos
- 513 Views
- 0 replies
- 0 kudos
DBFS problem
Hi All, When trying to get to my DBFS in Databricks comunity edition I get the next errorI have already disabled and Enabled de DBFS file browser but it did not help
- 513 Views
- 0 replies
- 0 kudos
- 1086 Views
- 1 replies
- 0 kudos
Issue with VSCode Extension and Databricks Cluster Using Docker Image
I've encountered a significant issue while using the VSCode extension for Databricks, particularly when working with a cluster configured with a Docker image. Here's a detailed description of the problem:Problem DescriptionWhen attempting to upload a...
- 1086 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Retired_mod thanks for a such quick response.Actually, I am using the Dockerfile from the Databricks runtime example here: https://github.com/databricks/containers/blob/master/ubuntu/minimal/Dockerfile . The configuration with the VSCode extensio...
- 0 kudos
