cancel
Showing results for 
Search instead for 
Did you mean: 
Community Platform Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

unity_Catalog
by New Contributor III
  • 1358 Views
  • 2 replies
  • 2 kudos

Resolved! Migrating dashboards from one workspace to another workspace

I'm exporting dashboard objects from an existing workspace to new workspace but after importing ,the underlying dashboards data is not coming to new workspace. I'm using the below code. Can anyone helpimport osimport requestsimport jsonimport logging...

  • 1358 Views
  • 2 replies
  • 2 kudos
Latest Reply
romy
Databricks Employee
  • 2 kudos

Hi, you can use the workspace API to import the dashboard: https://learn.microsoft.com/en-us/azure/databricks/dashboards/tutorials/workspace-lakeview-api#step-3-import-a-dashboard A code example is available on this thread: https://community.databric...

  • 2 kudos
1 More Replies
argl1995dbks
by New Contributor III
  • 1375 Views
  • 5 replies
  • 1 kudos

To trigger databricks workflow on defined frequency

Hi Databricks, I am trying to run a databricks workflow on scheduled basis (for e.g. the frequency is after every five mins). Here is the databricks.yaml file: bundle:  name: dab_demo# include:#   - resources/*.ymlvariables:  job_cluster_key:    desc...

  • 1375 Views
  • 5 replies
  • 1 kudos
Latest Reply
argl1995dbks
New Contributor III
  • 1 kudos

Hi, let me explain you the current scenario, we have databricks workflows which has DS, DE and MLOps tasks. The workflows are meant to be triggered on a specific frequency i.e. Monthly and Quarterly and Quarterly workflow depends on the Monthly workf...

  • 1 kudos
4 More Replies
mhasel
by New Contributor II
  • 625 Views
  • 1 replies
  • 1 kudos

Cannot use Databricks VSCode extensions on repository with ".devcontainer" folder

Hi, I have a repository that contains a ".devcontainer" folder. I use VSCode and try to use the databricks extension following this guide When I run "Upload and Run File on Databricks" I have this error and then cannot run the python scriptSync Error...

  • 625 Views
  • 1 replies
  • 1 kudos
Latest Reply
mhasel
New Contributor II
  • 1 kudos

Hi @Retired_mod The folder lays plain in the repository. When logging on the databricks Web UI I can see that the folder (together with its content) was correctly copied But I still have the error messsage in VSCode 

  • 1 kudos
elaya6
by New Contributor II
  • 447 Views
  • 1 replies
  • 0 kudos

Exam got suspended

Hi Team,In this morning i was taking the exam suddenly proctor asked me to show the room and walls i showed him then he suspended my exam no one was there. I dont understand why he suspended the exam. Kindly reschedule the exam i need the certificati...

  • 447 Views
  • 1 replies
  • 0 kudos
Latest Reply
elaya6
New Contributor II
  • 0 kudos

Hi Team,Could you please atleast reschedule the exam. i will take it from the prometric centerthanks

  • 0 kudos
araiho
by New Contributor II
  • 1459 Views
  • 2 replies
  • 1 kudos

R Package Installation Best Practices

Hello,We are new to databricks and are wondering what the best practices are for R package installation. We currently have cluster spin up wait times of more than 20 minutes with our init scripts. We have tried the following:1. Libraries tab in the c...

  • 1459 Views
  • 2 replies
  • 1 kudos
Latest Reply
araiho
New Contributor II
  • 1 kudos

@Retired_mod Thank you for your detailed response! I think we would like to use Docker if we can because we are not using RStudio but R directly in the databricks notebooks and workflows. So, anymore information about R and Docker and Databricks woul...

  • 1 kudos
1 More Replies
ankris
by New Contributor III
  • 4080 Views
  • 6 replies
  • 2 kudos

data quality check in data engineering

Can we use deequ library with azure databricks ? if yes Please provide some support material or examplesIs there any similar data quality library or suggestion to achieve automatic data quality check during data engineering (Azure databricks)Thanks i...

  • 4080 Views
  • 6 replies
  • 2 kudos
Latest Reply
joarobles
New Contributor III
  • 2 kudos

Hi there! You could also take a look at Rudol, it enables no-code Data Quality validations to enable non-technical roles such as Business Analysts or Data Stewards to configure quality checks by themselves. 

  • 2 kudos
5 More Replies
DatabricksIssue
by New Contributor II
  • 1603 Views
  • 5 replies
  • 3 kudos

Resolved! Unable to upload files from DBFS

When clicked on upload i am seeing below errorStorageContext com.databricks.backend.storage.StorageContextType$DbfsRoot$@2f3c3220 for workspace 1406865167171326 is not set in theCustomerStorageInfo.

  • 1603 Views
  • 5 replies
  • 3 kudos
Latest Reply
PB-Data
New Contributor III
  • 3 kudos

 same issue at my end since yesterday.. does anyone know the reason and what needs to be done from our side (if any) to fix this. 

  • 3 kudos
4 More Replies
AnandBagate
by New Contributor II
  • 682 Views
  • 2 replies
  • 2 kudos

Resolved! I am facing issue with DBFS File server

Hi,I am facing the issue DBFS File server, anyone guide me how to resolve the issue. what steps should I take to resolve storage issue ? 

AnandBagate_0-1721834812256.png
  • 682 Views
  • 2 replies
  • 2 kudos
Latest Reply
mozartiano
New Contributor III
  • 2 kudos

Looks good now. thanks

  • 2 kudos
1 More Replies
Carlton
by Contributor
  • 847 Views
  • 3 replies
  • 3 kudos

Unablet to Install Python Wheel Library

Hello Team,Can someone let me know if there has been some changes to Databricks Community Edition such that it's no longer possible to install Python Wheel libraries? I was able to install Python Wheel libraries as recently as a few days ago, but now...

Carlton_0-1721823396254.png
  • 847 Views
  • 3 replies
  • 3 kudos
Latest Reply
aalanis
New Contributor II
  • 3 kudos

Hi there, Check your runtime version to check you are using a version that supports that and I think nowadays the recommended pattern (don’t quote me) is to store your wheel files on the workspace tree

  • 3 kudos
2 More Replies
zll_0091
by New Contributor III
  • 1130 Views
  • 3 replies
  • 4 kudos

Resolved! How does AutoLoader works when triggered via Azure Data Factory?

Hi,I am currently creating an AutoLoader in databricks and will be using ADF as an orchestrator.I am quite confused how this will handle my data so please clarify if I misunderstood it.First, I will run my ADF pipeline which includes an activity to c...

zll_0091_0-1721789223632.png
  • 1130 Views
  • 3 replies
  • 4 kudos
Latest Reply
szymon_dybczak
Contributor III
  • 4 kudos

Auto loader will process files incrementally. Let's say you have a files in existing directory called /input_filesFirst time you run autoloader, it will read all files in that directory (unless you set an option includeExsistingFiles to false, like y...

  • 4 kudos
2 More Replies
zll_0091
by New Contributor III
  • 1128 Views
  • 3 replies
  • 2 kudos

How can I deduplicate data from my stream?

Hi,I'm new to databricks and I'm trying to use stream for my incremental data. This data has duplicates which can be solved using a window function. Can you check where my code goes wrong?1-------#Using Auto Loader to read new files schema = df1.sche...

zll_0091_1-1721743629228.png
  • 1128 Views
  • 3 replies
  • 2 kudos
Latest Reply
szymon_dybczak
Contributor III
  • 2 kudos

Hi @zll_0091 ,Change the output mode to update. Other than that, your code looks fine, but I would rename variable microdf to windowSpec, because now it's little confusing.

  • 2 kudos
2 More Replies
Mudasirfiyaz20
by New Contributor II
  • 1609 Views
  • 1 replies
  • 0 kudos

Easy GIF Animator 7.4.8 Crack + License Key 2024

Easy GIF Animator 7.4.8 Crack + License Key 2024Easy GIF Animator Crack is popular ever for animation creation and editing purpose there are sufficient modules that works in moderate session and also upgrade the further styles which available here to...

  • 1609 Views
  • 1 replies
  • 0 kudos
Latest Reply
Mudasirfiyaz20
New Contributor II
  • 0 kudos

Download Easy GIF Animator 

  • 0 kudos
ani2409
by New Contributor II
  • 961 Views
  • 3 replies
  • 0 kudos

Error Creating Primary Key Constraint in DLT

Hello There!Greetings!!I am getting the following error when trying to Create a DLT table in my Gold Layer..com.databricks.sql.managedcatalog.PrimaryKeyColumnsNullableException: Cannot create the primary key `x_key` because its child column(s) `x_key...

  • 961 Views
  • 3 replies
  • 0 kudos
Latest Reply
ani2409
New Contributor II
  • 0 kudos

Thank you @szymon_dybczak for the response.As you can see I have already defined the not null constraint in my definition for the primary key x_keyCONSTRAINT pk_key_not_null EXPECT (x_key IS NOT NULL) But still I am getting the same error.Also I chec...

  • 0 kudos
2 More Replies
arijit_sani
by New Contributor II
  • 3875 Views
  • 2 replies
  • 1 kudos

Oracle datawarehous Replacement With Databricks Using DeltaLake

I am new to Spark and DataBricks and exploring these to understand to replace Oracle DataWarehouse by DataBricks(deltalake) and to use Spark to improve the ELT/ETL performance of existing DW.Now, I have done some lookups in databricks blogs, spark do...

Community Platform Discussions
datawarehouse oracle-databricks Migration data
  • 3875 Views
  • 2 replies
  • 1 kudos
Latest Reply
arijit_sani
New Contributor II
  • 1 kudos

Hi, Could you please advise on this

  • 1 kudos
1 More Replies

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Top Kudoed Authors