Databricks Community

saisaranv

Hello everyone, I would like to understand Databricks Certified Data Engineer Associate exam and would greatly appreciate insights from anyone who has recently taken it. Specifically, I am looking to understand:Scenario-Based Questions: What types of...

saisaranv

@Islam_hoti Hope you are doing good. Actually we also faced the same thing in our project as customer defined UDF to be use across as per the policy but we explained that Photon is not compatible directly on Python UDF's bcz of the nature of converg...

saisaranv

For small workloads (a few MBs to a few GBs), you can prefer single-node or serverless compute within Databricks. This keeps the same governance, monitoring, CI/CD, Unity Catalog, and operational model while avoiding the overhead of a multi-node clus...

saisaranv

Thank you for your question :Few factors will decide the approaches to be considered like if data replay, data consistency, data volume and data query patterns from the business etc.,I am also faced similar situation : for one usecase we directly loa...

saisaranv

Excellent one and I am able to sense it why need to avoid the struct in sequnceBy : I had used 2 columns on a table with 10B records with huge performance gap.Thank you so much for the detailed explanation.

saisaranv

Just a small question to understand more : are you using any community connector or specific method to connect ?

Databricks Community

User Stats

User Activity

Insights Requested: Databricks Certified Data Engineer Associate Exam Experience & PatternComplexity

Re: Photon enabled but a large share of the plan is falling back, cost up and runtime flat

Re: At what data size do you stop reaching for Spark?

Re: Landing Layer vs. Bronze Layer — When to Use Which?

Re: Auto SCD API Tombstone Garbage Collection

Re: Title: Oracle CDC pipeline (Lakeflow Connect) never terminates