cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
Dekova
New Contributor II
since ‎07-14-2023
‎07-27-2023

User Stats

  • 4 Posts
  • 0 Solutions
  • 2 Kudos given
  • 0 Kudos received

User Activity

Structured Streaming and Workplace Max Jobs

07-27-2023
From the documentation: A workspace is limited to 1000 concurrent task runs. A 429 Too Many Requests response is returned when you request a run that cannot start immediately.The number of jobs a workspace can create in an hour is limited to 10000 (i...

Photon and UDF efficiency

07-27-2023
When using a JVM engine, Scala UDFs have an advantage over Python UDFs because data doesn't have to be shifted out to the Python environment for processing. If I understand the implications of using the Photon C++ engine, any processing that needs to...

Using DeltaTable.merge() and generating surrogate keys on insert?

07-25-2023
I'm using merge to upsert data into a table:DeltaTable.forName(DESTINATION_TABLE).as("target").merge(merge_df.as("source") ,"source.topic = target.topic and source.key = target.key").whenMatched().updateAll().whenNotMatched().insertAll().execute()Id ...

Structured Streaming & Workspace Job Limits

07-14-2023
In "Advanced Data Engineering with Databricks", the section on Bronze Ingestion Patterns mentions that workspaces have limits of 5000 jobs triggered in an hour. As a solution, it suggest multiplex streaming to a single bronze table and then using sub...
Kudos given to