hi @Dharinip
Cleaning up the shared log shows "Before" and "After" fingerprints. Hopefully can give us more info in how to proceed
Before
[
{
"id": 12
},
{
"qualifier": []
},
{
"class": "GreaterThan",
"num-children": 2,
...
Hello Hung,
Working with streaming tables is always a challenge. Let's remember we are working with unbounded data so it's important to consider a few points:
If you are working with Job, you can define your job cluster for each task. Consider the co...
Hi @Dileep_Karanki
Thank you for reaching out and for your question.
Here is a link for documentation about the available cluster types: https://docs.databricks.com/aws/en/compute#types-of-compute All-Purpose or Interactive Clusters: These are flex...
Hi @Leog
Thank you for reaching out and for your sending your question.
Per the documentation: https://docs.databricks.com/gcp/en/jobs/file-arrival-triggers
Only new files trigger runs. Overwriting an existing file with a file of the same name does ...
Hello @noorbasha534
Thank you for reaching out and for your patience with this reply; below are some of the best practices:
Monitor Data, Not Just Processes: Focus on monitoring the quality of your data, not just the processes that handle it. This a...
