cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
minhhung0507
Contributor III
since ‎12-05-2024
3 weeks ago

User Stats

  • 46 Posts
  • 0 Solutions
  • 25 Kudos given
  • 6 Kudos received

User Activity

API for Restarting Individual Failed Tasks within a Job?

04-15-2025
Hi everyone,I'm exploring ways to streamline my workflow in Databricks and could really use some expert advice. In my current setup, I have a job (named job_silver) with multiple tasks (e.g., task 1, task 2, task 3). When one of these tasks fails—say...

Handling Hanging Pipelines in Real-Time Environments: Leveraging Databricks’ Idle Event Monitoring

04-15-2025
Hi everyone,I’m running multiple real-time pipelines on Databricks using a single job that submits them via a thread pool. While most pipelines are running smoothly, I’ve noticed that a few of them occasionally get “stuck” or hang for several hours w...

Handling Streaming Query Hangs & Delta Upsert Failures in Multi-Table Jobs

04-13-2025
Hi Databricks Experts,I'm encountering issues with my streaming jobs in Databricks and need some advice. I’ve implemented a custom streaming query listener to capture job status events and upsert them into a Delta table. However, the solution behaves...

Optimizing Spark Read Performance on Delta Tables with Deletion Vectors Enabled

04-04-2025
 Hi Databricks Experts,I'm currently using Delta Live Table to generate master data managed within Unity Catalog, with the data stored directly in Google Cloud Storage. I then utilize Spark to read these master data from the GCS bucket. However, I’m ...

Performance issue with Spark SQL when working with data from Unity Catalog

04-01-2025
  We're encountering a performance issue with Spark SQL when working with data from Unity Catalog. Specifically, when I use Spark to read data from a Unity Catalog partition created by DLT and then create a view, the executor retrieval is very slow. ...
View more