raphaelblg
Databricks Employee
Databricks Employee

Hello @leobocci ,

In order to read multiple Delta tables, multiple read operations are required. You can trigger the read operations simultaneously through the Job Workflows, DLT, Databricks CLI, DBSQL, Interactive Clusters and other resources.

If the problem is the performance while listing the table paths, I'm afraid there's nothing we can do to improve filesystem read/list operations performance as these are not fully managed by Databricks . 

 

Best regards,

Raphael Balogo
Sr. Technical Solutions Engineer
Databricks