Writing to multiple files/tables from data held within a single file through autoloader

[Anandsingh]

I have a requirement to read and parse JSON files using autoloader where incoming JSON file has multiple sub entities. Each sub entity needs to go into its own delta table. Alternatively we can write each entity data to individual files. We can use DLT streaming or standard autoloader. Please suggest how can this be achieved with Azure Databricks.

[Lakshay]

I think using DLT's medallion architecture should be helpful in this scenario. You can write all the incoming data to one bronze table and one silver table. And you can have multiple gold tables based on the value of the sub-entities.