hello @Akshay_Petkar,
in your data tab, can't you create a dataset using "Create From SQL" and write a query like the following and use this dataset in your canvas?
SELECT COUNT(sales_key) total_sales, distirict FROM my_table
GROUP BY distirict
ORDE...
hello @Vetrivel,
Serverless compute resources run in the serverless compute plane, which is managed by Azure Databricks. For more details on the network and architecture, see Serverless compute plane networking.
https://learn.microsoft.com/en-us/azur...
hey @garf
could you please try to create an external volume using your external location and then use the file path in the volume as the input file path?
hey @AlokThampi,
it's difficult to understand what's going on here (not having access to spark UI, query profile or any idea about the dimensions of these tables) but you can give these a try:
make sure the keys have the same data type (i.e. all thre...
here you can find the documentation on how to use parameters in dlt (sql and python):
https://docs.databricks.com/en/delta-live-tables/settings.html#parameterize-dataset-declarations-in-python-or-sql
