External table issue

[RohitKulkarni]

Hello Team,

I am using df.write command and the table is getting created.

 

If you refer the below screenshot the table got created in Tables folder in dedicated sql pool. But i required in the External Tables folder.

 

Regards

RK

[-werners-]

if you actually write into Synapse, it is not an external table. the data resides on synapse.

If you want to have an external table, write the data on your data lake in parquet/delta lake format and then create an external table on that location in synapse.

[RohitKulkarni]

Please can you explain me with examples .

[-werners-]

https://learn.microsoft.com/en-us/azure/synapse-analytics/sql/develop-tables-external-tables?tabs=ha...

External tables are not actual tables but a 'view' on top of data which resides somewhere else, NOT in the database.

If you use df.write.format(...sqldw) you are actually gonna write into the database itself which makes it a common table.

If you would use df.write.parquet(<path>) you could create an external table on top of the data, see the link I provided.

[RohitKulkarni]

Thanks for sharing the link.But this can be tested in synapse analytics but not in databricks

[-werners-]

yes, databricks can send data to synapse but table management is done in Synapse, not databricks

[Kaniz]

Hi @Rohit Kulkarni​ , We haven't heard from you on the last response from @Werner Stinckens​​, and I was checking back to see if his suggestions helped you.

Or else, If you have any solution, please share it with the community as it can be helpful to others.

Also, Please don't forget to click the "Select As Best" button whenever the information provided helps resolve your question.