Databricks Community

gb_dbx · 08-07-2024

Hi,I am wondering if Databricks has planned to create a Python API of spark SQL's COPY INTO statement ?In my company we created some kind of a Python wrapper of the SQL COPY INTO statement, but it has lots of design issues and is hard to maintain. I ...

gb_dbx · 08-12-2024

Okay maybe I should take a look at Auto Loader then, I didn't know Auto Loader could basically do the same as COPY INTO, I originally thought it was only used for streaming and not batch ingestion.And Auto Loader has a dedicated Python API then ?And ...

Databricks Community

User Stats

User Activity

Does Databricks plan to create a Python API of the COPY INTO spark SQL statement in the future ?

Re: Does Databricks plan to create a Python API of the COPY INTO spark SQL statement in the future ?