Databricks

thomasthomas · 07-26-2023

Hi all,I have a postgres database that contains two tables: A and B.Also, I have 2 delta tables, called C and D. My task is to push the data from A to C and B to D - and if something fails, then leave everything as is.With python it is easy. Set up t...

thomasthomas · 06-27-2023

In the Expo event I could contact several companies so that I can accelerate my business when it comes to improvements in data processing and now I have the right contacts to reach out to.#

thomasthomas · 01-14-2022

Hi,I have a bunch of scripts in Databricks that perform a decent amount of data-wrangling. All of these scripts contain sensitive information and I have no intention of making them public.I would like to provide a service to my customers - so they ca...

thomasthomas · 07-27-2023

As I described above, I am trying to write the content of 2 delta tables to 2 Postgres tables with an insert statement either with Spark SQL or Pyspark.Restore to version/describe statement are valid statement when you work with a delta table. Otherw...

thomasthomas · 01-25-2022

@Piper Wilson Thank you.In the meantime I found out that Databricks supports REST API calls to execute scripts in a given language but I am not convinced that that would be a great approach. With API 1.2 we need to define the language - and in alm...

Databricks

User Stats

User Activity

How can I insert into 2 tables within one database transaction with spark SQL / pyspark?

AI Summit 2023 day 2 takaways

Customer deployment

Re: How can I insert into 2 tables within one database transaction with spark SQL / pyspark?

Re: Customer deployment