Solved: How to create a temporary file with sql - Databricks - 14033

Register to join the community

Data Engineering

what are the commands to create a temporary file with SQL

1 ACCEPTED SOLUTION

Accepted Solutions

In Spark SQL, you could use commands like "insert overwrite directory" that indirectly creates a temporary file with the data

https://docs.databricks.com/spark/latest/spark-sql/language-manual/sql-ref-syntax-dml-insert-overwri...

Using shell you could create directory using

%sh mkdir /tmp/file

& create temp file using

echo 'This is a test' > data.txt

If you have more questions, please let us know what is the use case are you trying to do

View solution in original post

1 REPLY 1

In Spark SQL, you could use commands like "insert overwrite directory" that indirectly creates a temporary file with the data

https://docs.databricks.com/spark/latest/spark-sql/language-manual/sql-ref-syntax-dml-insert-overwri...

Using shell you could create directory using

%sh mkdir /tmp/file

& create temp file using

echo 'This is a test' > data.txt

If you have more questions, please let us know what is the use case are you trying to do

never-displayed

You must be signed in to add attachments

never-displayed

Announcements

Registration now open! Databricks Data + AI Summit 2024

Meet DBRX, the New Standard for High-Quality LLMs

Data Warehousing in the Era of AI