Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
I need to export some data from the database to csv which will be downloaded to another application. What would be the procedure for that? I don't have a lot of knowledge in DataBricks and I didn't find much information in the documentation.
You can manually download data to your local in CSV from databricks notebook cell and pass it to your another application.
Your application can run Databricks notebook inside a workflow via an API that writes data to S3 bucket in CSV and in response you get the S3 location. You can then download the file from the bucket.
In the above step you can also make use of lambda function for an asynchronous call.
You can manually download data to your local in CSV from databricks notebook cell and pass it to your another application.
Your application can run Databricks notebook inside a workflow via an API that writes data to S3 bucket in CSV and in response you get the S3 location. You can then download the file from the bucket.
In the above step you can also make use of lambda function for an asynchronous call.
Connect with Databricks Users in Your Area
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโt want to miss the chance to attend and share knowledge.
If there isnโt a group near you, start one and help create a community that brings people together.
