topic Fixed length file from Databricks notebook ( Spark SQL) in Data Engineering

Fixed length file from Databricks notebook ( Spark SQL)

Sadiq — Mon, 29 Aug 2022 17:15:41 GMT

Hi ,

I need help writing data from azure databricks notebook into Fixed Length .txt.

notebook has 10 lakh rows and 86 columns. can anyone suggest me

Re: Fixed length file from Databricks notebook ( Spark SQL)

Sadiq — Sun, 04 Sep 2022 05:34:53 GMT

this is not the resolution

Re: Fixed length file from Databricks notebook ( Spark SQL)

Sadiq — Sun, 04 Sep 2022 05:45:20 GMT

I have data in databrick notebook which is in the form of columns and rows.

now I want to export data from notebook to .txt file with fixed length.

like each column has defined with legth.

support column1 it should occupy only first 10 lenth

Re: Fixed length file from Databricks notebook ( Spark SQL)

Vidula — Thu, 15 Sep 2022 10:47:10 GMT

Hi @sadiq vali

Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help.

We'd love to hear from you.

Thanks!

Re: Fixed length file from Databricks notebook ( Spark SQL)

Debayan — Wed, 31 Aug 2022 05:13:58 GMT

Hi Sadiq, Could you please refer below and check if this helps.

https://k21academy.com/microsoft-azure/data-engineer/reading-and-writing-data-in-databricks/

Re: Fixed length file from Databricks notebook ( Spark SQL)

Debayan — Sun, 04 Sep 2022 05:38:56 GMT

Hi @sadiq vali Could you please elaborate a little more what are you expecting about writing data into fixed length.txt?