topic PDF Generation via databricks Job in Data Engineering

PDF Generation via databricks Job

Mulder81 — Tue, 25 Mar 2025 18:31:36 GMT

WE have a databricks Job that will aggregate some data and create some data tables. This needs to be exported out in a PDF format.

I have seen a few python libraries that can generate PDF, but was wondering if the PDF can be generated and dropped in a cloud storage location frm databricks job.

If anyone has some ideas on this, greatly appreciated.

Mulder

Re: PDF Generation via databricks Job

PiotrMi — Tue, 25 Mar 2025 19:10:01 GMT

Hey @Mulder81 ,

After generating file you can copy it to dediacted blob storage using below command.

dbutils.fs.cp(source_path, destination_path)

You can also try saving file in desired path (blob storage) but there can be some obstacles

BR,

Piotrek

Re: PDF Generation via databricks Job

Mulder81 — Tue, 25 Mar 2025 19:23:49 GMT

Are there any specific ways to generate the PDF file from a dataframe? and libraries that work

Re: PDF Generation via databricks Job

PiotrMi — Tue, 25 Mar 2025 21:23:16 GMT

Hey @Mulder81

You can try this article

https://medium.com/@mahijain9211/creating-a-python-class-for-generating-pdf-tables-from-a-pandas-dataframe-using-fpdf2-c0eb4b88355c

It uses pandas and fpdf. Also you need to read about temporary place/path where you save pdf for later copying for blob