topic Re: how to read excel files inside a databricks notebook? in Data Engineering

how to read excel files inside a databricks notebook?

jeremy98 — Tue, 25 Feb 2025 15:20:23 GMT

Hi community,

Is it possible to read excel files from dbfs using a notebook file inside Databricks? If yes, how to do it?

Re: how to read excel files inside a databricks notebook?

Stefan-Koch — Tue, 25 Feb 2025 16:05:45 GMT

Have a look here, how to read excel files: https://community.databricks.com/t5/data-engineering/how-to-insert-from-an-excel-row-cell-level-data-into-a/m-p/101823#M40850

Re: how to read excel files inside a databricks notebook?

jeremy98 — Tue, 25 Feb 2025 17:16:45 GMT

Hello,

Thanks for your answer, but the point is that the file location is based on dbfs and seems that using a serveless compute and executing the pandas api is not possible to look at dbfs

Re: how to read excel files inside a databricks notebook?

Stefan-Koch — Wed, 26 Feb 2025 05:47:50 GMT

In general, you shouldn't use dbfs any more, instead, use Volumes.

But, as example, if I have an excel in my Worskpace directory, you could do this.

%pip install openpyxl import pandas as pd # replace with your path file_path = "/Workspace/Users/stefan.koch@btelligent.com/excel/FinancialsSampleData.xlsx" # read the sheet with Name Financials1 into a pandas dataframe pdf = pd.read_excel(file_path, sheet_name="Financials1") # Transform the Pandas Dataframe to a Pyspark Dataframe df = spark.createDataFrame(pdf) display(df)

Would this work for you or what is your dbfs path?

Re: how to read excel files inside a databricks notebook?

jeremy98 — Wed, 26 Feb 2025 18:40:40 GMT

amazing, yes that's is totally what I need! Thx Stefan!