topic Hi i have uploaded excel file in databricks but it shows different language. in Data Engineering

Hi i have uploaded excel file in databricks but it shows different language.

Ziy_41 — Mon, 21 Oct 2024 09:59:44 GMT

Hi,

I have attach one excel file in data bricks edition but unfortunately it shows a diiferent langaue in ouput whice i wrote display(df). below im attaching the screenshot please let me now thanking you in advance.

Re: Hi i have uploaded excel file in databricks but it shows different language.

Panda — Mon, 21 Oct 2024 10:12:04 GMT

@Ziy_41 When loading the file, try explicitly setting the encoding

.option("encoding", "UTF-8")

Re: Hi i have uploaded excel file in databricks but it shows different language.

Stefan-Koch — Mon, 21 Oct 2024 19:35:49 GMT

CSV and Excel are not the same datatype.

You can load the excel data into a pandas dataframe and then convert it to a pyspark dataframe.

first, you have to install the openpyxl library

%pip install openpyxl

Then import PySpark Pandas:

import pyspark.pandas as ps

And then read the excel-data into a df:

path = "/Volumes/demo/raw/files/FinancialsSampleData.xlsx" # create pandas-df pdf_sheet1 = ps.read_excel(path, sheet_name="Financials1") #convert pandas-df to pyspark-df df_sheet1 = pdf_sheet1.to_spark() display(df_sheet1)

Your df should look like this: