topic Re: Displaying HTML Output in Data Engineering

Displaying HTML Output

DavidWrench — Mon, 08 Oct 2018 17:52:19 GMT

I am trying to display the html output or read in an html file to display in databricks notebook from pandas-profiling.

import pandas as pd import pandas_profiling

df = pd.read_csv("/dbfs/FileStore/tables/my_data.csv", header='infer', parse_dates=True, encoding='UTF-8')

profile = pandas_profiling.ProfileReport(df) Out[13]: <pandas_profiling.ProfileReport at 0x7f30e0b55780>

profile.to_html() Out[19]: '<!doctype html>\n\n<html lang="en">\n<head>\n <meta charset="utf-8">\n\n <title>Profile report</title>... WARNING: skipped 429584 bytes of output

Error on dislpayHtml()

displayHTML(profile)Py4JException: An exception was raised by the Python Proxy. Return Message: x

I could also output to html file:

profile.to_file(outputfile="/tmp/my_profiling.html")

but how would I read that in? is there a %html command?

Re: Displaying HTML Output

DavidWrench — Mon, 08 Oct 2018 17:59:16 GMT

I am sorry it is a mess, the code formatting on here does not escape the code I tried to embed.

Re: Displaying HTML Output

anandkn1884 — Mon, 25 Feb 2019 11:20:11 GMT

Hi,

Took me a while to find a simple solution. Found two ways. Hope they work.

- Read the html file content

html_file_content = open("output.html", 'r').read()

- Use displayHTML on the html_file_content

displayHTML(html_file_content)

2. Note: df is the dataframe

profile = pp.ProfileReport(df)

p = profile.to_html()

displayHTML(p)

Re: Displaying HTML Output

christopher_bro — Fri, 22 Mar 2019 09:36:47 GMT

Have you tried using

displayHTML(profile.to_html())

It worked for me, but I didn't have the warning or Exception, you had, when I used

displayHTML(profile)

Re: Displaying HTML Output

Bendu_Preez — Sun, 24 Mar 2019 00:06:04 GMT

What eventually worked for me was displayHTML(profile.to_html()) for the pandas_profiling and displayHTML(profile.html) for the spark_profiling.