topic Re: Plotting in pyspark.pandas Uncaught ReferenceError Plotly is not defined in Data Engineering

Plotting in pyspark.pandas Uncaught ReferenceError Plotly is not defined

Data_Cowboy — Mon, 06 Jun 2022 14:44:26 GMT

Hi,

I am trying to plot using pyspark.pandas running this sample code:

speed = [0.1, 17.5, 40, 48, 52, 69, 88]
lifespan = [2, 8, 70, 1.5, 25, 12, 28]
index = ['snail', 'pig', 'elephant',
         'rabbit', 'giraffe', 'coyote', 'horse']
psdf = ps.DataFrame({'speed': speed,
                     'lifespan': lifespan}, index=index)
psdf.plot.bar()

When I run the code, it returns the following error:

This code can be found in this notebook from Microsoft (https://docs.microsoft.com/en-us/azure/databricks/_static/notebooks/pandas-to-pandas-api-on-spark-in-10-minutes.html).

Is there something that I need to define Plotly?

Please let me know if I may provide any additional information. Thank you for your assistance.

Re: Plotting in pyspark.pandas Uncaught ReferenceError Plotly is not defined

Data_Cowboy — Mon, 06 Jun 2022 15:02:31 GMT

Just wanted to follow up on this, using matplotlib as the backend circumvents this error.

ps.set_option("plotting.backend", "matplotlib")

Re: Plotting in pyspark.pandas Uncaught ReferenceError Plotly is not defined

-werners- — Tue, 07 Jun 2022 09:50:45 GMT

can you check the visualisation docs?

There is a page for plotly.

Re: Plotting in pyspark.pandas Uncaught ReferenceError Plotly is not defined

Data_Cowboy — Tue, 07 Jun 2022 12:27:34 GMT

Thank you @Werner Stinckens . I was able to find the plotly documentation listed below and setting the output_type and calling displayHTML() helped remedy the error.