It is so unfortunate that we cannot render pandas dataframes. In R you can display dataframes and datatables only using display(mydata).

Is there an easy way to transform pandas dataframes to pyspark dataframes?

I ran your example but I cannot plot anything in databricks using python.

I get this error. I am using pandas 0.23.0 and matplolib 2.2.2.

/databricks/python/local/lib/python2.7/site-packages/ggplot/components/smoothers.py

:4: FutureWarning: The pandas.lib module is deprecated and will be removed in a future version. These are private functions and can be accessed from pandas._libs.lib instead from pandas.lib import Timestamp

ImportError: cannot import name Timestamp---------------------------------------------------------------------------ImportError Traceback (most recent call last)<command-3750589184628757> in <module>()11 12 ## Display the matplotlib Figure object to render our pandas data frame---> 13 display(fig)/tmp/1527806120745-0/PythonShell.py in display(self, input, args, *kwargs)708 " Call help(display) for more info."709 # import ggplot is too slow, so delay it until first call of display()--> 710 import ggplot711 if input is None:712 curFigure = mpl.pyplot.gcf()/databricks/python/local/lib/python2.7/site-packages/ggplot/init.py in <module>()19 version = '0.6.8'20 ---> 21 from .qplot import qplot22 from .ggplot import ggplot23 from .components import aes