topic How can I use display() in a python notebook with pyspark.sql.Row Objects, e.g. after calling the first() operation on a DataFrame? in Data Engineering

How can I use display() in a python notebook with pyspark.sql.Row Objects, e.g. after calling the first() operation on a DataFrame?

Anonymous — Wed, 22 Apr 2015 16:24:42 GMT

I'm trying to

display()

the results from calling

first()

on a DataFrame, but

display()

doesn't work with

pyspark.sql.Row

objects. How can I display this result?

Anonymous — Wed, 22 Apr 2015 16:28:09 GMT

The

display()

function requires a collection as opposed to single item, so any of the following examples will give you a means to displaying the results:

`display([df.first()])` # just make it an array
```
display(df.take(1))
```
# take w/ 1 is functionally equivalent to first(), but returns a DataFrame
```
display(df.limit(1))
```
# I'm not 100% sure this is guaranteed to be ordered, but it's another option to try that returns a DataFrame

dnchari — Wed, 18 Nov 2015 23:22:36 GMT

Use take()