topic How to limit number rows to display using display method in Spark databricks notebook ? in Data Engineering

How to limit number rows to display using display method in Spark databricks notebook ?

ramravi — Thu, 22 Dec 2022 09:37:38 GMT

Ajay-Pandey — Thu, 22 Dec 2022 09:40:46 GMT

@Ravi Teja you can use limit() function to limit the number of row

You can refer below code -

data_frame.limit(10).display()

Rishabh-Pandey — Thu, 22 Dec 2022 10:31:16 GMT

hey @Ravi Teja there is two methods by which we can limit our datafame , by using take and limit .

refer this concept

myDataFrame.take(10)

-> results in an Array of Rows. This is an action and performs collecting the data (like collect does).

myDataFrame.limit(10)

-> results in a new Dataframe. This is a transformation and does not perform collecting the data.