Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-21-2021 11:55 PM
Thank you for your reply..
We stored our processed data to delta format.
Now from testing point of view, I am reading all the parquet files to dataframe to apply the queries.
Here, we tried to see how many records data we can display or show in databricks, so we used the below command as normal display is giving first 232 rows only
df_delta.show(df_delta.count(),False) -- we are trying to show/read 7 lakh records(df_delta.count()) and making truncate is false.
Thankyou