How do i see all the dataframe column if I have more than 1000 column in dataframe
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-25-2021 08:07 AM
I tried printSchema() of a Dataframe in Databricks
. The Dataframe is having more than 1500 columns and apparently the printscheam function is truncating results and displaying only 1000 items. How to see all columns
Labels:
- Labels:
-
Data Ingestion & connectivity
1 REPLY 1
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-25-2021 08:10 AM
Databricks also shows the schema of the Dataframe when it's created - click on the icon next to the name of variable that holds the dataframe
If you have output of more than limit, then I would imagine outputting the schema into file,

