https://community.databricks.com/t5/data-engineering/what-is-the-maximum-size-of-a-dataframe-that-i-can-convert/m-p/30387#M22025 <P></P> <P>There is no hardcoded limit we just call panda.fromRecords with a collection of fields to instantiate a new Panda Dataframe.</P> <P>The only limit is memory.</P> <P>See <A href="http://stackoverflow.com/questions/15455722/pandas-is-there-a-max-size-max-no-of-columns-max-rows" target="test_blank">http://stackoverflow.com/questions/15455722/pandas-is-there-a-max-size-max-no-of-columns-max-rows</A></P> <P></P> Fri, 31 Jul 2015 17:21:36 GMT rlgarris 2015-07-31T17:21:36Z https://community.databricks.com/t5/data-engineering/what-is-the-maximum-size-of-a-dataframe-that-i-can-convert/m-p/30386#M22024 Fri, 10 Jul 2015 21:19:52 GMT https://community.databricks.com/t5/data-engineering/what-is-the-maximum-size-of-a-dataframe-that-i-can-convert/m-p/30386#M22024 Gabriela_DeQuer 2015-07-10T21:19:52Z https://community.databricks.com/t5/data-engineering/what-is-the-maximum-size-of-a-dataframe-that-i-can-convert/m-p/30387#M22025 <P></P> <P>There is no hardcoded limit we just call panda.fromRecords with a collection of fields to instantiate a new Panda Dataframe.</P> <P>The only limit is memory.</P> <P>See <A href="http://stackoverflow.com/questions/15455722/pandas-is-there-a-max-size-max-no-of-columns-max-rows" target="test_blank">http://stackoverflow.com/questions/15455722/pandas-is-there-a-max-size-max-no-of-columns-max-rows</A></P> <P></P> Fri, 31 Jul 2015 17:21:36 GMT https://community.databricks.com/t5/data-engineering/what-is-the-maximum-size-of-a-dataframe-that-i-can-convert/m-p/30387#M22025 rlgarris 2015-07-31T17:21:36Z