https://community.databricks.com/t5/data-engineering/how-can-i-get-databricks-notebooks-to-stop-cutting-off-the/m-p/26129#M18245 <P>Notebooks really aren't the best method of viewing large files. Two methods you could employ are</P><P></P><OL><LI>Save the file to dbfs and then use databricks CLI to download the file</LI><LI>Use the web terminal</LI></OL><P></P><P>In the web terminal option you can do something like "cat my_large_file.txt | less" and then you can scroll through the entire content of the file.</P> Tue, 28 Sep 2021 19:16:03 GMT dazfuller 2021-09-28T19:16:03Z https://community.databricks.com/t5/data-engineering/how-can-i-get-databricks-notebooks-to-stop-cutting-off-the/m-p/26127#M18243 <P>(since Spark 3.0)</P><PRE><CODE>Dataset.queryExecution.debug.toFile</CODE></PRE><P>will dump the full plan to a file, without concatenating the output as a fully materialized Java string in memory.</P> Mon, 07 Jun 2021 16:02:46 GMT https://community.databricks.com/t5/data-engineering/how-can-i-get-databricks-notebooks-to-stop-cutting-off-the/m-p/26127#M18243 User15787040559 2021-06-07T16:02:46Z https://community.databricks.com/t5/data-engineering/how-can-i-get-databricks-notebooks-to-stop-cutting-off-the/m-p/26129#M18245 <P>Notebooks really aren't the best method of viewing large files. Two methods you could employ are</P><P></P><OL><LI>Save the file to dbfs and then use databricks CLI to download the file</LI><LI>Use the web terminal</LI></OL><P></P><P>In the web terminal option you can do something like "cat my_large_file.txt | less" and then you can scroll through the entire content of the file.</P> Tue, 28 Sep 2021 19:16:03 GMT https://community.databricks.com/t5/data-engineering/how-can-i-get-databricks-notebooks-to-stop-cutting-off-the/m-p/26129#M18245 dazfuller 2021-09-28T19:16:03Z