topic Re: Limitations of committing ipynb notebook output with Repos in Get Started Discussions

Limitations of committing ipynb notebook output with Repos

adrianna2942842 — Thu, 14 Sep 2023 08:39:11 GMT

During my experimentation with the latest feature that allows including notebook output in a commit, I ran into a specific issue. While attempting to commit my recent changes, I encountered an error message stating "Error fetching Git status." Interestingly, this error vanishes when I reduce the number of tables generated using the "display(df)" function or limit the number of columns and rows within a table. It appears that there might be a restriction on the size of the output, but I couldn't locate any specific information about this limitation, apart from the file size limit (which is not applicable in this case).

I would greatly appreciate it if anyone who has faced a similar issue could provide further insights or additional information on this matter.

Re: Limitations of committing ipynb notebook output with Repos

adrianna2942842 — Thu, 14 Sep 2023 09:05:43 GMT

I appreciate your quick answer! I am indeed aware of the 20MB size limit, although I initially believed it didn't apply here, given that my file is only 13.2 MB in size.

Re: Limitations of committing ipynb notebook output with Repos

adrianna2942842 — Thu, 21 Sep 2023 11:58:05 GMT

I've found that the restriction I've encountered isn't related to the file size within Repos, but rather the maximum file size that can be shown in the Azure Databricks UI. You can find this limitation documented at https://learn.microsoft.com/en-us/azure/databricks/repos/limits, and it's set at 10 MB.