https://community.databricks.com/t5/get-started-discussions/dbutils-fs-ls-max-list-size-exceeded/m-p/49978#M6055 <P>Hi!</P><P>I'm experiencing different behaviours between two DBX Workspaces when trying to list file contents from an abfss: location.</P><P>In workspace A running len(dbutils.fs.ls('abfss://~~@~~~~.dfs.core.windows.net/~~/')) results in "Out[1]: 1551", while running the same command in workspace B results in "<SPAN class=""><SPAN class="">AnalysisException</SPAN>: MAX_LIST_SIZE_EXCEEDED: There are more than 1001 files. Please specify [LIMIT] to limit the number of files returned.</SPAN>"</P><P>I can't seem to find any way to increase this limit and would prefer to work with dbutils.fs.ls as opposed to mounting the location.The only difference between these two Workspaces and the clusters I've tried is that Workspace B has Unity Catalog enabled.</P> Fri, 27 Oct 2023 07:26:52 GMT thuovi 2023-10-27T07:26:52Z https://community.databricks.com/t5/get-started-discussions/dbutils-fs-ls-max-list-size-exceeded/m-p/49978#M6055 <P>Hi!</P><P>I'm experiencing different behaviours between two DBX Workspaces when trying to list file contents from an abfss: location.</P><P>In workspace A running len(dbutils.fs.ls('abfss://~~@~~~~.dfs.core.windows.net/~~/')) results in "Out[1]: 1551", while running the same command in workspace B results in "<SPAN class=""><SPAN class="">AnalysisException</SPAN>: MAX_LIST_SIZE_EXCEEDED: There are more than 1001 files. Please specify [LIMIT] to limit the number of files returned.</SPAN>"</P><P>I can't seem to find any way to increase this limit and would prefer to work with dbutils.fs.ls as opposed to mounting the location.The only difference between these two Workspaces and the clusters I've tried is that Workspace B has Unity Catalog enabled.</P> Fri, 27 Oct 2023 07:26:52 GMT https://community.databricks.com/t5/get-started-discussions/dbutils-fs-ls-max-list-size-exceeded/m-p/49978#M6055 thuovi 2023-10-27T07:26:52Z