Hitting 504 Error with Databricks Delta Share open sharing protocol

[nbrisson]

When trying to query a particularly large table that my team has been given access to in a share (we are querying the table using a profile file with bearer token), we are continually hitting the following error:

io.delta.sharing.client.util.UnexpectedHttpStatuss: HTTP request failed with status: HTTP/1.1 504 Gateway Timeout {"error_code":"DEADLINE_EXCEEDED"}

Are there limitations on the databricks delta share server for the amount of data you can query via a share?

[nbrisson]

As a note we are using the deltaSharing data source like so:

spark.read.format("deltaSharing")