Is there a (request-) size limit for the Databricks Rest Api Sql statements?

TheIceBrick
New Contributor III

When inserting rows through the Sql Api (/api/2.0/sql/statements/), when more than a certain number of records (about 25 records with 8 small columns) are included in the statement, the call fails with the error:

"The request could not be processed by the warehouse."

Including fewer records (less than 25 in this case) will cause the call to succeed.

 

"statement": "INSERT OVERWRITE TableName (Columns....) VALUES 
    (Named markers record1 for 8 columns...),
    (Named markers record2 for 8 columns...),
    (Named markers record3 for 8 columns...),
    etc. etc. etc. for more records
"wait_timeout": "10s",
"on_wait_timeout": "CONTINUE",
"parameters": [
{
    "name": "Marker",
    "type": "LONG",
    "value": 1705680165682
},
etc. etc. etc. all parameters for the named markers for all records.
]

 

My question is therefore, what limit am I seemingly hitting here? Note that I am obviously referring to the request, not the response, for which the limits are documented. The total size of the request is around 30 - 40 kb.