Why is the current limit for rows returned in Databricks SQL 64K?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-23-2021 07:11 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-25-2021 03:32 PM
I believe it's due to limitation in Redash's legacy architecture (which was acquired by Databricks). Hence Databricks is doing great efforts in increasing this threshold (was originally 20K), so with patience it will get to close to 1 Million. In the meantime, it's recommended to run aggregation/reduction operations on your data.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-11-2022 01:42 PM
@Amine El Helou when this limit will be lifted? my users won't switch from SSMS to dbx sql unless they can see all results set in UI ( which sometimes is more than 10mm rows)