cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Warehousing & Analytics
Engage in discussions on data warehousing, analytics, and BI solutions within the Databricks Community. Share insights, tips, and best practices for leveraging data for informed decision-making.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Facing Data Truncation Issues in Databricks Dashboards

Akshay_Petkar
New Contributor III

I'm encountering data truncation in my Databricks dashboards. I'm working with a large dataset, and the dashboard only displays a limited number of (truncated) rows.
let's take a dataset containing 1 million sales records. The dashboard currently only displays a limited number of rows, which affects the accuracy of important metrics such as total sales. Is there a way to configure the dashboards to handle larger datasets and ensure that they display the complete picture, including all 1 million records in visualizations?

1 REPLY 1

NandiniN
Honored Contributor
Honored Contributor

Hi @Akshay_Petkar ,

This is simple in Databricks SQL, just uncheck LIMIT 1000 in the drop down.

https://docs.databricks.com/en/sql/get-started/visualize-data-tutorial.html

Limit 1000 is selected by default for all queries to ensure that the query returns at most 1000 rows. If a query is saved with the Limit 1000 setting, this setting applies to all executions of the query (including within dashboards). If you want to return all rows for this query, you can unselect LIMIT 1000 by clicking the Run (1000) drop-down. If you want to specify a different limit on the number of rows, you can add a LIMIT clause in your query with a value of your choice.

The query result displays in the Results tab.

 

Same way in notebook you can click on download full results.

But it won't preview the entire data on the UI.

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!