cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

When I aggregate over more data, I get the below error message. I've tried multiple ways of diagnosis like going back to a version I know it was w...

User16618471166
New Contributor II

When I aggregate over more data, I get the below error message. I've tried multiple ways of diagnosis like going back to a version I know it was working fine (but still got the same error below). Please advise as this is a critical report where the business I support highly depend on on a monthly basis. Thank!

Error shown below:

This visualization cannot be shown. Please refresh the visualization or update its configuration.

Error in SQL statement: ParseException:

[PARSE_SYNTAX_ERROR] Syntax error at or near end of input(line 102, pos 85)

3 REPLIES 3

Debayan
Databricks Employee
Databricks Employee

Hi, Could you please elaborate a little more on the use case here and the ask?

Also, please tag @Debayan​ with your next response so that I will be notified. Thanks!

User16618471166
New Contributor II

it appears to be something in the aggregation logic in Notebook environment and I think it just got fixed.. thx for your help Debayan.

Anonymous
Not applicable

@Jeff Wu​ :

The error message suggests that there is a syntax error in a SQL statement, specifically near the end of the input. Without the full SQL statement or additional information, it's difficult to pinpoint the exact cause of the error. However, here are some general tips that could help you troubleshoot the issue:

  1. Check for typos or syntax errors: Look for any typos or syntax errors in the SQL statement, especially near the end of the input. You can try copying the statement to a SQL editor or IDE to help identify any syntax errors.
  2. Check for missing or extra parentheses: Make sure that all parentheses are properly matched and that there are no missing or extra parentheses.
  3. Check for missing or extra commas: Similarly, make sure that all commas are properly placed and that there are no missing or extra commas.
  4. Check for missing or extra quotes: Check for missing or extra quotes around strings or date values.
  5. Check for data issues: If the error only occurs when you aggregate over more data, it could be due to data issues such as missing or invalid values.
  6. Check the data types: Make sure that the data types of the columns being aggregated match the expected data types.
  7. Check for recent changes: If the error started occurring after recent changes to the SQL statement or the data, try reverting those changes and see if the error goes away.

If none of these suggestions help, it may be helpful to provide more context or details about the specific SQL statement and data being used, so that others can better understand the issue and provide more targeted suggestions.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group