cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

How to optimize queries in data bricks to query huge data

Ranjeeth
New Contributor
 
1 ACCEPTED SOLUTION

Accepted Solutions

Pat
Honored Contributor III

Hi @Ranjeeth Rikkalaโ€‹ ,

you can check this:

https://docs.databricks.com/optimizations/index.html#optimization-recommendations-on-databricks

TBH, Itโ€™s nit enough info. Make sure you have partioned data, Files are nit too small, try to use bigger cluster, convert data into delta format.

View solution in original post

2 REPLIES 2

Pat
Honored Contributor III

Hi @Ranjeeth Rikkalaโ€‹ ,

you can check this:

https://docs.databricks.com/optimizations/index.html#optimization-recommendations-on-databricks

TBH, Itโ€™s nit enough info. Make sure you have partioned data, Files are nit too small, try to use bigger cluster, convert data into delta format.

Kaniz
Community Manager
Community Manager

Hi @Ranjeeth Rikkalaโ€‹ , We havenโ€™t heard from you since the last response from @Pat Sienkiewiczโ€‹ , and I was checking back to see if his suggestions helped you.

Or else, If you have any solution, please share it with the community, as it can be helpful to others.

Also, Please don't forget to click on the "Select As Best" button whenever the information provided helps resolve your question.

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.