cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Start a conversation
kll
by • New Contributor III
  • 6088 Views
  • 1 replies
  • 1 kudos

Internal error: com.databricks.rpc.RPCResponseTooLarge, when attempting to use mosaic's st_intersects

I get an exception when attempting to run the following line of code, which filters a spark DataFrame based on the geometry.df_tx = df_zip.filter(st_intersects(st_aswkt("zip_code_geom"), tx_poly))   df_tx.show()where, `tx_poly` is,`tx_poly = shapely....

Machine Learning
Reply
  • 6088 Views
  • 1 replies
  • 1 kudos
View Replies
Latest Reply
Anonymous
Not applicable
  • 1 kudos

I am not familiar with st_intersects, but it seems that it runs solely on the driver (as python code, not spark).Does mosaic work in pyspark?If not: try to use a larger driver.

  • 1 kudos
Labels