cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

Strange object returned using sparklyr

Jeff1
Contributor II

Community

I'm running a sparklyr "group_by" function and the function returns the following info:

# group by event_type

acled_grp_tbl <- acled_tbl %>%

 group_by("event_type") %>%

 summary(count = n())

                  Length Class      Mode      

src                 1     src_spark  list      

ops                4     op_group_by list      

sdf_cache_state    2     -none-     environment

spark_dataframe   1     -none-     function  

schema_cache_state 2     -none-     environment

schema             1     -none-     function

Not what I expected and have no idea what it is telling me. Other than my group_by isn't working. Any ideas.

Jeff

1 ACCEPTED SOLUTION

Accepted Solutions

Jeff1
Contributor II

I should have deleted the post. While your are correct "event_type" should be without quotes the problem was the Summary function. I was using the wrong function it should have been "summarize."

View solution in original post

3 REPLIES 3

Hubert-Dudek
Esteemed Contributor III

I think "event_type" should be without quotation marks

Jeff1
Contributor II

I should have deleted the post. While your are correct "event_type" should be without quotes the problem was the Summary function. I was using the wrong function it should have been "summarize."

Hubert-Dudek
Esteemed Contributor III

yes I haven't spotted that as names are similar 🙂

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.