Strange object returned using sparklyr

Jeff1
Contributor II

Community

I'm running a sparklyr "group_by" function and the function returns the following info:

# group by event_type

acled_grp_tbl <- acled_tbl %>%

 group_by("event_type") %>%

 summary(count = n())

                  Length Class      Mode      

src                 1     src_spark  list      

ops                4     op_group_by list      

sdf_cache_state    2     -none-     environment

spark_dataframe   1     -none-     function  

schema_cache_state 2     -none-     environment

schema             1     -none-     function

Not what I expected and have no idea what it is telling me. Other than my group_by isn't working. Any ideas.

Jeff

Hubert-Dudek
Databricks MVP

I think "event_type" should be without quotation marks


My blog: https://databrickster.medium.com/

Jeff1
Contributor II

I should have deleted the post. While your are correct "event_type" should be without quotes the problem was the Summary function. I was using the wrong function it should have been "summarize."

View solution in original post

yes I haven't spotted that as names are similar 🙂


My blog: https://databrickster.medium.com/