What is the best way to decode protobuf using pyspark?

[User16868770416]

I am using spark structured streaming to read a protobuf encoded message from the event hub. We use a lot of Delta tables, but there isn't a simple way to integrate this.

We are currently using K-SQL to transform into avro on the fly and then use Databricks to read the Avro file. Is there a better way of doing this?

[jose_gonzalez]

hi @Will Block​ ,

I think there is a related question being asked in the past. I think it was this one

I found this library, I hope it helps.