- 14591 Views
- 13 replies
- 7 kudos
Resolved! Protobuf deserialization in Databricks
Hi,​Let's assume I have these things:Binary column containing protobuf-serialized dataThe .proto file including message definition​What different approaches have Databricks users chosen to deserialize the data? Python is the programming language that...
- 14591 Views
- 13 replies
- 7 kudos
- 7 kudos
We've now added a native connector with parsing directly with Spark Dataframes. https://docs.databricks.com/en/structured-streaming/protocol-buffers.htmlfrom pyspark.sql.protobuf.functions import to_protobuf, from_protobuf schema_registry_options = ...
- 7 kudos
- 3757 Views
- 3 replies
- 1 kudos
Train deep learning model with numpy arrays.
Hey guys,I'm trying to train deep learning model at ML databricks with numpy arrays as input.For now i organized all the data inside DF- df contains 4 columns : col1,col2,col3,col4col1 and col2 have arrays with shape (1,3,3,3,3), col 3 have array wit...
- 3757 Views
- 3 replies
- 1 kudos
- 1 kudos
Maybe you could save some your code. It will be easier to answer and also we could learn deep learning in databricks from your code.
- 1 kudos