Hubert-Dudek
Databricks MVP

For CSV, you need just to readStream in the notebook and append output to CSV using forEachBatch method.

Your Kafka on PC needs to have the public address or you need to set AWS VPN and connect from your laptop to be in the same VPC as databricks.


My blog: https://databrickster.medium.com/

View solution in original post