Hi @Ivan_Pyrog ,

java.util.concurrent.ExecutionException: kafkashaded.org.apache.kafka.common.errors.TimeoutException: Timed out waiting for a node assignment. Call: describeTopics ​<p><strong>Caused by: kafkashaded.org.apache.kafka.common.errors.TimeoutException: Timed out waiting for a node assignment. Call: describeTopics</strong></p><p> </p>

Looking at the above error it is seems that the above errors are occuring due to no network connectivity between Databricks and Kafka cluster. Please make sure that telnet or nc commands should be successful before trying to execute any code to Kafka cluster.

for example

 %sh telnet b-2.scram.cxdevorderbrokerstr<>xyz 14002

Also, make sure to enable SSL connections if Kafka cluster requires SSL connection. Please refer below link for SSL connection code snippet:

[+] https://docs.databricks.com/en/structured-streaming/kafka.html