cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Single-Node cluster works but Multi-Node clusters do not read data.

TheDataDexter
New Contributor III

I am currently working with a VNET injected databricks workspace. At the moment I have mounted a the databricks cluster on an ADLS G2 resource.

When running notebooks on a single node that read, transform, and write data we do not encounter any problems. However, when I run the same notebook on a multi-node cluster the spark job enters into an infinite waiting stage.

When looking deeper into the Spark cluster UI I find an active stage: "load at NativeMethodAccessorImpl.java:0 (Stage 2.0)". When going to the stage page we get a 403 error - Invalid or missing CSRF token.

Interestingly, for testing purposes we've deployed a databricks workspace without VNET injection. There we make use of a multi-node clusters without any issues.

1 ACCEPTED SOLUTION

Accepted Solutions

-werners-
Esteemed Contributor III

Could it be your whitelisted firewall IP-ranges? wrong CIDR-interval?

Every note will have a separate IP-address, so if your firewall is not configured correctly, the nodes cannot communicate.

View solution in original post

4 REPLIES 4

-werners-
Esteemed Contributor III

Could it be your whitelisted firewall IP-ranges? wrong CIDR-interval?

Every note will have a separate IP-address, so if your firewall is not configured correctly, the nodes cannot communicate.

Kaniz_Fatma
Community Manager
Community Manager

Hi @Derrick Bakhuis​ , Does @Werner Stinckens​ 's reply answer your query?

TheDataDexter
New Contributor III

@Werner Stinckens​ thank you for your reply. I will take a look into the netwerk configurations today.

ellafj
New Contributor II

@TheDataDexter Did you find a solution to your problem? I am facing the same issue

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!