cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Error cluster launch: Security Daemon Registration

FerArribas
Contributor

I have created a workspace in AWS with private link. When we launch a cluster we get the following error: "Security Daemon Registration Exception: Failed to set up the spark container due to an error when registering the container to security daemon"

The log (in a cluster workspace instance) stays in a loop at:

[ 348.935443] audit: kauditd hold queue overflow

[ 348.940183] audit: kauditd hold queue overflow

[ 348.946439] audit: kauditd hold queue overflow

[ 354.013288] audit: kauditd hold queue overflow

[ 354.019590] audit: kauditd hold queue overflow

[ 354.025712] audit: kauditd hold queue overflow

[ 475.998259] audit: kauditd hold queue overflow

[ 476.004062] audit: kauditd hold queue overflow

[ 476.009494] audit: kauditd hold queue overflow

[ 638.997129] audit: kauditd hold queue overflow

[ 639.005763] audit: kauditd hold queue overflow

[ 639.012236] audit: kauditd hold queue overflow

Thanks,

1 ACCEPTED SOLUTION

Accepted Solutions

Sivaprasad1
Valued Contributor II

@Fernando Arribas Jara​ : Is it a terraform deployment? Do you see any STS endpoint in it? if yes, could you please delete it and try

View solution in original post

2 REPLIES 2

Sivaprasad1
Valued Contributor II

@Fernando Arribas Jara​ : Is it a terraform deployment? Do you see any STS endpoint in it? if yes, could you please delete it and try

FerArribas
Contributor

Thanks @Sivaprasad C S​  It's already working. The problem was that the AWS STS private link was wrongly associated with the correct subnet.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group