Error cluster launch: Security Daemon Registration

FerArribas — Fri, 07 Oct 2022 13:51:00 GMT

I have created a workspace in AWS with private link. When we launch a cluster we get the following error: "Security Daemon Registration Exception: Failed to set up the spark container due to an error when registering the container to security daemon"

The log (in a cluster workspace instance) stays in a loop at:

[ 348.935443] audit: kauditd hold queue overflow

[ 348.940183] audit: kauditd hold queue overflow

[ 348.946439] audit: kauditd hold queue overflow

[ 354.013288] audit: kauditd hold queue overflow

[ 354.019590] audit: kauditd hold queue overflow

[ 354.025712] audit: kauditd hold queue overflow

[ 475.998259] audit: kauditd hold queue overflow

[ 476.004062] audit: kauditd hold queue overflow

[ 476.009494] audit: kauditd hold queue overflow

[ 638.997129] audit: kauditd hold queue overflow

[ 639.005763] audit: kauditd hold queue overflow

[ 639.012236] audit: kauditd hold queue overflow

Thanks,

Re: Error cluster launch: Security Daemon Registration

Sivaprasad1 — Fri, 07 Oct 2022 17:04:44 GMT

@Fernando Arribas Jara : Is it a terraform deployment? Do you see any STS endpoint in it? if yes, could you please delete it and try

Re: Error cluster launch: Security Daemon Registration

FerArribas — Mon, 10 Oct 2022 18:45:13 GMT

Thanks @Sivaprasad C S It's already working. The problem was that the AWS STS private link was wrongly associated with the correct subnet.

topic Re: Error cluster launch: Security Daemon Registration in Data Engineering

Error cluster launch: Security Daemon Registration

Re: Error cluster launch: Security Daemon Registration

Re: Error cluster launch: Security Daemon Registration