cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

AWS + Cluster with custom docker image = export metrics to CloudWatch?

ivanychev
Contributor

Is there a working setup on setting up metrics export to CloudWatch while using custom docker images for cluster creation?

I've tried to set up the CloudWatch agent manually, but launching `amzon-cloudwatch-agent-ctl` in the bootstrap script fails with

`sysv-init is not supported`

It is probably caused by the fact that it's launched in a Docker container, and it's not using `systemd`.

3 REPLIES 3

Atanu
Esteemed Contributor
Esteemed Contributor

I am not sure, if this works with custom docker (probably not.)

But should work with normal cluster.

Integration Steps is adding as a text file.Please take a look @Sergey Ivanychev​ 

Thanks! My question is specifically about custom docker. I managed to set up CloudWatch for a normal cluster myself.

Atanu
Esteemed Contributor
Esteemed Contributor

We do not support gangila with custom docker too. but let me cross verify if we are supporting cloudwatch for the same. Sorry for the inconvenience @Sergey Ivanychev​ 

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.