Why is pytorch cuda total memory not aligned with the memory size of GPU cluster I created?

zzy
New Contributor III

No matter GPU cluster of which size I create, cuda total capacity is always ~16 Gb. Does anyone know what is the issue?

The code I use to get the total capacity:

torch.cuda.get_device_properties(0).total_memory