topic Re: Why is pytorch cuda total memory not aligned with the memory size of GPU cluster I created? in Data Engineering

Why is pytorch cuda total memory not aligned with the memory size of GPU cluster I created?

zzy — Wed, 01 Feb 2023 16:22:06 GMT

No matter GPU cluster of which size I create, cuda total capacity is always ~16 Gb. Does anyone know what is the issue?

The code I use to get the total capacity:

torch.cuda.get_device_properties(0).total_memory

Re: Why is pytorch cuda total memory not aligned with the memory size of GPU cluster I created?

zzy — Thu, 02 Feb 2023 08:46:43 GMT

Hi, the DBR version is 11.3 LTS ML. The instance types I created is g4dn.

Re: Why is pytorch cuda total memory not aligned with the memory size of GPU cluster I created?

Anonymous — Sun, 09 Apr 2023 02:30:30 GMT

Hi @Simon Zhang

Hope everything is going great.

Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we can help you.

Cheers!

Re: Why is pytorch cuda total memory not aligned with the memory size of GPU cluster I created?

Debayan — Thu, 02 Feb 2023 06:11:21 GMT

Hi, Could you please let us know which DBR has been installed? Also, please let us know if you have gone the supported instance types. Reference: https://docs.databricks.com/clusters/gpu.html.