Hello @jaytimbadia,
When you run the nvidia-smi
command, it reports the GPU memory, which is why you are seeing approximately 16GB. The 56GB refers to the overall system memory available for the instance, not the memory available on the GPU itself.
The discrepancy you are observing is due to the difference between the total system memory and the GPU memory. The Standard_NC8as_T4_v3 instance type has a total of 56GB of system memory (RAM), but the NVIDIA T4 GPU within this instance has only 16GB of GPU memory