NVIDIA data center GPUs comparison table: T4 to B200
In 2020 when A100 was launched by Nvidia. If someone asked what GPU to use for inference, the A100 was our default answer. It was not a bad recommendation at the time. It was genuinely one of the best data center GPUs available, and for a few years there was not a clearly better option built specifically for serving models rather than training them. That stopped being true a while ago, and we...
0 Comments 0 Shares 58 Views 0 Reviews