NVIDIA A100 Tensor Core GPU
An NVIDIA A100 Tensor Core GPU is an Nvidia GPU that is a commercial GPU.
- Context:
- It can (typically) be based on a Nvidia Ampere Microarchitecture.
- ...
- Example(s):
- A100 80GB.
- ...
- Counter-Example(s):
- See: GPU, Nvidia Consumer GPU.
References
2023
- https://www.nvidia.com/en-us/data-center/a100/
- QUOTE: ... NVIDIA A100 Tensor Core GPU delivers unprecedented acceleration at every scale to power the world’s highest-performing elastic data centers for AI, data analytics, and HPC. Powered by the NVIDIA Ampere Architecture, A100 is the engine of the NVIDIA data center platform. A100 provides up to 20X higher performance over the prior generation and can be partitioned into seven GPU instances to dynamically adjust to shifting demands. The A100 80GB debuts the world’s fastest memory bandwidth at over 2 terabytes per second (TB/s) to run the largest models and datasets. ...
2023
- https://arstechnica.com/information-technology/2023/03/you-can-now-run-a-gpt-3-level-ai-model-on-your-laptop-phone-and-raspberry-pi/
- QUOTE: ... Typically, running GPT-3 requires several datacenter-class A100 GPUs (also, the weights for GPT-3 are not public), but LLaMA made waves because it could run on a single beefy consumer GPU. And now, with optimizations that reduce the model size using a technique called quantization, LLaMA can run on an M1 Mac or a lesser Nvidia consumer GPU. ...