| Main Specifications | |
| Product Series | Nvidia A2 |
| Core Type | NVIDIA TENSOR |
| Core Clock Speed | 1440 MHz (1770 MHz Boost Clock) |
| Host Interface | PCI Express 4.0 x8 |
| GPU Architecture | Ampere |
| Detailed Specifications | |
| Streaming Processor Cores | 1280 CUDA Cores |
| NVIDIA Tensor Cores | 40 | Gen 3 |
| NVIDIA RT Cores | 10 | Gen 2 |
| Memory Clock Speed | 6251 MHz |
| Memory Interface | 128-bit |
| Max Memory Size | 16 GB GDDR6 ECC |
| Max Memory Bandwidth | 200 GB/s |
| Peak FP32 | 4.5 TFLOPS |
| Peak TF32 Tensor Core | 9 TFLOPS | 18 TFLOPS Sparsity |
| Peak FP16 Tensor Core | 18 TFLOPS | 36 TFLOPS Sparsity |
| NVIDIA CUDA™ Technology | 11.1 or later |
| Peak INT4 Performance | 72 TOPS | 144 TOPS Sparsity |
| Peak INT8 Performance | 36 TOPS | 72 TOPS Sparsity |
| ECC Protection | On by Default |
| Cooling | Passive |
| Dual Slot | Single-slot |
| Dimensions | 6.61” L x 2.71” H |
| Form Factor | Low-Profile PCIe |
| Max Graphics Card Power (W) | 40-60 W | Configurable |
