Hardware Price
-
Cloud from
$3.40/hr
2 providers
Cheapest at
Microsoft Azure →
Quick Insights
Performance/Dollar
N/A
FP16 performance per $1000
VRAM/Dollar
N/A
VRAM per $1000
vs null Average
N/A
FP16 TFLOPS comparison
Cloud Availability
2 providers
from $3.40/hr
Specifications
| VRAM | 40GB |
| Memory Bandwidth | - |
| FP16 TFLOPS | - |
| Tensor TFLOPS | - |
| FP32 TFLOPS | - |
| TDP | - |
| Form Factor | - |
| Architecture | - |
| NVLink | No |
| Release Date | - |
Cloud GPU Pricing
Rent A100 40GB from 2 cloud providers. Prices shown per GPU per hour.
| Provider | Type | Instance | GPUs | On-Demand | Per GPU | Spot | Availability |
|---|---|---|---|---|---|---|---|
| Microsoft Azure | hyperscaler | Standard_ND96asr_v4 | 8x | $27.20/hr | $3.40/hr Cheapest | - | - |
| Amazon Web Services | hyperscaler | p4d.24xlarge | 8x | $32.77/hr | $4.10/hr | $13.07/hr (-60%) | - |
Best Spot Deal:
Amazon Web Services
offers spot pricing at $13.07/hr
(60% off on-demand).
A100 40GB vs Alternatives
Compare A100 40GB with similar GPUs from other brands.
| GPU | VRAM | FP16 TFLOPS | Bandwidth | Hardware Price | Cloud Price | |
|---|---|---|---|---|---|---|
| A100 40GB Current | 40GB | - | - | - | - | - |
| AMD Instinct MI100 AMD | 32GB (-20%) | 184.6 | 1.2 TB/s | - | - | Compare |
| AMD Radeon RX 7900 XTX AMD | 24GB (-40%) | 122.0 | 960 GB/s | - | - | Compare |
| AMD Radeon RX 7900 XT AMD | 20GB (-50%) | 104.0 | 800 GB/s | - | - | Compare |
| AMD Instinct MI210 AMD | 64GB (+60%) | 181.0 | 1.6 TB/s | - | - | Compare |
Best Use Cases
No specific use case recommendations for A100 40GB yet.
Browse All Use Cases →Compare A100 40GB
Alternatives
- AMD Instinct MI100 32GB · -
- AMD Radeon RX 7900 XTX 24GB · -
- AMD Radeon RX 7900 XT 20GB · -
- AMD Instinct MI210 64GB · -
