Hardware Price
$12k
MSRP: $15k
Cloud from
$1.15/hr
9 providers
Cheapest at
Paperspace →
Quick Insights
Performance/Dollar
6.50 TFLOPS/$k
FP16 performance per $1000
VRAM/Dollar
6.7 GB/$k
VRAM per $1000
vs Data Center Average
-57% perf
FP16 TFLOPS comparison
Cloud Availability
9 providers
from $1.15/hr
Specifications
| VRAM | 80GB HBM2e |
| Memory Bandwidth | 2.0 TB/s |
| FP16 TFLOPS | 78.0 |
| Tensor TFLOPS | 312.0 |
| FP32 TFLOPS | 19.5 |
| TDP | 400W |
| Form Factor | SXM |
| Architecture | Ampere |
| NVLink | Yes (600GB/s) |
| Release Date | 2020-11 |
Buy vs Rent Analysis
Buy Hardware
$12k
- One-time cost, unlimited usage
- Full control over hardware
- Electricity & cooling costs extra
- Depreciation over 2-3 years
Best if using >10435 hours total
Rent Cloud GPU
$1.15/hr
- Pay only for what you use
- No upfront investment
- Scale up/down instantly
- No maintenance required
Best for <10435 hours or variable usage
Breakeven Point
10,435
hours of usage
At $1.15/hr cloud pricing, buying the hardware pays off after 10,435 hours (~435 days or 14.5 months of 24/7 usage).
| Usage | Monthly Cloud Cost | Months to Breakeven |
|---|---|---|
| 100 hrs/month | $115.00 | 105 months |
| 200 hrs/month | $230.00 | 53 months |
| 500 hrs/month | $575.00 | 21 months |
Cloud GPU Pricing
Rent A100 SXM from 9 cloud providers. Prices shown per GPU per hour.
| Provider | Type | Instance | GPUs | On-Demand | Per GPU | Spot | Availability |
|---|---|---|---|---|---|---|---|
| Paperspace | gpu-cloud | paperspace-a100-80gb-sxm | 1x | $1.15/hr | $1.15/hr Cheapest | - | - |
| Datacrunch (Verda) | gpu-cloud | datacrunch-a100-80gb-sxm | 1x | $1.29/hr | $1.29/hr | - | - |
| Jarvis Labs | gpu-cloud | jarvislabs-a100-80gb-sxm | 1x | $1.29/hr | $1.29/hr | - | - |
| Fluidstack | gpu-cloud | fluidstack-a100-80gb-sxm | 1x | $1.30/hr | $1.30/hr | - | - |
| TensorDock | marketplace | tensordock-a100-80gb-sxm | 1x | $1.50/hr | $1.50/hr | - | - |
| RunPod | gpu-cloud | NVIDIA A100-SXM4-80GB | 1x | $1.59/hr | $1.59/hr | $1.59/hr | - |
| Lambda Labs | gpu-cloud | lambda-a100-80gb-sxm | 1x | $2.79/hr | $2.79/hr | - | - |
| Google Cloud Platform | hyperscaler | gcp-a10080gb | 1x | $3.93/hr | $3.93/hr | $1.57/hr (-60%) | - |
| CoreWeave | gpu-cloud | coreweave-a100-80gb-sxm | 1x | $6.16/hr | $6.16/hr | - | - |
Best Spot Deal:
Google Cloud Platform
offers spot pricing at $1.57/hr
(60% off on-demand).
A100 SXM vs Alternatives
Compare A100 SXM with similar GPUs from other brands.
| GPU | VRAM | FP16 TFLOPS | Bandwidth | Hardware Price | Cloud Price | |
|---|---|---|---|---|---|---|
| A100 SXM Current | 80GB | 78.0 | 2.0 TB/s | $12k | - | - |
| AMD Instinct MI210 AMD | 64GB (-20%) | 181.0 (+132%) | 1.6 TB/s | - | - | Compare |
| MI300 AMD | 128GB (+60%) | 490.3 (+529%) | 5.3 TB/s | $15k (+25%) | - | Compare |
| AMD Instinct MI300A AMD | 128GB (+60%) | 980.0 (+1156%) | 5.3 TB/s | - | - | Compare |
| AMD Instinct MI250X AMD | 128GB (+60%) | 383.0 (+391%) | 3.3 TB/s | - | - | Compare |
| AMD Instinct MI250 AMD | 128GB (+60%) | 362.0 (+364%) | 3.3 TB/s | - | - | Compare |
Compare A100 SXM
Alternatives
- AMD Instinct MI210 64GB · -
- MI300 128GB · $15k
- AMD Instinct MI300A 128GB · -
- AMD Instinct MI250X 128GB · -
- AMD Instinct MI250 128GB · -
