Quick Insights
Performance/Dollar
20.33 TFLOPS/$k
FP16 performance per $1000
VRAM/Dollar
5.3 GB/$k
VRAM per $1000
vs Data Center Average
+2% perf
FP16 TFLOPS comparison
Cloud Availability
4 providers
from $0.860/hr
Specifications
| VRAM | 48GB GDDR6 |
| Memory Bandwidth | 864 GB/s |
| FP16 TFLOPS | 183.0 |
| Tensor TFLOPS | 733.0 |
| FP32 TFLOPS | 91.6 |
| TDP | 350W |
| Form Factor | PCIe |
| Architecture | Ada Lovelace |
| NVLink | No |
| Release Date | 2023-08 |
Buy vs Rent Analysis
Buy Hardware
$9.0k
- One-time cost, unlimited usage
- Full control over hardware
- Electricity & cooling costs extra
- Depreciation over 2-3 years
Best if using >10465 hours total
Rent Cloud GPU
$0.860/hr
- Pay only for what you use
- No upfront investment
- Scale up/down instantly
- No maintenance required
Best for <10465 hours or variable usage
Breakeven Point
10,465
hours of usage
At $0.860/hr cloud pricing, buying the hardware pays off after 10,465 hours (~436 days or 14.5 months of 24/7 usage).
| Usage | Monthly Cloud Cost | Months to Breakeven |
|---|---|---|
| 100 hrs/month | $86.00 | 105 months |
| 200 hrs/month | $172.00 | 53 months |
| 500 hrs/month | $430.00 | 21 months |
Cloud GPU Pricing
Rent NVIDIA L40S from 4 cloud providers. Prices shown per GPU per hour.
| Provider | Type | Instance | GPUs | On-Demand | Per GPU | Spot | Availability |
|---|---|---|---|---|---|---|---|
| RunPod | gpu-cloud | NVIDIA L40S | 1x | $0.860/hr | $0.860/hr Cheapest | $0.260/hr (-70%) | - |
| Datacrunch (Verda) | gpu-cloud | datacrunch-l40s | 1x | $0.910/hr | $0.910/hr | - | - |
| Fluidstack | gpu-cloud | fluidstack-l40s | 1x | $1.30/hr | $1.30/hr | - | - |
| CoreWeave | gpu-cloud | coreweave-l40s | 1x | $2.25/hr | $2.25/hr | - | - |
Best Spot Deal:
RunPod
offers spot pricing at $0.260/hr
(70% off on-demand).
L40S vs Alternatives
Compare NVIDIA L40S with similar GPUs from other brands.
| GPU | VRAM | FP16 TFLOPS | Bandwidth | Hardware Price | Cloud Price | |
|---|---|---|---|---|---|---|
| L40S Current | 48GB | 183.0 | 864 GB/s | $9.0k | - | - |
| AMD Instinct MI210 AMD | 64GB (+33%) | 181.0 (-1%) | 1.6 TB/s | - | - | Compare |
| AMD Instinct MI100 AMD | 32GB (-33%) | 184.6 (+1%) | 1.2 TB/s | - | - | Compare |
| AMD Radeon RX 7900 XTX AMD | 24GB (-50%) | 122.0 (-33%) | 960 GB/s | - | - | Compare |
Best Use Cases for L40S
Compare L40S
Popular Comparisons
Alternatives
- AMD Instinct MI210 64GB · -
- AMD Instinct MI100 32GB · -
- AMD Radeon RX 7900 XTX 24GB · -