Price Highlights
About Microsoft Azure
Key Features
- Enterprise SLAs
- Azure integration
- Spot VMs
- Reserved instances
Best For
- Microsoft ecosystem users
- Enterprise AI
- Hybrid cloud
Considerations
- Premium pricing
- Availability can be limited
Microsoft Azure Cost Planning Notes
Azure GPU pricing searches usually mean more than the name of one VM SKU. Buyers compare H100, A100, and T4 availability, Azure GPU VM pricing, on-demand versus spot capacity, and the trade-off between Microsoft ecosystem integration and total hourly cost.
Azure GPU pricing by VM and GPU
Use the live pricing table below to compare the tracked Azure GPU VM rows by instance type, GPU count, on-demand rate, per-GPU rate, spot rate, and availability. The same GPU can have a different effective price when the VM includes multiple accelerators or a different configuration.
Azure H100, A100, and T4 fit
H100 is generally considered for demanding training and inference, A100 remains useful for established CUDA workloads, and T4 can be a practical lower-cost option for lighter inference or media workloads. Confirm the exact Azure region, VM family, and capacity before treating a comparison as a quote.
On-demand versus spot GPU cost
Spot capacity can reduce the headline Azure GPU price, but interruption risk changes the real cost. It is better suited to checkpointed training, batch jobs, and experiments than to latency-sensitive services that cannot tolerate eviction.
Azure GPU VM pricing checklist
Compare the per-GPU rate, region, VM size, attached storage, network transfer, startup time, and expected utilization. A lower hourly GPU number is not automatically cheaper if the workload needs extra host resources or frequent restarts.
| Cost check | Why it matters |
|---|---|
| Check 1 | Filter the table to the GPU family and VM configuration that actually fits the model, then compare per-GPU cost instead of only the full-instance price. |
| Check 2 | For H100 or A100 workloads, record region and availability alongside price because a nominally cheaper row is not useful if capacity is unavailable when the job starts. |
| Check 3 | For spot tests, budget checkpoint storage and restart time before comparing the discount with on-demand Azure GPU capacity. |
H100 Price Comparison
Compare Microsoft Azure's H100 pricing with other enterprise providers.
| Provider | H100 Price (per GPU) | vs Microsoft Azure |
|---|---|---|
| Google Cloud Platform | $9.80/hr | -20% |
| Oracle Cloud | $10.75/hr | -13% |
| Amazon Web Services | $12.29/hr | 0% |
| Microsoft Azure Current | $12.29/hr | - |
All GPU Pricing
| GPU | VRAM | Instance | GPUs | On-Demand | Per GPU | Spot | Availability |
|---|---|---|---|---|---|---|---|
| H100 | 80GB | Standard_ND96isr_H100_v5 | 8x | $98.32/hr | $12.29/hr Cheapest | - | - |
| GPU | VRAM | Instance | GPUs | On-Demand | Per GPU | Spot | Availability |
|---|---|---|---|---|---|---|---|
| T4 | 16GB | Standard_NC16as_T4_v3 | 1x | $1.20/hr | $1.20/hr | - | - |
| V100 | 16GB | Standard_NC12s_v3 | 2x | $6.12/hr | $3.06/hr | - | - |
| A100 80GB | 80GB | Standard_NC48ads_A100_v4 | 2x | $7.35/hr | $3.67/hr | - | - |
| V100 | 16GB | Standard_NC6s_v3 | 1x | $3.06/hr | $3.06/hr | - | - |
| T4 | 16GB | Standard_NC8as_T4_v3 | 1x | $0.752/hr | $0.752/hr | - | - |
| A100 80GB | 80GB | Standard_NC96ads_A100_v4 | 4x | $14.69/hr | $3.67/hr | - | - |
| T4 | 16GB | Standard_NC4as_T4_v3 | 1x | $0.526/hr | $0.526/hr | - | - |
| A100 80GB | 80GB | Standard_NC24ads_A100_v4 | 1x | $3.67/hr | $3.67/hr | - | - |
| T4 | 16GB | Standard_NC64as_T4_v3 | 4x | $4.35/hr | $1.09/hr | - | - |
| V100 | 16GB | Standard_NC24rs_v3 | 4x | $13.46/hr | $3.37/hr | - | - |
| V100 | 16GB | Standard_NC24s_v3 | 4x | $12.24/hr | $3.06/hr | - | - |
| A100 80GB | 80GB | Standard_ND96amsr_A100_v4 | 8x | $32.77/hr | $4.10/hr | - | - |
| A100 40GB | 40GB | Standard_ND96asr_v4 | 8x | $27.20/hr | $3.40/hr | - | - |
| A10 | 24GB | Standard_NV36ads_A10_v5 | 1x | $3.20/hr | $3.20/hr | - | - |
| A10 | 24GB | Standard_NV36adms_A10_v5 | 1x | $4.52/hr | $4.52/hr | - | - |
| A10 | 24GB | Standard_NV6ads_A10_v5 | 1x | $0.454/hr | $0.454/hr Cheapest | - | - |
| A10 | 24GB | Standard_NV12ads_A10_v5 | 1x | $0.908/hr | $0.908/hr | - | - |
| A10 | 24GB | Standard_NV72ads_A10_v5 | 2x | $6.52/hr | $3.26/hr | - | - |
| A10 | 24GB | Standard_NV18ads_A10_v5 | 1x | $1.60/hr | $1.60/hr | - | - |
Similar Providers
Other enterprise cloud providers you might consider.
