GPU NVIDIA

A100 40GB

Architecture · 320GB · PCIe

VRAM
320GB
FP16
-
TDP
-
Hardware Price
-
Cloud from
$3.40/hr
2 providers
Cheapest at Microsoft Azure →

Quick Insights

Performance/Dollar
N/A
FP16 performance per $1000
VRAM/Dollar
N/A
VRAM per $1000
vs null Average
N/A
FP16 TFLOPS comparison
Cloud Availability
2 providers
from $3.40/hr

Specifications

VRAM 320GB
Memory Bandwidth -
FP16 TFLOPS -
Tensor TFLOPS -
FP32 TFLOPS -
TDP -
Form Factor -
Architecture -
NVLink No
Release Date -

Cloud GPU Pricing

Rent A100 40GB from 2 cloud providers. Prices shown per GPU per hour.

Provider Type Instance GPUs On-Demand Per GPU Spot Availability
Microsoft Azure hyperscaler Standard_ND96asr_v4 8x $27.20/hr $3.40/hr Cheapest - -
Amazon Web Services hyperscaler p4d.24xlarge 8x $32.77/hr $4.10/hr $13.07/hr (-60%) -
Best Spot Deal: Amazon Web Services offers spot pricing at $13.07/hr (60% off on-demand).

A100 40GB vs Alternatives

Compare A100 40GB with similar GPUs from other brands.

GPU VRAM FP16 TFLOPS Bandwidth Hardware Price Cloud Price
A100 40GB Current 320GB - - - - -
MI355X AMD 288GB (-10%) - 8.0 TB/s $25k - Compare
MI300X AMD 192GB (-40%) 653.7 5.3 TB/s $18k $1.99/hr Compare

Best Use Cases

No specific use case recommendations for A100 40GB yet.

Browse All Use Cases →

Compare A100 40GB

Other NVIDIA GPUs
Alternatives
Add to Comparison Tool

Frequently Asked Questions about A100 40GB

Pricing for A100 40GB varies. Check our cloud pricing section for rental options starting at $3.40/hr.

Yes, the A100 40GB with 320GB VRAM is suitable for many AI/ML workloads. For large language models, you may need multiple GPUs or consider higher-VRAM options like A100 or H100.

Consider buying for long-term, heavy usage (>4 hrs/day). Rent from cloud providers for short-term projects, experimentation, or when you need to scale quickly.

With 320GB VRAM and - FP16 TFLOPS, the A100 40GB can run: Large language models (7B-13B), Stable Diffusion XL, video AI, and professional 3D rendering.

The A100 40GB offers 320GB VRAM and - FP16 performance at its price point. Compare with similar GPUs using our comparison tool above. Key factors: VRAM for model size, TFLOPS for speed, and price for budget.