Data Center AMD

AMD Instinct MI300A

CDNA 3 Architecture · 128GB HBM3 · PCIe

VRAM
128GB
FP16
980.0
TDP
760W
Hardware Price
-
MSRP: $12k
Cloud from
-
0 providers

Quick Insights

Performance/Dollar
N/A
FP16 performance per $1000
VRAM/Dollar
N/A
VRAM per $1000
vs Data Center Average
+446% perf
FP16 TFLOPS comparison
Cloud Availability
Not available
Check providers

Specifications

VRAM 128GB HBM3
Memory Bandwidth 5.3 TB/s
FP16 TFLOPS 980.0
Tensor TFLOPS 2.0k
FP32 TFLOPS 122.6
TDP 760W
Form Factor -
Architecture CDNA 3
NVLink No
Release Date 2023-12-06

Cloud GPU Pricing

No cloud pricing data available for AMD Instinct MI300A yet.

Browse All Providers →

AMD Instinct MI300A vs Alternatives

Compare AMD Instinct MI300A with similar GPUs from other brands.

GPU VRAM FP16 TFLOPS Bandwidth Hardware Price Cloud Price
AMD Instinct MI300A Current 128GB 980.0 5.3 TB/s - - -
H200 NVIDIA 141GB (+10%) 134.0 (-86%) 4.8 TB/s $38k $2.30/hr Compare
NVIDIA H200 NVL NVIDIA 143GB (+12%) - - - $3.39/hr Compare
GH200 NVIDIA 96GB (-25%) - - - $1.49/hr Compare
RTX PRO 6000 MaxQ NVIDIA 96GB (-25%) - - - $0.500/hr Compare
RTX PRO 6000 NVIDIA 96GB (-25%) - - - $1.84/hr Compare

Best Use Cases

No specific use case recommendations for AMD Instinct MI300A yet.

Browse All Use Cases →

Compare AMD Instinct MI300A

Other AMD GPUs
Alternatives
Add to Comparison Tool

Frequently Asked Questions about AMD Instinct MI300A

Pricing for AMD Instinct MI300A varies. Check our cloud pricing section for rental options starting at various rates.

Yes, the AMD Instinct MI300A with 128GB VRAM is suitable for many AI/ML workloads. For large language models, you may need multiple GPUs or consider higher-VRAM options like A100 or H100.

Consider buying for long-term, heavy usage (>4 hrs/day). Rent from cloud providers for short-term projects, experimentation, or when you need to scale quickly.

With 128GB VRAM and 980.0 FP16 TFLOPS, the AMD Instinct MI300A can run: Large language models (7B-13B), Stable Diffusion XL, video AI, and professional 3D rendering.

The AMD Instinct MI300A offers 128GB VRAM and 980.0 FP16 performance at its price point. Compare with similar GPUs using our comparison tool above. Key factors: VRAM for model size, TFLOPS for speed, and price for budget.