Data Center AMD

AMD Instinct MI300

CDNA3 Architecture · 128GB HBM3 · OAM

VRAM
128GB
FP16
490.3
TDP
750W
Hardware Price
$15k
Cloud from
-
0 providers

Quick Insights

Performance/Dollar
32.69 TFLOPS/$k
FP16 performance per $1000
VRAM/Dollar
8.5 GB/$k
VRAM per $1000
vs Data Center Average
+173% perf
FP16 TFLOPS comparison
Cloud Availability
Not available
Check providers

Specifications

VRAM 128GB HBM3
Memory Bandwidth 5.3 TB/s
FP16 TFLOPS 490.3
Tensor TFLOPS -
FP32 TFLOPS 122.6
TDP 750W
Form Factor OAM
Architecture CDNA3
NVLink No
Release Date 2023-12

Cloud GPU Pricing

No cloud pricing data available for AMD Instinct MI300 yet.

Browse All Providers →

MI300 vs Alternatives

Compare AMD Instinct MI300 with similar GPUs from other brands.

GPU VRAM FP16 TFLOPS Bandwidth Hardware Price Cloud Price
MI300 Current 128GB 490.3 5.3 TB/s $15k - -
H200 NVIDIA 141GB (+10%) 134.0 (-73%) 4.8 TB/s $38k (+153%) $2.30/hr Compare
NVIDIA H200 NVL NVIDIA 143GB (+12%) - - - $3.39/hr Compare
GH200 NVIDIA 96GB (-25%) - - - $1.49/hr Compare
RTX PRO 6000 MaxQ NVIDIA 96GB (-25%) - - - $0.500/hr Compare
RTX PRO 6000 NVIDIA 96GB (-25%) - - - $1.84/hr Compare

Best Use Cases

No specific use case recommendations for AMD Instinct MI300 yet.

Browse All Use Cases →

Compare MI300

Other AMD GPUs
Alternatives
Add to Comparison Tool

Frequently Asked Questions about MI300

The AMD Instinct MI300 has a market price of approximately $15k. Cloud rental starts at varies by provider. Prices may vary based on retailer, region, and availability.

Yes, the AMD Instinct MI300 with 128GB VRAM is suitable for many AI/ML workloads. For large language models, you may need multiple GPUs or consider higher-VRAM options like A100 or H100.

Consider buying for long-term, heavy usage (>4 hrs/day). Rent from cloud providers for short-term projects, experimentation, or when you need to scale quickly.

With 128GB VRAM and 490.3 FP16 TFLOPS, the AMD Instinct MI300 can run: Large language models (7B-13B), Stable Diffusion XL, video AI, and professional 3D rendering.

The AMD Instinct MI300 offers 128GB VRAM and 490.3 FP16 performance at $15k. Compare with similar GPUs using our comparison tool above. Key factors: VRAM for model size, TFLOPS for speed, and price for budget.