Data Center AMD

AMD Instinct MI300X

CDNA3 Architecture · 192GB HBM3 · OAM

VRAM
192GB
FP16
653.7
TDP
750W
Hardware Price
$18k
MSRP: $15k
Cloud from
$1.99/hr
1 providers
Cheapest at RunPod →

Quick Insights

Performance/Dollar
36.32 TFLOPS/$k
FP16 performance per $1000
VRAM/Dollar
10.7 GB/$k
VRAM per $1000
vs Data Center Average
+264% perf
FP16 TFLOPS comparison
Cloud Availability
1 providers
from $1.99/hr

Specifications

VRAM 192GB HBM3
Memory Bandwidth 5.3 TB/s
FP16 TFLOPS 653.7
Tensor TFLOPS -
FP32 TFLOPS 163.4
TDP 750W
Form Factor OAM
Architecture CDNA3
NVLink No
Release Date 2023-12

Buy vs Rent Analysis

Buy Hardware
$18k
  • One-time cost, unlimited usage
  • Full control over hardware
  • Electricity & cooling costs extra
  • Depreciation over 2-3 years
Best if using >9045 hours total
Rent Cloud GPU
$1.99/hr
  • Pay only for what you use
  • No upfront investment
  • Scale up/down instantly
  • No maintenance required
Best for <9045 hours or variable usage
Breakeven Point
9,045
hours of usage

At $1.99/hr cloud pricing, buying the hardware pays off after 9,045 hours (~377 days or 12.6 months of 24/7 usage).

Usage Monthly Cloud Cost Months to Breakeven
100 hrs/month $199.00 91 months
200 hrs/month $398.00 46 months
500 hrs/month $995.00 19 months

Cloud GPU Pricing

Rent AMD Instinct MI300X from 1 cloud providers. Prices shown per GPU per hour.

Provider Type Instance GPUs On-Demand Per GPU Spot Availability
RunPod gpu-cloud AMD Instinct MI300X OAM 1x $1.99/hr $1.99/hr Cheapest $1.49/hr (-25%) -
Best Spot Deal: RunPod offers spot pricing at $1.49/hr (25% off on-demand).

MI300X vs Alternatives

Compare AMD Instinct MI300X with similar GPUs from other brands.

GPU VRAM FP16 TFLOPS Bandwidth Hardware Price Cloud Price
MI300X Current 192GB 653.7 5.3 TB/s $18k - -
B200 NVIDIA 192GB (+0%) - 8.0 TB/s $45k (+150%) $3.75/hr Compare
B200 SXM6 NVIDIA 180GB (-6%) - - - $4.99/hr Compare
NVIDIA H200 NVL NVIDIA 143GB (-26%) - - - $3.39/hr Compare
H200 NVIDIA 141GB (-27%) 134.0 (-80%) 4.8 TB/s $38k (+111%) $2.30/hr Compare
GH200 NVIDIA 96GB (-50%) - - - $1.49/hr Compare

Best Use Cases for MI300X

🧠
LLM Training
4/5

AMD training option
⚡
AI Inference
4/5

High VRAM inference

Compare MI300X

Popular Comparisons
Other AMD GPUs
Alternatives
Add to Comparison Tool

Frequently Asked Questions about MI300X

The AMD Instinct MI300X has a market price of approximately $18k (MSRP: $15k). Cloud rental starts at $1.99/hr. Prices may vary based on retailer, region, and availability.

Yes, the AMD Instinct MI300X with 192GB VRAM is suitable for many AI/ML workloads. It's particularly recommended for LLM Training. For large language models, you may need multiple GPUs or consider higher-VRAM options like A100 or H100.

The breakeven point is approximately 9,045 hours of usage. Buy if you'll use it more than this; rent for shorter projects or variable workloads. Cloud rental from RunPod starts at $1.99/hr.

With 192GB VRAM and 653.7 FP16 TFLOPS, the AMD Instinct MI300X can run: Large language models (7B-13B), Stable Diffusion XL, video AI, and professional 3D rendering.

The AMD Instinct MI300X offers 192GB VRAM and 653.7 FP16 performance at $18k. Compare with similar GPUs using our comparison tool above. Key factors: VRAM for model size, TFLOPS for speed, and price for budget.