About the NVIDIA RTX 4090
The NVIDIA RTX 4090 is the most popular GPU for hobbyist and indie AI work — Stable Diffusion image generation, small-model fine-tuning, local LLM inference. It's a consumer card (not officially supported by AWS/GCP/Azure) but widely available via community-tier providers like Vast.ai, RunPod, and Salad at extremely low prices. 24GB VRAM fits most consumer AI workflows.
Specs
What's it good for?
- Stable Diffusion / SDXL — image generation at fast iteration speeds.
- Llama 3 8B fine-tuning — QLoRA / LoRA fits comfortably in 24GB.
- Local LLM inference — run 7B-13B models at full precision, or 30B+ quantized.
- Hobbyist / learning — by far the most cost-effective way to experiment with modern AI.
When to use RTX 4090 vs alternatives
- RTX 4090 vs RTX 3090: 4090 is ~70% faster, same 24GB VRAM. The 3090 is cheaper if you find it; 4090 wins on speed-per-dollar at typical rental rates.
- RTX 4090 vs A10: 4090 is dramatically faster, similar VRAM. Use A10 only for cheap inference; 4090 for anything that needs training speed.
- RTX 4090 vs A100 80GB: A100 has 3× the VRAM and ECC memory. Use A100 for models that exceed 24GB or for production reliability; 4090 for experimentation.
Rent or buy? The break-even math.
Renting an RTX 4090 at a few cents per hour and buying a used one for around $1,600 sound like completely different decisions. But at some usage rate they equalize. Here's exactly when.
Used on eBay
—
avg sold-listings price
Break-even at 8 hours/day
—
—
—
—
How this changes with usage
Break-even scales linearly with how many hours per day you'd run the card. Common scenarios:
- Casual (2h/day): break-even ≈ —
- Workday (8h/day): break-even ≈ —
- Heavy (16h/day): break-even ≈ —
- 24/7 batch: break-even ≈ —
The unspoken costs of buying
The pure hourly math undersells a few real costs on the buy side:
- Electricity: A 4090 pulls ~450W under load. At the US average $0.16/kWh, running one 8 hours a day adds ~$21/month to your power bill.
- Cooling and noise: your room becomes a heat vent; some people need dedicated AC in summer.
- Depreciation: GPUs lose 30-50% of value per generation. If you sell in 2 years, factor that in.
- Zero upside on downtime: a rental provider handles a dead card; you're stuck buying another one.
So even when the raw break-even says "buy," add ~$25/month in operating costs and about 30% total depreciation over 2 years before deciding.
See sold listings on
eBay ↗