toolspool

Compare tools

Side-by-side features, use cases and pricing — because the right pick depends on your job and budget, not just the ranking.

Fireworks AI logo
Fireworks AI
✓ verifiedPaid

Developer platform for fast serverless inference and training of open generative models, billed per token or GPU-second.

611K visits/mo1.3K saves
Deep Infra logo
Deep Infra
✓ verifiedPaid

Low-cost inference cloud with developer APIs to run open ML models and on-demand GPUs, billed pay-per-use.

375K visits/mo
Runpod logo
Runpod
✓ verifiedPaid

Developer-focused GPU cloud offering on-demand pods, serverless inference and multi-node clusters at per-second pricing for AI workloads.

2.3M visits/mo
Nebius logo
Nebius
✓ verifiedPaid

AI-focused cloud offering NVIDIA GPU compute, storage and MLOps tooling for training and inference at scale, with usage-based pricing.

678K visits/mo133K saves
Evolink AI Model API logo
Evolink AI Model API
✓ verifiedPaid

One API to access leading LLM, image, video, and audio models with pay-as-you-go, usage-based pricing.

363K visits/mo1.5K saves
Pricing
On-Demand H100/H200: $7/GPU-hour
On-Demand B200: $10/GPU-hour
On-Demand B300: $12/GPU-hour
Fine-tuning (LoRA SFT, models up to 16B): from $0.50 per 1M training tokens

No public pricing

Pods A40 48GB: $0.44/hr
Pods RTX 4090 24GB: $0.69/hr
Pods A100 SXM 80GB: $1.49/hr
Pods H100 SXM 80GB: $2.99/hr
Pods H200 141GB: $4.39/hr
Pods B300 288GB: $7.39/hr
NVIDIA H100: $3.85/GPU-hour on-demand ($2.15 preemptible)
NVIDIA H200: $4.50/GPU-hour on-demand
NVIDIA B200: $7.15/GPU-hour on-demand
Shared filesystem storage: $0.08/GiB per month
Usage-based pay-as-you-go (e.g., Seedance 2.0 $0.198/s, GPT Image 2 from $0.015/image)
Core features
  • Serverless per-token inference with OpenAI/Anthropic-compatible APIs
  • On-demand dedicated and reserved GPU deployments
  • Fine-tuning and reinforcement-learning training pipelines
  • Large library of open LLM, vision, image and audio models
  • Optimized inference engine for throughput and latency
  • Hosted inference for many open models
  • Simple REST/OpenAI-compatible API
  • Pay-per-token or per-time billing
  • On-demand GPU rental
  • Broad catalog (Llama, DeepSeek, Qwen, Flux, etc.)
  • DeepStart and DeepCluster tooling
  • On-demand GPU pods across 30+ GPU types and 31 regions
  • Serverless GPU endpoints with sub-200ms cold starts
  • Zero idle cost billing for inference workloads
  • Multi-node clusters for distributed training
  • Persistent network storage for full pipelines
  • Real-time logs, monitoring and autoscaling from 0 to hundreds of workers
  • NVIDIA GPU instances (H100, H200, B200, GB200)
  • On-demand and preemptible GPU pricing
  • High-performance and object storage
  • Managed Kubernetes and Slurm (Soperator)
  • Serverless and managed inference (Token Factory)
  • MLOps tooling and 24/7 expert support
  • Commitment discounts up to 35%
  • Single API for LLM, image, video, and audio models
  • Access to GPT, Claude, Gemini, Seedance, and more
  • Usage-based, pay-as-you-go pricing
  • Model comparison and documented capabilities
  • Smart Router for model selection
  • 99.9% uptime, no credit card to start
Use cases
  • Serving open models in production apps and agents
  • Fine-tuning models on private data
  • Powering code assistants, chatbots and RAG at scale
  • Serving open-source models via API
  • Building AI apps cost-efficiently
  • Renting GPUs for inference or training
  • Scaling inference up and down on demand
  • Renting GPUs for model training and fine-tuning
  • Deploying low-latency real-time inference APIs
  • Running AI agents that need to scale instantly
  • Processing compute-heavy batch or distributed workloads
  • Train large AI/ML models on GPU clusters
  • Run scalable inference workloads
  • Store and manage large training datasets
  • Run Slurm/Kubernetes AI pipelines
  • Add multiple AI models to a product via one API
  • Switch between model providers without rewrites
  • Generate video, images, and audio programmatically
  • Build AI agents and workflows
Visit
More in Model Hosting Inference