toolspool

Compare tools

Side-by-side features, use cases and pricing — because the right pick depends on your job and budget, not just the ranking.

Fireworks AI logo
Fireworks AI
✓ verifiedPaid

Developer platform for fast serverless inference and training of open generative models, billed per token or GPU-second.

611K visits/mo1.3K saves
Replicate AI logo
Replicate AI
✓ verifiedPaid

Pay-per-use cloud API to run, fine-tune, and deploy thousands of open-source and proprietary AI models with one line of code.

1.3M visits/mo17K saves
OpenRouter logo
OpenRouter
✓ verifiedFreemium

Unified API gateway that routes requests to 400+ LLMs across 70+ providers with failover and no subscription.

17M visits/mo
Nebius logo
Nebius
✓ verifiedPaid

AI-focused cloud offering NVIDIA GPU compute, storage and MLOps tooling for training and inference at scale, with usage-based pricing.

678K visits/mo133K saves
AI/ML API logo
AI/ML API
✓ verifiedPaid

Single API and playground for 1000+ AI models (chat, image, video, audio) with pay-as-you-go billing.

223K visits/mo5.7K saves
Pricing
On-Demand H100/H200: $7/GPU-hour
On-Demand B200: $10/GPU-hour
On-Demand B300: $12/GPU-hour
Fine-tuning (LoRA SFT, models up to 16B): from $0.50 per 1M training tokens
CPU (Small): $0.000025/sec ($0.09/hr)
Nvidia A100 80GB: $0.0014/sec ($5.04/hr)
Nvidia H100: $0.001525/sec ($5.49/hr)

Free trial available

Free: $0
Pay-as-you-go: Per-token, no subscription
Enterprise: Talk to sales
NVIDIA H100: $3.85/GPU-hour on-demand ($2.15 preemptible)
NVIDIA H200: $4.50/GPU-hour on-demand
NVIDIA B200: $7.15/GPU-hour on-demand
Shared filesystem storage: $0.08/GiB per month
Pay As You Go: $20 top-up (pay per use, all models)

Free trial available

Core features
  • Serverless per-token inference with OpenAI/Anthropic-compatible APIs
  • On-demand dedicated and reserved GPU deployments
  • Fine-tuning and reinforcement-learning training pipelines
  • Large library of open LLM, vision, image and audio models
  • Optimized inference engine for throughput and latency
  • One-line API calls to run community and proprietary AI models
  • Support for image, video, speech, and LLM generation models
  • Fine-tuning and custom model deployment via Cog
  • Per-second usage billing on shared or dedicated hardware
  • Automatic scaling for high-traffic private models
  • Thousands of community-published models with production APIs
  • One unified, OpenAI-compatible API for 400+ models
  • Automatic provider failover for higher uptime
  • Edge routing for low latency
  • Custom data and provider policies
  • Pay-as-you-go credits usable across any model
  • NVIDIA GPU instances (H100, H200, B200, GB200)
  • On-demand and preemptible GPU pricing
  • High-performance and object storage
  • Managed Kubernetes and Slurm (Soperator)
  • Serverless and managed inference (Token Factory)
  • MLOps tooling and 24/7 expert support
  • Commitment discounts up to 35%
  • One API for 1000+ models
  • OpenAI/Anthropic-compatible endpoints
  • Chat, image, video, audio and embedding models
  • AI playground/sandbox
  • Pay-as-you-go billing across models
  • Enterprise dedicated infrastructure option
Use cases
  • Serving open models in production apps and agents
  • Fine-tuning models on private data
  • Powering code assistants, chatbots and RAG at scale
  • Developers embedding image/video/speech generation into an app via API
  • Teams deploying and scaling their own fine-tuned models
  • Builders comparing outputs from multiple AI models in one playground
  • Companies avoiding GPU infrastructure management for ML inference
  • Accessing many LLMs through one integration
  • Adding provider redundancy to AI apps
  • Comparing model price and performance
  • Powering agents and AI-native products
  • Train large AI/ML models on GPU clusters
  • Run scalable inference workloads
  • Store and manage large training datasets
  • Run Slurm/Kubernetes AI pipelines
  • Integrating many AI models via one API
  • Prototyping and scaling AI apps
  • Cost-controlled multi-model access
Visit
More in Model Hosting Inference