kluster.ai

Core features

• ✦Adaptive Inference for intelligent scaling
• ✦Serverless inference and fine-tuning
• ✦Batch and real-time AI inference
• ✦OpenAI compatible API

Use cases

• →Analyzing vast amounts of EMRs, lab reports, and case histories in healthcare to identify eligible patients for clinical trials.
• →Performing monthly customer segmentation jobs with fine-tuned LLMs at a fraction of the cost of self-hosting.
• →Handling high volumes of AI requests without hitting rate limits.

How to use

Developers can deploy, scale, and fine-tune models using the kluster.ai platform. The platform offers an OpenAI compatible API, allowing users to submit requests and receive responses. Users can also fine-tune AI models by uploading datasets, starting fine-tuning jobs, and monitoring progress.

FAQ

Pricing

• Qwen3-235B-A22B: $0.15 input/ $2 output
• Qwen3-235B-A22B: $0.10 input/ $1.50 output
• Qwen3-235B-A22B: $0.08 input/ $1.00 output
• Qwen3-235B-A22B: $0.06 input/ $0.75 output
• Qwen2.5-VL-7B-Instruct: $0.30 input/output
• Qwen2.5-VL-7B-Instruct: $0.15
• Qwen2.5-VL-7B-Instruct: $0.10
• Qwen2.5-VL-7B-Instruct: $0.05
• Llama 4 Maverick: $0.2 input/ $0.8 output
• Llama 4 Maverick: $0.25
• Llama 4 Maverick: $0.20
• Llama 4 Maverick: $0.15
• Llama 4 Scout: $0.8 input/ $0.45 output
• Llama 4 Scout: $0.15
• Llama 4 Scout: $0.12
• Llama 4 Scout: $0.10
• DeepSeek-V3-0324: $0.7 input/ $1.4 output
• DeepSeek-V3-0324: $0.63
• DeepSeek-V3-0324: $0.50
• DeepSeek-V3-0324: $0.35
• DeepSeek-R1: $3 input/ $5 output
• DeepSeek-R1: $3.50
• DeepSeek-R1: $3.00
• DeepSeek-R1: $2.50
• Gemma 3: $0.35 input/output
• Gemma 3: $0.30
• Gemma 3: $0.25
• Gemma 3: $0.20
• Llama 8B Instruct Turbo: $0.18 input/output
• Llama 8B Instruct Turbo: $0.05
• Llama 8B Instruct Turbo: $0.04
• Llama 8B Instruct Turbo: $0.03
• Llama 70B Instruct Turbo: $0.70 input/output
• Llama 70B Instruct Turbo: $0.20
• Llama 70B Instruct Turbo: $0.18
• Llama 70B Instruct Turbo: $0.15
• M3-Embeddings: $0.01 input
• M3-Embeddings: $0.005
• M3-Embeddings: $0.005
• M3-Embeddings: $0.005
• Mistral NeMo: $0.025 input/ $0.07 output
• Mistral NeMo: $0.02 input/ $0.06 output
• Mistral NeMo: $0.018 input/ $0.05 output
• Mistral NeMo: $0.017 input/ $0.045 output