/* Target the background image span */
.fixed.inset-0[style*='background-image'] {
  background-repeat: no-repeat;
  background-position: top right;
  background-size: cover;
  -webkit-touch-callout: none;
}   

Chat models

Image models

Explore the models currently available for serverless inference, ready to deploy instantly for chat, vision, and image generation.

Current

Nscale

Welcome to the Nscale docs. Discover how to get started and unlock the full potential of Nscale.

Overview

Get up and running with Nscale’s serverless inference models in just a few steps. This guide will walk you through signing up, adding credit to your account, and making your first API call to start leveraging the power of our AI models.

Quickstart

This guide will walk you through installing and using the Nscale Command Line Interface (CLI).

Nscale CLI

This guide will walk you through integrating a chat model into your application using Nscale’s API. With our serverless architecture, you can focus on building your application without worrying about infrastructure management.

Chat

This guide will walk you through integrating image generation models into your application using Nscale's API. With our serverless architecture, you can focus on building your application without worrying about infrastructure management.

Image Generation

Fine Tuning

Evaluations

Contact our sales team to get access to GPU clusters

GPU Clusters

Nscale AI services use a credit-based billing system. To access AI services, you’ll need to purchase credits, which are deducted as you consume resources. You can monitor your balance, usage, and transaction history in the Usage & Billing section.

Credit

You can monitor your usage and spend in the Usage & Billing section to manage costs, optimise workloads, and prevent unexpected credit depletion.

Monitoring usage

This section explains how to generate an API key in Nscale, along with important details about managing and securing your keys.

API Keys

Helpful resources and tutorials are on the way.

Coming Soon

Rate limits define the maximum number of requests a user can make to Nscale’s serverless inference service within a given time frame.

Rate Limits

Refer to the error codes below for troubleshooting common issues with Nscale's serverless inference service.

Error Codes

We’re excited to keep our platform at the cutting edge with robust open-source model upgrades.

Deprecations

Whatever you need, we're here to help—get in touch with the right team below.

Support

Terms

Quick Start

Create A Cluster

Connect To Cluster

Manage A Cluster

Welcome to the home of Nscale documentation

Create a Cluster

Teams

RBAC

Account

Organisation Access

Auth Tokens

SSH Keys

Returns a list of models available for the specified organization.

List models

Generates a chat completion response for the provided model and chat history.

Create chat completion

Creates an image based on the provided text prompt.

Create image

Docs

Private Cloud

API Reference

Console

A preview of upcoming models that will expand our serverless inference capabilities—stay tuned for what’s next.

Model name	Developer	API model string	Type	Price
Qwen QwQ 32B	Qwen	Qwen/QwQ-32B	Text-to-text	$0.18 Input /$ 0.20 Output per 1M tokens
Qwen 2.5-Coder 32B-Instruct	Qwen	Qwen/Qwen-2.5-Coder 32b-Instruct	Text-to-text	$0.06 Input /$ 0.20 Output per 1M tokens
Qwen 2.5-Coder 7B-Instruct	Qwen	Qwen/Qwen-2.5-Coder 7b-Instruct	Text-to-text	$0.01 Input /$ 0.03 Output per 1M tokens
Qwen 2.5-Coder 3B-Instruct	Qwen	Qwen/Qwen-2.5-Coder 3b-Instruct	Text-to-text	$0.01 Input /$ 0.03 Output per 1M tokens
DeepSeek / R1 671B GGUF	Deepseek	deepseek/DeepSeek-R1-671B-UD_Q2_K_XL	Text-to-text	$0.8 Input /$ 2.40 Output per 1M tokens
Deepseek R1 Distill: Llama-70B	Deepseek	deepseek-ai/DeepSeek-R1-Distill-Llama-70B	Text-to-text	$0.75 per 1M tokens
Deepseek R1 Distill: Llama-8B	Deepseek	deepseek-ai/DeepSeek-R1-Distill-Llama-8B	Text-to-text	$0.05 per 1M tokens
Deepseek R1 Distill: Qwen 32B	Deepseek	deepseek-ai/DeepSeek-R1-Distill-Qwen-32B	Text-to-text	$0.30 per 1M tokens
Deepseek R1 Distill: Qwen 14B	Deepseek	deepseek-ai/DeepSeek-R1-Distill-Qwen-14B	Text-to-text	$0.14 per 1M tokens
Deepseek R1 Distill: Qwen 7B (Math focused)	Deepseek	deepseek-ai/DeepSeek-R1-Distill-Qwen-7B	Text-to-text	$0.40 per 1M tokens
Deepseek R1 Distill: Qwen 1.5B (Math focused)	Deepseek	deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B	Text-to-text	$0.18 per 1M tokens
Llama 3.3 70B Instruct	Meta	meta-llama/Llama-3.3-70B-Instruct	Text-to-text	$0.40 per 1M tokens
Llama 3.1 8B Instruct	Meta	meta-llama/Llama-3.1-8B-Instruct	Text-to-text	$0.06 per 1M tokens
Mixtral 8x22B Instruct v0.1	Mistral AI	mistralai/mixtral-8x22b-instruct-v0.1	Text-to-text	$1.20 per 1M tokens

Model name	Developer	API model string	Type	Price
FLUX.1 [schnell]	Black Forest Labs	black-forest-labs/FLUX.1-schnell	Text-to-image	$0.0013 per 1M pixels
Stable diffusion XL Turbo	Stability AI	stabilityai/sdxl-turbo	Text-to-image	$0.03 per 1M pixels

Inference

Training

Manage

Guides

FAQs

Current

Chat models

Image models

Looking for a model?

Inference

Training

Manage

Guides

FAQs

​Chat models

​Image models

Looking for a model?

Chat models

Image models