GPUStack

Input—per 1M tokens

Output—per 1M tokens

Context—tokens

WeightsClosed

About

GPUStack is ranked #3 of 18 in GPU Cluster Management Software on Inferse. It runs on API, Linux, macOS, Self-hosted, Web, Windows. There is a free plan.

Compared on GPU Cluster Management Software

Free plan: Yesgpustack.ai
Deployment model: hybridgpustack.ai
Workload scheduling: interactivegpustack.ai
Kubernetes support: Yesgpustack.ai
Quota controls: Yesgpustack.ai
GPU utilization metrics: Yesgpustack.ai
Cloud GPU support: Yesgpustack.ai

Facts

What it does: GPUStack is an open-source GPU cluster manager for deploying, governing, and scaling AI models across on-premise, cloud, or hybrid infrastructure.gpustack.ai · 29 Sept 2026
Inference APIs: It exposes models through OpenAI-compatible and Anthropic-compatible endpoints.gpustack.ai · 29 Sept 2026
Inference engines: The platform supports inference engines including vLLM, SGLang, llama.cpp, TensorRT-LLM, and MindIE.gpustack.ai · 29 Sept 2026
Model sources: Users can browse and download models from Hugging Face and ModelScope or provide local model files, with automated compatibility checks.gpustack.ai · 29 Sept 2026
GPU service: GPUStack can provision GPU instances with lifecycle controls, GPU partitioning, SSH key injection, Jupyter access, and persistent S3 or NFS storage.gpustack.ai · 29 Sept 2026
Deployment: It supports on-premise, Kubernetes, and multi-cloud GPU deployments, and the maker states that air-gapped deployments are supported.gpustack.ai · 29 Sept 2026
Supported hardware: The maker lists NVIDIA, AMD, Ascend, T-head, Hygon, MetaX, Moore Threads, Cambricon, and Iluvatar accelerators.gpustack.ai · 29 Sept 2026
Integrations: Listed integrations include OpenWebUI, LangChain, n8n, Dify, RAGFlow, Claude Code, OpenClaw, Docker, Podman, Kubernetes, Helm, Prometheus, and Grafana.gpustack.ai · 29 Sept 2026
Security: The site lists RBAC, multi-tenancy, OIDC/SAML/AD-LDAP SSO, scoped API keys, IP allowlisting, token quotas, and usage analytics.gpustack.ai · 29 Sept 2026
Enterprise security: GPUStack Enterprise describes immutable audit logs, CIDR-based IP allowlists and blocklists, and per-model and per-API-key access rules.gpustack.ai · 29 Sept 2026
Enterprise availability: GPUStack Enterprise describes control-plane and model-service high availability with automatic failover and traffic rerouting.gpustack.ai · 29 Sept 2026
Enterprise licensing: The contact page directs users to contact the company for pricing and Enterprise Edition licensing.gpustack.ai · 29 Sept 2026
Support: The contact page offers personalized demos and architecture, deployment, and scaling guidance, and says replies typically arrive within one business day.gpustack.ai · 29 Sept 2026
Linux worker requirement: The Docker installation page says GPUStack worker nodes support Linux only; Windows users are directed to consider WSL2, and macOS is not supported for worker nodes.docs.gpustack.ai · 29 Sept 2026