Garnet

Input—per 1M tokens

Output—per 1M tokens

Context—tokens

WeightsClosed

About

Garnet is ranked #8 of 16 in caching software on Inferse. It runs on Linux, macOS, Self-hosted, Windows. There is a free plan.

Compared on caching software

Free plan: Yesmicrosoft.github.io
Deployment: self_hostedmicrosoft.github.io
Cache targets: application data, key-value data, strings, lists, sets, sorted sets, hashesmicrosoft.github.io
Data persistence: Yesmicrosoft.github.io
High availability: Yesmicrosoft.github.io
Supported cache engines: RESP, Redis-compatible clients, Tsavoritemicrosoft.github.io

Facts

Purpose: Garnet is a remote cache-store from Microsoft Research designed for high performance, extensibility, and low latency.microsoft.github.io · 29 Sept 2026
Protocol and clients: Garnet uses the RESP protocol and works with many unmodified Redis clients, including StackExchange.Redis.microsoft.github.io · 29 Sept 2026
Data APIs: Its API includes strings, lists, hashes, sets, sorted sets, geo operations, HyperLogLog, bitmaps, ACLs, pub/sub, transactions, and Lua scripting.microsoft.github.io · 29 Sept 2026
Storage and recovery: Garnet supports datasets larger than memory using local or cloud storage, along with checkpointing and recovery.microsoft.github.io · 29 Sept 2026
Cluster features: Multi-node cluster mode supports sharding, state migration, and replication.microsoft.github.io · 29 Sept 2026
Extensibility: A custom operator framework lets developers register C# data structures and read-modify-write operations.microsoft.github.io · 29 Sept 2026
Preview features: Vector database support using DiskANN and range index support using Bf-Tree are marked preview.microsoft.github.io · 29 Sept 2026
Platforms: The server is extensively tested on Windows and Linux, and is also described as running on Azure hardware and edge devices.microsoft.github.io · 29 Sept 2026
Security: Garnet supports TLS/SSL connections and RESP password-based authentication.microsoft.github.io · 29 Sept 2026
Compatibility limit: Garnet is not intended to be a fully compatible Redis drop-in replacement, and it does not support Redis modules.microsoft.github.io · 29 Sept 2026
Managed service: Azure Cosmos DB Garnet Cache handles infrastructure provisioning, scaling, patching, and monitoring automatically; it is in expanded Private Preview.microsoft.github.io · 29 Sept 2026
Integrations: The documented Redis client libraries include StackExchange.Redis, Jedis, Redisson, redis-py, node_redis, and go-redis.microsoft.github.io · 29 Sept 2026
License: The Garnet project is licensed under the MIT License.github.com · 29 Sept 2026
Support and community: The project site links to Discord and GitHub for community and project information.microsoft.github.io · 29 Sept 2026