The OS for personal AI clusters/open source

Turn the GPUs
you already own
into one computer.

One machine is never enough. Instead of renting the cloud or spending weeks stitching infrastructure together, install a 1 MB agenton every box with a GPU. Clystria fuses them into one cluster that just works — you don't think about which machine does what. You just deploy.

0
nodes online
0
GPUs pooled
0 GB
unified VRAM
terminal — clystria@home

install the agent · join the cluster · deploy a model — that's it.

Any silicon · any modelmix consumer & datacenter GPUs in one pool
RTX 4090H100 SXMRTX 5090A100 80GBMI300XRTX 3090L40SGH200M3 UltraRTX 6000 AdaMI250RTX 4080RTX 4090H100 SXMRTX 5090A100 80GBMI300XRTX 3090L40SGH200M3 UltraRTX 6000 AdaMI250RTX 4080
Hugging FacePyTorchvLLMOllamaLlama 3.1MixtralQwen 2.5DeepSeekStable DiffusionWhisperOpenAI APINCCLHugging FacePyTorchvLLMOllamaLlama 3.1MixtralQwen 2.5DeepSeekStable DiffusionWhisperOpenAI APINCCL
(01) The state of things

You bought the compute. You're still renting the answer.

ERR_01

Stranded silicon

A 4090 here, an A6000 there, a rack of H100s no one can fully book. Each a locked island. Your building already holds a supercomputer — it just doesn't know it yet.

ERR_02

The YAML tax

Kubernetes, Helm, schedulers, operators, service meshes. A second full-time job just to run the first one. Most teams give up and rent the cloud back at 8× markup.

ERR_03

Models too big to fit

The best open models no longer fit on one card. Sharding them by hand across machines is a research project. So they sit undeployed, and you pay per token elsewhere.

(02) The ritual

Three moves from cold metal to live intelligence.

1
INSTALL

Drop the agent on any GPU box

One line. 1.2 MB. Zero dependencies. It fingerprints the GPU, VRAM, interconnect and thermals, then whispers itself onto the network. Works on Linux, Windows, or that Mac Studio in the corner.

$ curl clystria.sh | sh
2
FUSE

Machines melt into one pool

Agents gossip over your LAN and self-assemble into a single fabric. No control-plane to babysit, no etcd to lose sleep over. VRAM, compute and bandwidth become one addressable pool that grows the instant a machine powers on.

$ clystria status
▸ 14 nodes · 512 GB VRAM · healthy
3
DEPLOY

Summon any model, one command

Clystria reads the model, plans which layers live on which GPU, balances the KV-cache, and routes traffic. A machine dies mid-request? Layers re-forge onto survivors before the token stream even stutters.

$ clystria deploy mixtral-8x22b --replicas auto
(03) One cluster · many machines

You don't think about which machine does what. You just deploy.

Gaming PCs, workstations, old servers, whatever you have — Clystria binds them into one system. Add a GPU and the cluster uses it. Lose a machine and the workload moves.

online
Gaming PC
2× RTX 4090
online
Workstation
2× RTX 3090
online
Old Server
2× RTX 6000 Ada
online
Lab Box
2× RTX 4090
ClystriaClystria
Clystria Cluster

Unified compute. Shared memory. One network.

Healthy · 8 GPUs · 160 GB VRAM
output
Deploy any model
Live · self-healing

Kill a machine. Watch it heal.

A live simulation of the control loop: four machines serve a 70B model, a node dies — and the workload re-forges onto the survivors before you'd notice. Hit Kill a node yourself.

SERVINGcluster / home
4/4
nodes
1,940
tok/s
160 GB
pooled
UNIFIED VRAM POOL101 GB / 160 GB · 63% forged
studio-pc
2× RTX 4090
32 / 48 GBlive
buildbox
2× RTX 3090
30 / 48 GBlive
server-01
2× RTX 6000 Ada
28 / 40 GBlive
old-desktop
2× RTX 3080
12 / 24 GBlive

Live · llama-3.1-70b sharded across 8 GPUs · KV-cache balanced · 0 spillover.

(04) What the OS does for you

An entire cluster team, compiled into a daemon.

01

Unified memory pool

Every card's VRAM becomes one addressable space. Run models bigger than any single GPU could ever hold.

02

Automatic layer placement

Clystria reads each model and decides which layers live where — by VRAM, bandwidth, and thermals. You never touch a shard map.

03

Self-healing failover

A machine dies mid-inference and layers re-forge onto survivors. Requests drain gracefully. Uptime measured in nines.

04

Zero Kubernetes

No control plane, no etcd, no Helm charts. A gossiping mesh that assembles itself. Delete the YAML museum.

05

One-command deploy

clystria deploy <model>. Quantization, sharding, routing and autoscaling handled. From HF repo to endpoint in seconds.

06

Gloriously heterogeneous

Mix a 4090, an H100 and a Mac Studio in the same pool. Clystria weighs each by its true throughput. No card left behind.

07

OpenAI-compatible

A drop-in /v1/chat/completions endpoint. Point your existing app at your own hardware. Cancel the invoice.

08

Live observability

Per-layer utilization, token economics, thermal maps and traces — streamed in real time. See the metal think.

Drop-in API

OpenAI-compatible. Point & go.

Every deployment exposes a /v1 endpoint that speaks the OpenAI protocol. Change one base URL and your existing app runs on hardware you own — no rewrite, no vendor SDK.

  • Chat, completions & embeddings
  • Streaming + tool calls
  • Cancel the cloud invoice
curl http://home.local:8080/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "llama-3.1-70b",
    "messages": [{"role": "user", "content": "hi"}]
  }'
(05) The reckoning

You, versus the hyperscalers.

ClystriaKubernetesHyperscale cloud
Time to first model~90 seconds2–6 weeksminutes*
Config to maintainNoneThousands of YAML linesVendor console sprawl
Where your data livesYour buildingYour clusterSomeone else's
8×H100 for a monthHardware you ownHardware you own$50k+ rented
Mix consumer + datacenter GPUsBy designFight the schedulerNot allowed
When a node diesSelf-heals, no ticketPage the on-callRead the status page
Runs on the gaming PC upstairsAbsolutelyPlease don'tN/A

* until the bill arrives.

The math

You already bought the GPUs. Stop renting them back.

8
1a homelaba rack · 64
60%
10%always-on inference100%

Renting 8 datacenter-class GPUs at ~$2.4/hr. With Clystria that same compute runs on the hardware you already own — for the price of electricity.

The cloud would charge
$8,294/mo
You keep, per year
$99,533
Own your compute →

Illustrative. Real savings depend on your hardware, power cost and usage.

(06) The crew

Built by two engineers.

Two builders who got tired of renting compute they already owned — and built the operating system to fix it.

Shub Gaur
Shub Gaur
Founder & CEO

Optimize for fun, build for delight. Turning idle GPUs into one machine.

Irfan Sharif
Irfan Sharif
Co-founder & CTO

Built GPU clusters, storage and replication engines. Systems, top to bottom.

(07) The manifesto

The compute already exists. It's humming under desks, idling in closets, sleeping in racks that run at nine percent utilization. Every building is already a supercomputer — scattered, unaware, waiting for something to bind it into one.

Clystria is the binding. A private AI cloud shouldn't need a platform team, a data-center lease, or a hyperscaler's permission. It should be as easy as plugging computers into the same network.

OWN YOUR INTELLIGENCE
(08) Request access

Light your
own forge.

Point us at the GPUs you already own. We'll turn them into a single AI computer you fully control — and never send a token to a cloud you don't.

— No credit card— Self-hosted— Your data never leaves— Open-core