Sitelet https://diffuse-systems.github.io/diffuse/

DiffuseYour own AI. Split across the world.

Large language models running on a peer-to-peer network of ordinary machines. Your prompt never leaves your device in clear text.

Get started

How it works

GitHub

🧠

Runs the impossible

Models too large for one machine run across many small ones, split vertically by layers. An old laptop gives what it can, a workstation gives more.

🕸️

Organizes itself

No master, no server. Nodes find each other by gossip, measure their own hardware, and take the slice the network needs most. When one falls, the others heal the gap.

🔒

Keeps your words home

Your device tokenizes locally and traffic is sealed end to end with X25519 and ChaCha20-Poly1305. No certificate authority, keys bound to node identities.

🌐

Reaches every contributor

Nodes behind NAT or a firewall serve through an encrypted relay, so a home machine can contribute, not only consume.

⚡

Streams in real time

Answers appear token by token as the network generates them, not in one delayed block. Works from the CLI or any OpenAI-compatible client.

🧩

OpenAI-compatible

A local server speaks the OpenAI API, so LibreChat, Open WebUI, Continue and the official SDKs work against the network with no code changes.

no serversno surveillanceno prompt loggingbuilt with Rust + PyTorchlicense AGPL-3.0

Built on and works with

RusttokioPyTorchTransformersHugging FaceX25519ChaCha20-Poly1305Ed25519LibreChatOpen WebUIContinueOpenAI APIRusttokioPyTorchTransformersHugging FaceX25519ChaCha20-Poly1305Ed25519LibreChatOpen WebUIContinueOpenAI API