runoffline.ai is the international hub for everyone exploring local LLMs — 100% open-source runtimes like Ollama, Open WebUI and Jan, and a new wave of personal agent platforms like OpenClaw, Hermes Agent and ZeroClaw. No clouds. No telemetry. No proprietary lock-in.
New models ship faster than ever. Here's what just hit Hugging Face and can run on your own hardware — updated as releases happen.
The next generation of DeepSeek's flagship. Bigger context, stronger reasoning, and still fully open-weight — the release everyone's been waiting for since V3.
Hugging Face →Alibaba's top-tier Qwen 3 variant — trades blows with closed frontier models on code, math, and multilingual tasks, all still shippable locally.
Hugging Face →Meta's first natively multimodal MoE. Scout fits a single H100; Maverick is the enterprise tier. Both open-weight, both shipping on day one in llama.cpp.
Hugging Face →Google's small-model series gets a major upgrade — longer context, vision, and 27B is the new sweet spot for a single consumer GPU.
Hugging Face →Mistral's flagship returns to fully permissive Apache 2.0 weights. Strong function calling, excellent European-language coverage.
Hugging Face →The successor to FLUX.1 — sharper prompt adherence and better text-in-image. Drops straight into ComfyUI, Forge, and SwarmUI.
Hugging Face →Local AI flips the economics and ethics of intelligence. Your prompts, your files, your agents, and your reasoning — all stay on your machine, under your control.
Every token is computed on your CPU/GPU. No prompts uploaded, no logs scraped, no vendor training on your workflow.
A plane seat, a remote cabin, a classified network — your models keep working exactly the same, with zero latency to a data center.
Run millions of tokens a day without a bill. The only cost is the electricity you were already paying for.
Swap models, quantizations, system prompts, tools, and memory. You aren't stuck in someone else's sandbox.
Apple Silicon, NVIDIA, AMD and even modest CPUs can now stream tokens fast enough for real agentic work.
From GGUF models to MCP tools, the local stack is open, inspectable, and composable — the way software should be.
Whether you want a one-line install or a full developer-grade toolkit, there's a runtime made for your workflow.
The easiest way to pull, run and serve open models. One command, hundreds of models, instant OpenAI-compatible API.
Details on runoffline →
A ChatGPT-class web interface for your local models — multi-user, RAG, plugins, all open source.
Details on runoffline →A fully-open, privacy-first desktop chat app that runs local and remote models with an extension system.
Details on runoffline →
The legendary C/C++ inference engine that made local LLMs practical. Powers most tools on this page.
Details on runoffline →A new generation of desktop-native agents that can see your screen, click your apps, read your files and get real work done — all without sending a single byte to the cloud.
The community answer to Claude Computer Use. Gives any local model hands — mouse, keyboard, browser and shell — with a safe action layer.
Details on runoffline →A multi-agent orchestrator built around the Hermes instruction-tuned models, designed for chained reasoning, tool use and long-horizon tasks.
Details on runoffline →Spin up an autonomous agent with a single binary. ZeroClaw plans, executes and self-reviews goals using any Ollama or llama.cpp model.
Details on runoffline →A complete catalog of free models — chat, coding, reasoning, vision, image generation, speech, music, video and embeddings — each mapped to the loaders that can actually run it.
Instruction-tuned LLMs for writing, Q&A and the reasoning core of most agents.
Drop-in backends for Continue, Aider and Cline — local Copilot quality, zero code leaving your box.
"Think-before-you-speak" models that outscore GPT-4-class systems on math and logic.
Different plumbing from LLMs — needs ComfyUI, Forge, InvokeAI or Draw Things. We map every model to its loader.
Let agents see images, screens and documents — the brain behind OpenClaw-style computer use.
Local transcription, voice cloning, song generation and video synthesis — all open-weight, all offline.
# 1. Install Ollama curl -fsSL https://ollama.com/install.sh | sh # 2. Pull a strong open model ollama pull llama3.1:8b # 3. Chat with it — fully offline ollama run llama3.1:8b "Draft a launch email for runoffline.ai" # 4. Or use the OpenAI-compatible API curl http://localhost:11434/v1/chat/completions \ -H "Content-Type: application/json" \ -d '{"model":"llama3.1:8b","messages":[{"role":"user","content":"hi"}]}'
runoffline.ai is more than a directory — it's a rallying point. See what builders are shipping on X right now, jump into the biggest local-AI subreddits, trending GitHub repos and Hacker News threads, or hop straight into a Discord full of people who run models on their own machines.
Follow #LocalLLM, #Ollama, #OpenSourceAI for the worldwide conversation.
The central nervous system of the open-source LLM world.
Real-time help from Ollama maintainers and power users.
Where nearly every open-weight model ships first.
Open-source ChatGPT alternative, fully offline-capable.
Decentralized, privacy-first chat for local-AI hackers.
Deep-dive issues, RFCs and build tips across every project.
Demos, benchmarks and hot takes from builders worldwide.
Long-form threads dissecting every local-AI release.
New runtimes, hot models, and the best community threads — curated, zero spam.
A glimpse of what builders around the world are saying.
Dive into the full catalog of runtimes and agents — carefully curated, neutrally compared, and updated as the local-AI world moves fast.