runoffline.ai is the international hub for everyone exploring local LLMs — 100% open-source runtimes like Ollama, Open WebUI and Jan, and a new wave of personal agent platforms like OpenClaw, Hermes Agent, ZeroClaw and OpenCode. No clouds. No telemetry. No proprietary lock-in.
New models ship faster than ever. Here's what just hit Hugging Face and can run on your own hardware — updated as releases happen.
The release of the year. V4-Pro (1.6T total / 49B active) and V4-Flash (284B / 13B active) ship under MIT with a 1M-token context, and need just ~10% of V3's KV cache. Open weights are already on Hugging Face.
Hugging Face →The Qwen team's freshest MoE — A3B activations make it sip VRAM while topping the open leaderboards on tool-use and multilingual tasks. Drops straight into Ollama and vLLM.
Hugging Face →The Gemma family's biggest leap yet — frontier-level reasoning at every size, native vision, and 27B is the new sweet spot for a single 24 GB consumer GPU.
Hugging Face →Meta's first natively multimodal MoE. Scout (17B active) fits a single H100; Maverick is the workstation tier and still leads open-weight MMLU at 85.5%.
Hugging Face →Zhipu's flagship is now an open-weight contender. GLM-5.1 is purpose-tuned for agent loops, with strong function-calling and one of the cleanest tool-use schemas in the open ecosystem.
Hugging Face →Mistral's flagship returns to fully permissive Apache 2.0 weights — multimodal, 80+ languages, and the strongest open European-language model on the market.
Hugging Face →The successor to FLUX.1 takes open image gen from "experimental" to true production-grade — sharper prompt adherence, real text rendering, and the new go-to checkpoint for ComfyUI, Forge and SwarmUI.
Hugging Face →OpenAI's first open-weight release (120B MoE / 5.1B active, runs on a single 80 GB H100) and Nous Research's Hermes 4 — the first local model trained mostly on real agent traces — are now baseline picks for any local agent stack.
Hugging Face →Local AI flips the economics and ethics of intelligence. Your prompts, your files, your agents, and your reasoning — all stay on your machine, under your control.
Every token is computed on your CPU/GPU. No prompts uploaded, no logs scraped, no vendor training on your workflow.
A plane seat, a remote cabin, a classified network — your models keep working exactly the same, with zero latency to a data center.
Run millions of tokens a day without a bill. The only cost is the electricity you were already paying for.
Swap models, quantizations, system prompts, tools, and memory. You aren't stuck in someone else's sandbox.
Apple Silicon, NVIDIA, AMD and even modest CPUs can now stream tokens fast enough for real agentic work.
From GGUF models to MCP tools, the local stack is open, inspectable, and composable — the way software should be.
Whether you want a one-line install or a full developer-grade toolkit, there's a runtime made for your workflow.
The easiest way to pull, run and serve open models. One command, hundreds of models, instant OpenAI-compatible API.
Details on runoffline →
A ChatGPT-class web interface for your local models — multi-user, RAG, plugins, all open source.
Details on runoffline →A fully-open, privacy-first desktop chat app that runs local and remote models with an extension system.
Details on runoffline →
The legendary C/C++ inference engine that made local LLMs practical. Powers most tools on this page.
Details on runoffline →A new generation of desktop-native agents that can see your screen, click your apps, read your files and get real work done — all without sending a single byte to the cloud.
The community answer to Claude Computer Use. Gives any local model hands — mouse, keyboard, browser and shell — with a safe action layer.
Details on runoffline →A multi-agent orchestrator built around the Hermes instruction-tuned models, designed for chained reasoning, tool use and long-horizon tasks.
Details on runoffline →Spin up an autonomous agent with a single binary. ZeroClaw plans, executes and self-reviews goals using any Ollama or llama.cpp model.
Details on runoffline →
The most adopted open-source terminal coding agent. LSP-powered edits, multi-session, and works with any local model via 75+ LLM providers.
Details on runoffline →A complete catalog of free models — chat, coding, reasoning, vision, image generation, speech, music, video and embeddings — each mapped to the loaders that can actually run it.
Instruction-tuned LLMs for writing, Q&A and the reasoning core of most agents.
Drop-in backends for Continue, Aider and Cline — local Copilot quality, zero code leaving your box.
"Think-before-you-speak" models that match closed frontier systems on math, logic and agent decisions.
Different plumbing from LLMs — needs ComfyUI, Forge, InvokeAI or Draw Things. We map every model to its loader.
Let agents see images, screens and documents — the brain behind OpenClaw-style computer use.
Local transcription, voice cloning, song generation and video synthesis — all open-weight, all offline.
# 1. Install Ollama curl -fsSL https://ollama.com/install.sh | sh # 2. Pull a strong open model ollama pull llama3.1:8b # 3. Chat with it — fully offline ollama run llama3.1:8b "Draft a launch email for runoffline.ai" # 4. Or use the OpenAI-compatible API curl http://localhost:11434/v1/chat/completions \ -H "Content-Type: application/json" \ -d '{"model":"llama3.1:8b","messages":[{"role":"user","content":"hi"}]}'
runoffline.ai is more than a directory — it's a rallying point. See what builders are shipping on X right now, jump into the biggest local-AI subreddits, trending GitHub repos and Hacker News threads, or hop straight into a Discord full of people who run models on their own machines.
Follow #LocalLLM, #Ollama, #OpenSourceAI for the worldwide conversation.
The central nervous system of the open-source LLM world.
Real-time help from Ollama maintainers and power users.
Where nearly every open-weight model ships first.
Open-source ChatGPT alternative, fully offline-capable.
Decentralized, privacy-first chat for local-AI hackers.
Deep-dive issues, RFCs and build tips across every project.
Demos, benchmarks and hot takes from builders worldwide.
Long-form threads dissecting every local-AI release.
New runtimes, hot models, and the best community threads — curated, zero spam.
A glimpse of what builders around the world are saying.
Dive into the full catalog of runtimes and agents — carefully curated, neutrally compared, and updated as the local-AI world moves fast.